Habilitation thesis of Florent Berthaut

Revealing Interactions : Expression and Exploration in Mixed and Virtual Reality

Artistic and cultural productions have often followed or inspired the development of immersive technologies. They have for instance greatly benefited from the generalisation of mixed and virtual reality headsets, mobile augmented reality or projection mapping software that happened in the past two decades. By freely integrating virtual elements within the physical space, these technologies allow for enriching the perception and interactions of artists, ensembles and audiences. My research lies at the intersection of 3D Interaction in Mixed and Virtual Reality and of Artistic, in particular Musical, Expression and Cultural Applications. Part of this research uses mixed-reality displays to reveal the mechanisms of complex or unfamiliar expressive interactions to spectators and collaborators of musical performances, with the goal of understanding and augmenting their experience. The other part investigates opportunities that arise for expression and cultural content exploration when virtual elements are revealed in the physical space, with the development of novel display technologies, interaction devices and techniques. Perspectives of this research include an in-depth study of the perception of digital interactions by the audience, the generalisation of levels-of-detail in the design of expressive interfaces, and the shift towards 3D interfaces that are less centred on technology and more on human expression.

defended on 27/10/2023