UC Santa Barbara

Immersive technologies are widely used in interactive media art and storytelling today. A high-quality virtual environment and avatar can provide the audience with a strong sense of presence and ownership of the virtual body, evoking empathetic outcomes from the experience. However, the majority of immersive art we encounter today shows a strong favoring of visual and auditory sensation over interactions. They provide the audience with a limited number of ways to participate in an immersive narrative, leaving them a sense of being an “outsider” that breaks the connection between the audience’s virtual avatar and the virtual environment. Starting with Nicolas Bourriaud’s relational aesthetics for art creation and taking human relations and their social context as the main conceptual and practical point of departure for experience design, I develop artistic and technical strategies for creating immersive experiences that place the audience at the center to let them activate the narrative content and cultural meanings. My approach is to provide the user novel ways to relate themselves to what they see on a screen, and to allow for direct participation and engagement. Through an increased level of interactivity, co-presence and plausibility in immersive environments, my work aims to help the audience develop new relationships with other people, with virtual entities, and with AI agents. The hybrid systems introduced in this thesis describe novel ways of creating relational experiences by techniques learned from different domains such as soft robotics, quantum computing and social science. I also demonstrate authoring interface design that can be more widely adopted by the creative community to overcome the challenges often faced in immersive and interactive narrative compositions.