Beyond Reality: Designing Personal Experiences and Interactive Narratives in AR Theater

TL;DR

This paper explores the design of immersive AR theater experiences that blend live storytelling with virtual elements, enabling personalized, interactive narratives in augmented reality environments.

Contribution

It introduces innovative methods for creating an immersive AR theater system that combines avatars, interactive elements, and user agency, informed by domain-specific research and prior publications.

Findings

Developed a well-designed AR stage with avatars and interactive features.

Enabled user engagement with stories at their own pace.

Ensured smooth, curated experiences aligned with creative visions.

Abstract

Augmented Reality (AR) technologies are redefining how we perceive and interact with the world by seamlessly integrating digital elements into our physical surroundings. These technologies offer personalized experiences and transform familiar spaces by layering new narratives onto the real world. Through increased levels of perceived agency and immersive environments, my work aims to merge the human elements of live theater with the dynamic potential of virtual entities and AI agents. This approach captures the subtlety and magic of storytelling, making theater experiences available anytime and anywhere. The system I am building introduces innovative methods for theatrical production in virtual settings, informed by my research and eight published works. These contributions highlight domain-specific insights that have shaped the design of an immersive AR Theater system. My research in building a well-designed AR stage features avatars and interactive elements that allow users to engage with stories at their own pace, granting them full agency over their experience. However, to ensure a smooth and curated experience that aligns with the director or creator's vision, several factors must be considered, especially in open-world settings that depend on natural user movement. This requires the story to be conveyed in a controlled manner, while the interaction remains intuitive and natural for the user.