SimulataR: Rapid Assisted Reality Prototyping using Design-Blended Videos

TL;DR

SimulataR is a cost-effective desktop tool that uses blended videos to simulate Assisted Reality experiences, enabling rapid prototyping and testing across various real-world environments without the need for expensive hardware.

Contribution

It introduces a novel, efficient method for prototyping Assisted Reality designs using design-blended videos, reducing time and resource requirements.

Findings

SimulataR closely approximates real OST-HMD experiences in indoor and low-to-moderate outdoor lighting.

The approach enables rapid testing and iteration in the design process.

Designers found SimulataR useful for early-stage AR development.

Abstract

Assisted Reality (aR) is a subfield of Augmented Reality (AR) that overlays information onto a user's immediate view via see-through head-mounted displays (OST-HMDs). This technology has proven to be effective and energy-efficient to support the user and information interaction for everyday wearable intelligent systems. The aR viewing experience, however, is affected by varying real-world backgrounds, lighting, and user movements, which makes designing for aR challenging. Designers have to test their designs in-situ across multiple real-world settings, which can be time-consuming and labor-intensive. We propose SimulataR, a cost-effective desktop-based approach for rapid aR prototyping using first-person-view context videos blended with design prototypes to simulate an aR experience. A field study involving 12 AR users comparing SimulataR to real OST-HMDs found that SimulataR can approximate the aR experience, particularly for indoors and in low-to-moderate lit outdoor environments. Case studies with two designers who used SimulataR in their design process demonstrates the potential of design-blended videos for rapid aR prototyping.