Design of an XR Collab. Arch. for Mixed Immersive and MS Interaction

TL;DR

This paper presents an architecture integrating head-worn XR devices with touchscreen interfaces to enable collaborative analysis and decision-making across various domains, enhancing immersive multi-device interactions.

Contribution

It introduces a flexible architecture for combining XR headsets with digital touch devices, demonstrated through a maritime collaboration prototype.

Findings

Prototype supports collaborative analysis in maritime domain

Architecture adaptable to multiple domains and purposes

Enhances immersive multi-device interaction

Abstract

EXtended Reality (XR) is a rapidly developing paradigm for computer entertainment, and is also increasingly used for simulation, training, data analysis, and other non-entertainment purposes, often employing head-worn XR devices like the Microsoft HoloLens. In XR, integration with the physical world should also include integration with commonly used digital devices. This paper proposes an architecture to integrate head-worn displays with touchscreen devices, such as phones, tablets, or large tabletop or wall displays. The architecture emerged through the iterative development of a prototype for collaborative analysis and decision-making for the maritime domain. However, our architecture can flexibly support a range of domains and purposes. XR designers, XR entertainment researchers, and game developers can benefit from our architecture to propose new ways of gaming, considering multiple devices as user interfaces in an immersive collaborative environment.