RealityDrop: A Multimodal Mixed Reality Framework to Manipulate Virtual Content between Cross-system Displays

TL;DR

RealityDrop is a multimodal mixed reality framework enabling seamless manipulation and transfer of virtual content across diverse display systems, enhancing collaboration through intuitive interactions.

Contribution

It introduces a novel MR framework that integrates multimodal interactions and cross-system interfaces for improved virtual content management.

Findings

Effective cross-system content transfer demonstrated

Enhanced collaboration through multimodal interactions

Flexible content manipulation across displays

Abstract

In this poster, we present RealityDrop, a novel multimodal framework that uses Mixed Reality (MR) technology to manipulate, display, and transfer virtual content across different display systems. Employing MR as the centre of control, RealityDrop affords concise information dissemination among diverse collaborators, through varied representations that best fit each display system's unique features using `superhuman' gaze and gesture interactions. Three multimodal interaction techniques, a customised content interpreter, and two cross-system interfaces are incorporated for fluent content manipulation and presentation.