Desk2Desk: Optimization-based Mixed Reality Workspace Integration for Remote Side-by-side Collaboration

TL;DR

Desk2Desk introduces an optimization-based method to seamlessly integrate dissimilar physical and virtual workspaces for remote mixed reality collaboration, enhancing immersive side-by-side interactions.

Contribution

It presents a novel optimization approach that adaptively merges different physical workspace layouts for improved remote mixed reality collaboration.

Findings

User study shows effective workspace merging

System handles physical workspace dissimilarities

Enhances immersive remote collaboration

Abstract

Mixed Reality enables hybrid workspaces where physical and virtual monitors are adaptively created and moved to suit the current environment and needs. However, in shared settings, individual users' workspaces are rarely aligned and can vary significantly in the number of monitors, available physical space, and workspace layout, creating inconsistencies between workspaces which may cause confusion and reduce collaboration. We present Desk2Desk, an optimization-based approach for remote collaboration in which the hybrid workspaces of two collaborators are fully integrated to enable immersive side-by-side collaboration. The optimization adjusts each user's workspace in layout and number of shared monitors and creates a mapping between workspaces to handle inconsistencies between workspaces due to physical constraints (e.g. physical monitors). We show in a user study how our system adaptively merges dissimilar physical workspaces to enable immersive side-by-side collaboration, and demonstrate how an optimization-based approach can effectively address dissimilar physical layouts.