Mixed Reality Outperforms Virtual Reality for Remote Error Resolution in Pick-and-Place Tasks

TL;DR

This study demonstrates that Mixed Reality interfaces significantly improve remote error resolution in pick-and-place tasks by enhancing speed, usability, and reducing mental workload compared to Virtual Reality and camera streams.

Contribution

The paper provides empirical evidence that Mixed Reality outperforms VR and camera interfaces in remote industrial error correction tasks, highlighting its advantages in usability and cognitive load.

Findings

MR enabled faster task resolution

Participants preferred MR interface

MR reduced perceived mental workload

Abstract

This study evaluates the performance and usability of Mixed Reality (MR), Virtual Reality (VR), and camera stream interfaces for remote error resolution tasks, such as correcting warehouse packaging errors. Specifically, we consider a scenario where a robotic arm halts after detecting an error, requiring a remote operator to intervene and resolve it via pick-and-place actions. Twenty-one participants performed simulated pick-and-place tasks using each interface. A linear mixed model (LMM) analysis of task resolution time, usability scores (SUS), and mental workload scores (NASA-TLX) showed that the MR interface outperformed both VR and camera interfaces. MR enabled significantly faster task completion, was rated higher in usability, and was perceived to be less cognitively demanding. Notably, the MR interface, which projected a virtual robot onto a physical table, provided superior spatial understanding and physical reference cues. Post-study surveys further confirmed participants' preference for MR over other interfaces.