Effects of Virtual Controller Representation and Virtuality on Selection Performance in Extended Reality

TL;DR

This study investigates how different virtual controller representations affect selection performance in mixed and virtual reality, revealing that realistic representations improve performance but user perception varies across modes, highlighting design considerations.

Contribution

It provides empirical evidence on the impact of virtual controller representations on selection performance in MR and VR, emphasizing the importance of realistic virtual controllers.

Findings

Performance was similar between VR and MR.

Realistic virtual controllers improved selection accuracy.

User perception differed between MR and VR modes.

Abstract

We present an experiment exploring how the controller's virtual representation impacts target acquisition performance across MR and VR contexts. Participants performed selection tasks comparing four visual configurations: a virtual controller, a virtual hand, both the controller and the hand, and neither representation. We found performance comparable between VR and MR, and switching between them did not impact the user's ability to perform basic tasks. Controller representations mimicking reality enhanced performance across both modes. However, users perceived performance differently in MR, indicating the need for unique MR design considerations, particularly regarding spatial awareness.