Bumpy Ride? Understanding the Effects of External Forces on Spatial Interactions in Moving Vehicles

TL;DR

This study examines how external forces like G-forces and vibrations affect 3D interaction methods in moving vehicles, revealing significant impacts on accuracy, efficiency, and workload, and offering insights for improving in-vehicle immersive experiences.

Contribution

It provides an empirical analysis of the effects of vehicle motion on various 3D interaction methods, highlighting challenges and proposing future research directions.

Findings

Vehicle motion significantly affects interaction accuracy and duration.

Movement impacts throughput, error rate, and perceived workload.

Different interaction methods respond variably to external forces.

Abstract

As the use of Head-Mounted Displays in moving vehicles increases, passengers can immerse themselves in visual experiences independent of their physical environment. However, interaction methods are susceptible to physical motion, leading to input errors and reduced task performance. This work investigates the impact of G-forces, vibrations, and unpredictable maneuvers on 3D interaction methods. We conducted a field study with 24 participants in both stationary and moving vehicles to examine the effects of vehicle motion on four interaction methods: (1) Gaze&Pinch, (2) DirectTouch, (3) Handray, and (4) HeadGaze. Participants performed selections in a Fitts' Law task. Our findings reveal a significant effect of vehicle motion on interaction accuracy and duration across the tested combinations of Interaction Method x Road Type x Curve Type. We found a significant impact of movement on throughput, error rate, and perceived workload. Finally, we propose future research considerations and recommendations on interaction methods during vehicle movement.