Align-to-Scale: Mode Switching Technique for Unimanual 3D Object Manipulation with Gaze-Hand-Object Alignment in Extended Reality

TL;DR

This paper introduces a mode switching technique called Align-to-Scale that enables single-handed 3D object scaling in XR by leveraging gaze-hand alignment, improving unimanual interaction capabilities.

Contribution

It presents novel techniques for one-handed scaling in XR using gaze-hand alignment as a mode switch, supported by usability evaluations and design guidelines.

Findings

All proposed methods enable effective one-handed scaling.

Each method has unique advantages and trade-offs.

Design guidelines support future unimanual 3D XR interactions.

Abstract

As extended reality (XR) technologies rapidly become as ubiquitous as today's mobile devices, supporting one-handed interaction becomes essential for XR. However, the prevalent Gaze + Pinch interaction model partially supports unimanual interaction, where users select, move, and rotate objects with one hand, but scaling typically requires both hands. In this work, we leverage the spatial alignment between gaze and hand as a mode switch to enable single-handed pinch-to-scale. We design and evaluate several techniques geared for one-handed scaling and assess their usability in a compound translate-scale task. Our findings show that all proposed methods effectively enable one-handed scaling, but each method offers distinct advantages and trade-offs. To this end, we derive design guidelines to support futuristic 3D interfaces with unimanual interaction. Our work helps make eye-hand 3D interaction in XR more mobile, flexible, and accessible.