HandOver: Enabling Precise Selection & Manipulation of 3D Objects with Mouse and Hand Tracking
Esen K. T\"ut\"unc\"u, Mar Gonzalez-Franco, Eric J. Gonzalez

TL;DR
HandOver integrates mouse precision with hand-tracking expressiveness in XR, enabling accurate 3D object selection and manipulation, improving task accuracy and ergonomics over traditional methods.
Contribution
The paper introduces a novel XR interaction technique that combines mouse and hand-tracking for precise and expressive 3D object manipulation.
Findings
HandOver reduces task errors across various distances.
It improves user ergonomics and comfort.
Users report lower workload with HandOver.
Abstract
We present HandOver, an extended reality (XR) interaction technique designed to unify the precision of traditional mouse input for object selection with the expressiveness of hand-tracking for object manipulation. With HandOver, the mouse is used to drive a depth-aware 3D cursor enabling precise and restful targeting -by hovering their hand over the mouse, the user can then seamlessly transition into direct 3D manipulation of the target object. In a formal user study, we compare HandOver against two raybased techniques: traditional raycasting (Ray) and a hybrid method (Ray+Hand) in a 3D docking task. Results show HandOver yields lower task errors across all distances, and moreover improves interaction ergonomics as highlighted by a RULA posture analysis and self-reported measures (NASA-TLX). These findings illustrate the benefits of blending traditional precise input devices with the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
