Handows: A Palm-Based Interactive Multi-Window Management System in Virtual Reality

TL;DR

Handows introduces a palm-based, gesture-driven VR window management system that reduces physical effort and enhances efficiency, demonstrating the benefits of mobile-inspired metaphors in body-centric interfaces.

Contribution

The paper presents Handows, a novel palm-based interface for VR window management that combines ergonomic design with body-centric input, improving interaction efficiency and user comfort.

Findings

Handows significantly reduces physical effort compared to traditional VR techniques.

Handows improves task efficiency and interaction precision.

Users adopt spontaneous layout strategies in multitasking scenarios.

Abstract

Window management in virtual reality (VR) remains a challenging task due to the spatial complexity and physical demands of current interaction methods. We introduce Handows, a palm-based interface that enables direct manipulation of spatial windows through familiar smartphone-inspired gestures on the user's non-dominant hand. Combining ergonomic layout design with body-centric input and passive haptics, Handows supports four core operations: window selection, closure, positioning, and scaling. We evaluate Handows in a user study (N=15) against two common VR techniques (virtual hand and controller) across these core window operations. Results show that Handows significantly reduces physical effort and head movement while improving task efficiency and interaction precision. A follow-up case study (N=8) demonstrates Handows' usability in realistic multitasking scenarios, highlighting user-adapted workflows and spontaneous layout strategies. Our findings suggest the potential of embedding mobile-inspired metaphors into proprioceptive body-centric interfaces to support low-effort and spatially coherent interaction in VR.