Magical Touch: Transforming Raw Capacitive Streams into Expressive Hand-Touchscreen Interaction
Yuanlei Guo, Xizi Gong, Yizhong Zhang, Xiaoyu Zhang

TL;DR
Magical Touch leverages raw capacitive sensing data to enable more expressive, natural, and continuous hand interactions on touchscreens, expanding interaction possibilities beyond traditional fingertip contact.
Contribution
This work introduces a novel interaction method that directly uses raw capacitive data, allowing for arbitrary hand gestures and more expressive touchscreen interactions.
Findings
Enabled real-time, pressure-sensitive, and gesture-based interactions.
Demonstrated through a physics-based interactive game with multiple modes.
Showed expanded design space for embodied touchscreen interactions.
Abstract
Modern touchscreens utilize capacitive sensing technology to enable precise and robust multi-touch interaction. However, the broader expressive potential of the human hand remains underutilized, since most existing methods directly filter out larger-area hand-screen contact. This paper introduces Magical Touch, an interaction method based on raw capacitive sensing data. By directly integrating raw touchscreen sensor data into the interaction loop, our method allows users to interact with the screen naturally and efficiently using arbitrary hand gestures on existing touchscreen devices. To demonstrate the feasibility and expressive capacity of this approach, we implement a physics-based interactive game featuring single-player, multiplayer collaborative, and pressure-sensitive modes. These scenarios showcase how digital objects can respond in real-time to both the geometry and contact…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
