PressureVision: Estimating Hand Pressure from a Single RGB Image
Patrick Grady, Chengcheng Tang, Samarth Brahmbhatt, Christopher D., Twigg, Chengde Wan, James Hays, Charles C. Kemp

TL;DR
PressureVision demonstrates that a deep learning model can accurately estimate hand pressure from a single RGB image by leveraging appearance changes like tissue deformation and shadows, enabling non-intrusive pressure sensing.
Contribution
This work introduces PressureVisionNet, a novel deep model that infers hand pressure from RGB images, using appearance cues without specialized sensors, and generalizes across diverse participants.
Findings
Model outperforms baselines in pressure estimation.
Appearance cues like shadows significantly influence predictions.
Generalizes to unseen participants outside training data.
Abstract
People often interact with their surroundings by applying pressure with their hands. While hand pressure can be measured by placing pressure sensors between the hand and the environment, doing so can alter contact mechanics, interfere with human tactile perception, require costly sensors, and scale poorly to large environments. We explore the possibility of using a conventional RGB camera to infer hand pressure, enabling machine perception of hand pressure from uninstrumented hands and surfaces. The central insight is that the application of pressure by a hand results in informative appearance changes. Hands share biomechanical properties that result in similar observable phenomena, such as soft-tissue deformation, blood distribution, hand pose, and cast shadows. We collected videos of 36 participants with diverse skin tone applying pressure to an instrumented planar surface. We then…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsErgonomics and Musculoskeletal Disorders · Muscle activation and electromyography studies · Tactile and Sensory Interactions
