Text to Blind Motion
Hee Jae Kim, Kathakoli Sengupta, Masaki Kuribayashi, Hernisa Kacorri, Eshed Ohn-Bar

TL;DR
This paper introduces BlindWays, a novel multimodal benchmark dataset capturing 3D motion and textual descriptions of blind pedestrians in urban environments, highlighting the limitations of current models in understanding diverse human movement behaviors.
Contribution
The work presents the first dataset of 3D motion and textual descriptions for blind pedestrians, and evaluates existing models, revealing their poor performance on this new, diverse data.
Findings
State-of-the-art models perform poorly on blind pedestrian data.
Blind pedestrians exhibit distinct movement patterns not captured by current models.
The dataset enables future research on diverse human motion understanding.
Abstract
People who are blind perceive the world differently than those who are sighted, which can result in distinct motion characteristics. For instance, when crossing at an intersection, blind individuals may have different patterns of movement, such as veering more from a straight path or using touch-based exploration around curbs and obstacles. These behaviors may appear less predictable to motion models embedded in technologies such as autonomous vehicles. Yet, the ability of 3D motion models to capture such behavior has not been previously studied, as existing datasets for 3D human motion currently lack diversity and are biased toward people who are sighted. In this work, we introduce BlindWays, the first multimodal motion benchmark for pedestrians who are blind. We collect 3D motion data using wearable sensors with 11 blind participants navigating eight different routes in a real-world…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDigital Humanities and Scholarship · Mathematics, Computing, and Information Processing · Handwritten Text Recognition Techniques
