Multisensory cues facilitate coordination of stepping movements with a virtual reality avatar
Omar Khan, Imran Ahmed, Joshua Cottingham, Musa Rahhal, Theodoros N, Arvanitis, Mark Elliott

TL;DR
This study demonstrates that virtual reality avatars can effectively guide gait training, especially when combined with auditory cues, leading to improved coordination and stability in stepping movements.
Contribution
The paper introduces a novel visual cueing method using virtual avatars for gait retraining and shows that auditory cues enhance movement synchronization.
Findings
Auditory-visual cues stabilize asynchronies during gait tasks.
Participants respond adaptively to avatar movement perturbations.
Virtual avatars can influence real human gait patterns.
Abstract
The effectiveness of simple sensory cues for retraining gait have been demonstrated, yet the feasibility of humanoid avatars for entrainment have yet to be investigated. Here, we describe the development of a novel method of visually cued training, in the form of a virtual partner, and investigate its ability to provide movement guidance in the form of stepping. Real stepping movements were mapped onto an avatar using motion capture data. The trajectory of one of the avatar step cycles was then accelerated or decelerated by 15% to create a perturbation. Healthy participants were motion captured while instructed to step in time to the avatar's movements, as viewed through a virtual reality headset. Step onset times were used to measure the timing errors (asynchronies) between them. Participants completed either a visual-only condition, or auditory-visual with footstep sounds included.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMultisensory perception and integration · Neuroscience and Music Perception · Action Observation and Synchronization
