EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors
Xinyu Yi, Yuxiao Zhou, Marc Habermann, Vladislav Golyanik, Shaohua, Pan, Christian Theobalt, Feng Xu

TL;DR
EgoLocate integrates sparse body-mounted inertial sensors and a monocular camera to perform real-time human motion capture, localization, and environment mapping, improving accuracy over existing methods.
Contribution
The paper introduces a novel system that combines inertial mocap with SLAM to enhance real-time human localization and mapping using minimal sensors.
Findings
Localization accuracy is significantly improved.
System operates in real time.
Outperforms state-of-the-art methods.
Abstract
Human and environment sensing are two important topics in Computer Vision and Graphics. Human motion is often captured by inertial sensors, while the environment is mostly reconstructed using cameras. We integrate the two techniques together in EgoLocate, a system that simultaneously performs human motion capture (mocap), localization, and mapping in real time from sparse body-mounted sensors, including 6 inertial measurement units (IMUs) and a monocular phone camera. On one hand, inertial mocap suffers from large translation drift due to the lack of the global positioning signal. EgoLocate leverages image-based simultaneous localization and mapping (SLAM) techniques to locate the human in the reconstructed scene. On the other hand, SLAM often fails when the visual feature is poor. EgoLocate involves inertial mocap to provide a strong prior for the camera motion. Experiments show that…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Pose and Action Recognition · Robotics and Sensor-Based Localization · Advanced Vision and Imaging
