Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles

TL;DR

Step2Motion is a novel method that reconstructs human locomotion using pressure and inertial data from wearable insoles, enabling robust motion capture in real-world scenarios without constraints.

Contribution

It introduces the first approach to human motion reconstruction from multi-modal insole sensors, combining pressure and inertial data for diverse locomotion styles.

Findings

Effective across various locomotion styles

Works in outdoor and unconstrained environments

Utilizes pressure and inertial data for accurate reconstruction

Abstract

Human motion is fundamentally driven by continuous physical interaction with the environment. Whether walking, running, or simply standing, the forces exchanged between our feet and the ground provide crucial insights for understanding and reconstructing human movement. Recent advances in wearable insole devices offer a compelling solution for capturing these forces in diverse, real-world scenarios. Sensor insoles pose no constraint on the users' motion (unlike mocap suits) and are unaffected by line-of-sight limitations (in contrast to optical systems). These qualities make sensor insoles an ideal choice for robust, unconstrained motion capture, particularly in outdoor environments. Surprisingly, leveraging these devices with recent motion reconstruction methods remains largely unexplored. Aiming to fill this gap, we present Step2Motion, the first approach to reconstruct human locomotion from multi-modal insole sensors. Our method utilizes pressure and inertial data-accelerations and angular rates-captured by the insoles to reconstruct human motion. We evaluate the effectiveness of our approach across a range of experiments to show its versatility for diverse locomotion styles, from simple ones like walking or jogging up to moving sideways, on tiptoes, slightly crouching, or dancing.