A Novel Transformer-Based Method for Full Lower-Limb Joint Angles and Moments Prediction in Gait Using sEMG and IMU data

TL;DR

This paper introduces a transformer-based deep learning framework that accurately predicts full lower-limb joint angles and moments in real-time using wearable sEMG and IMU sensors, outperforming existing methods.

Contribution

The study develops two specialized Transformer Neural Networks for kinematic and kinetic prediction, demonstrating high accuracy and real-time applicability with wearable sensors.

Findings

Spearman correlation > 0.96 for all joints

R-squared > 0.92 for all predictions

Outperforms recent benchmark in joint angle prediction

Abstract

This study presents a transformer-based deep learning framework for the long-horizon prediction of full lower-limb joint angles and joint moments using surface electromyography (sEMG) and inertial measurement unit (IMU) signals. Two separate Transformer Neural Networks (TNNs) were designed: one for kinematic prediction and one for kinetic prediction. The model was developed with real-time application in mind, using only wearable sensors suitable for outside-laboratory use. Two prediction horizons were considered to evaluate short- and long-term performance. The network achieved high accuracy in both tasks, with Spearman correlation coefficients exceeding 0.96 and R-squared scores above 0.92 across all joints. Notably, the model consistently outperformed a recent benchmark method in joint angle prediction, reducing RMSE errors by an order of magnitude. The results confirmed the complementary role of sEMG and IMU signals in capturing both kinematic and kinetic information. This work demonstrates the potential of transformer-based models for real-time, full-limb biomechanical prediction in wearable and robotic applications, with future directions including input minimization and modality-specific weighting strategies to enhance model efficiency and accuracy.