Automatic rehabilitation exercise task assessment of stroke patients based on wearable sensors with a lightweight multichannel 1D-CNN model

TL;DR

A low-cost system using wearable sensors and a lightweight 1D-CNN model assesses stroke patients' rehabilitation exercises at home with high accuracy.

Contribution

A multichannel 1D-CNN model with Naive Bayes fusion for accurate home-based rehabilitation exercise assessment.

Findings

The 1D-CNN model achieved 91.96% performance on the UCI-HAR dataset.

The multichannel 1D-CNN with Naive Bayes fusion achieved 97.23% F1-score on the Fugl-Meyer dataset.

The HREA system provides accurate and timely feedback for home rehabilitation.

Abstract

Approximately 75% of stroke survivors have movement dysfunction. Rehabilitation exercises are capable of improving physical coordination. They are mostly conducted in the home environment without guidance from therapists. It is impossible to provide timely feedback on exercises without suitable devices or therapists. Human action quality assessment in the home setting is a challenging topic for current research. In this paper, a low-cost HREA system in which wearable sensors are used to collect upper limb exercise data and a multichannel 1D-CNN framework is used to automatically assess action quality. The proposed 1D-CNN model is first pretrained on the UCI-HAR dataset, and it achieves a performance of 91.96%. Then, five typical actions were selected from the Fugl-Meyer Assessment Scale for the experiment, wearable sensors were used to collect the participants’ exercise data, and experienced therapists were employed to assess participants’ exercise at the same time. Following the above process, a dataset was built based on the Fugl-Meyer scale. Based on the 1D-CNN model, a multichannel 1D-CNN model was built, and the model using the Naive Bayes fusion had the best performance (precision: 97.26%, recall: 97.22%, F1-score: 97.23%) on the dataset. This shows that the HREA system provides accurate and timely assessment, which can provide real-time feedback for stroke survivors’ home rehabilitation.

Figures