# Webcam-Based Exergame for Motor Recovery with Physical Assessment via DTW

## TL;DR

RehabHub is a webcam-based exergaming system that helps with motor recovery by assessing movement quality during exercises at home.

## Contribution

The integration of standardized physical assessment into exergaming using a webcam and DTW for movement quality quantification is novel.

## Key findings

- The single-angle method best distinguishes normal and abnormal movements for abduction and elbow flexion.
- Shoulder flexion scores were less distinct due to movement variability and posture-related angle fluctuations.
- The system's cloud-based platform enables remote monitoring with performance scores and recorded videos.

## Abstract

This paper presents RehabHub, a home-based exergaming system that integrates standardized physical assessment directly into gameplay by using a common webcam and MediaPipe for real-time pose estimation. The system quantifies upper-limb movement quality, specifically abduction, shoulder flexion, and elbow flexion based on FMA-UE guidelines, by applying Dynamic Time Warping (DTW) together with a Z-score-based scoring model that relies on data from non-clinical adult participants. A pilot study, which included movements simulated with a 5-kg resistance band, evaluated three feature-extraction methods. The findings indicate that the single-angle method provides the clearest distinction between normal and abnormal movements, particularly for abduction and elbow flexion. In the case of shoulder flexion, the score separation was less distinct because of movement variability and posture-related angle fluctuations, which suggests that further refinement of feature design is needed. The cloud-based platform supports remote monitoring and gives caregivers access to both performance scores and recorded exercise videos. Overall, the results demonstrate the feasibility of a low-cost webcam-based assessment integrated into exergaming, and they highlight important trends for improving abnormal-movement detection in home rehabilitation systems.