Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants

TL;DR

This study evaluates three state-of-the-art pose estimation frameworks on infant videos to assess their accuracy for biomechanical analysis, highlighting their potential and limitations for early motor development assessment.

Contribution

It systematically compares pose estimation methods on infant data and demonstrates the feasibility of biomechanical modeling using these estimates.

Findings

Sapiens achieved the lowest reprojection error (22.8 pixels) and highest geometric consistency (0.82).

SAM 3D Body provided the most comprehensive 3D information for kinematic reconstruction.

Biomechanical models fitted to SAM 3D estimates can distinguish infant movement patterns related to motor development.

Abstract

arly identification of motor impairment in infancy relies on expert visual assessment of spontaneous movement, motivating the development of automated, objective alternatives. One promising approach is using computer vision, which benefits from high quality pose estimation from video. In this study, we systematically evaluated three state-of-the-art pose estimation frameworks (MeTRAbs-ACAE, SAM 3D Body, and Sapiens) on 100 videos over 13 sessions of 8 infants recorded with a multi-view markerless motion capture system. We quantified keypoint detection accuracy using reprojection error, geometric consistency, and Procrustes-aligned 3D position error, and demonstrated proof-of-concept for fitting an inverse kinematic framework to infant data. While Sapiens achieved the lowest reprojection error and highest geometric consistency of the methods evaluated (22.8 pixels and 0.82, respectively), SAM 3D Body provided the most comprehensive 3D information for kinematic reconstruction with Procrustes-aligned position errors of 19 to 28 mm. We demonstrate in a case comparison example that biomechanical models fit to SAM 3D estimates distinguish representative movement patterns in infants related to motor development, as identified by a clinical expert. Together, these findings highlight both the promise and current limitations of 3D pose estimation for infant biomechanics and establish preliminary groundwork for scalable, video-based assessment of early motor development.