Fetuses Made Simple: Modeling and Tracking of Fetal Shape and Pose

TL;DR

This paper introduces the first 3D articulated statistical fetal body model based on SMPL, enabling improved fetal shape and pose analysis from MRI data, with applications in prenatal diagnostics.

Contribution

We develop a novel 3D fetal body model based on SMPL, trained on extensive MRI data, improving robustness and enabling automated measurements in fetal MRI analysis.

Findings

Achieves 3.2 mm surface alignment error on unseen fetal shapes.

Improves robustness to MRI motion artifacts and intensity distortions.

Enables automated fetal anthropometric measurements.

Abstract

Analyzing fetal body motion and shape is paramount in prenatal diagnostics and monitoring. Existing methods for fetal MRI analysis mainly rely on anatomical keypoints or volumetric body segmentations. Keypoints simplify body structure to facilitate motion analysis, but may ignore important details of full-body shape. Body segmentations capture complete shape information but complicate temporal analysis due to large non-local fetal movements. To address these limitations, we construct a 3D articulated statistical fetal body model based on the Skinned Multi-Person Linear Model (SMPL). Our algorithm iteratively estimates body pose in the image space and body shape in the canonical pose space. This approach improves robustness to MRI motion artifacts and intensity distortions, and reduces the impact of incomplete surface observations due to challenging fetal poses. We train our model on segmentations and keypoints derived from $19,816$ MRI volumes across $53$ subjects. Our model captures body shape and motion across time series and provides intuitive visualization. Furthermore, it enables automated anthropometric measurements traditionally difficult to obtain from segmentations and keypoints. When tested on unseen fetal body shapes, our method yields a surface alignment error of $3.2$ mm for $3$ mm MRI voxel size. To our knowledge, this represents the first 3D articulated statistical fetal body model, paving the way for enhanced fetal motion and shape analysis in prenatal diagnostics. The code is available at https://github.com/MedicalVisionGroup/fetal-smpl .