CineMesh4D: Personalized 4D Whole Heart Reconstruction from Sparse Cine MRI

TL;DR

CineMesh4D is an innovative end-to-end pipeline that reconstructs personalized 4D whole-heart meshes from sparse multi-view cine MRI, improving accuracy and motion consistency for real-time cardiac assessment.

Contribution

The paper introduces a novel differentiable rendering loss and dual-context temporal block for comprehensive 4D heart reconstruction from sparse MRI data.

Findings

Outperforms existing methods in reconstruction quality.

Achieves superior motion consistency in 4D heart models.

Enables practical real-time cardiac assessment.

Abstract

Accurate 3D+t whole-heart mesh reconstruction from cine MRI is a clinically crucial yet technically challenging task. The difficulty of this task arises from two coupled factors: inherently sparse sampling of 3D cardiac anatomy by 2D image slices and the tight coupling between cardiac shape and motion. Current cardiac image-to-mesh approaches typically reconstruct only a subset of cardiac chambers or a single phase of the cardiac cycle. In this work, we propose CineMesh4D, a novel end-to-end 4D (3D+t) pipeline that directly reconstructs patient-specific whole-heart mesh from multi-view 2D cine MRI via cross-domain mapping. Specifically, we introduce a differentiable rendering loss that enables supervision of 3D+t whole-heart mesh from multi-view sparse contours of cine MRI. Furthermore, we develop a dual-context temporal block that fuses global and local cardiac temporal information to capture high-dimensional sequential patterns. In quantitative and qualitative evaluations, CineMesh4D outperforms existing approaches in terms of reconstruction quality and motion consistency, providing a practical pathway for personalized real-time cardiac assessment. The code will be publicly released once the manuscript is accepted.