Systole-Conditioned Generative Cardiac Motion

TL;DR

This paper introduces a novel generative model that synthesizes realistic cardiac CT frame pairs with dense motion annotations, reducing the need for manual ground-truth data in cardiac motion estimation.

Contribution

It proposes a CVAE-based method with multi-scale conditioning to generate 3D flow fields for cardiac CT frames, enabling realistic data augmentation for motion estimation.

Findings

Generates realistic cardiac motion pairs with dense flow annotations.

Reduces reliance on manual ground-truth data for training models.

Provides a pipeline for improved myocardium motion modeling.

Abstract

Accurate motion estimation in cardiac computed tomography (CT) imaging is critical for assessing cardiac function and surgical planning. Data-driven methods have become the standard approach for dense motion estimation, but they rely on vast amounts of labeled data with dense ground-truth (GT) motion annotations, which are often unfeasible to obtain. To address this limitation, we present a novel approach that synthesizes realistically looking pairs of cardiac CT frames enriched with dense 3D flow field annotations. Our method leverages a conditional Variational Autoencoder (CVAE), which incorporates a novel multi-scale feature conditioning mechanism and is trained to generate 3D flow fields conditioned on a single CT frame. By applying the generated flow field to warp the given frame, we create pairs of frames that simulate realistic myocardium deformations across the cardiac cycle. These pairs serve as fully annotated data samples, providing optical flow GT annotations. Our data generation pipeline could enable the training and validation of more complex and accurate myocardium motion models, allowing for substantially reducing reliance on manual annotations. Our code, along with animated generated samples and additional material, is available on our project page: https://shaharzuler.github.io/GenerativeCardiacMotion_Page.