Deformation-Recovery Diffusion Model (DRDM): Instance Deformation for Image Manipulation and Synthesis

TL;DR

The paper introduces DRDM, a diffusion model that generates realistic, diverse deformations for medical images by learning to recover from unrealistic transformations, improving data augmentation and image synthesis.

Contribution

DRDM is a novel deformation-based diffusion model that emphasizes morphological transformations and topology preservation for realistic medical image generation.

Findings

Capable of generating diverse, large-scale deformations.

Maintains anatomical plausibility in generated deformations.

Improves performance in image segmentation and registration tasks.

Abstract

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically implausible structures or illusions. To address these limitations, we propose the Deformation-Recovery Diffusion Model (DRDM), a novel diffusion-based generative model that emphasises morphological transformation through deformation fields rather than direct image synthesis. DRDM introduces a topology-preserving deformation field generation strategy, which randomly samples and integrates multi-scale Deformation Velocity Fields (DVFs). DRDM is trained to learn to recover unrealistic deformation components, thus restoring randomly deformed images to a realistic distribution. This formulation enables the generation of diverse yet anatomically plausible deformations that preserve structural integrity, thereby improving data augmentation and synthesis for downstream tasks such as few-shot learning and image registration. Experiments on cardiac Magnetic Resonance Imaging and pulmonary Computed Tomography show that DRDM is capable of creating diverse, large-scale deformations, while maintaining anatomical plausibility of deformation fields. Additional evaluations on 2D image segmentation and 3D image registration tasks indicate notable performance gains, underscoring DRDM's potential to enhance both image manipulation and generative modelling in medical imaging applications. Project page: https://jianqingzheng.github.io/def_diff_rec/