Noise-Consistent Siamese-Diffusion for Medical Image Synthesis and Segmentation

TL;DR

This paper introduces Siamese-Diffusion, a dual-component diffusion model with a Noise Consistency Loss, to generate high-fidelity synthetic images and masks for medical image segmentation, improving robustness and dataset augmentation.

Contribution

We propose Siamese-Diffusion, a novel dual diffusion model with a Noise Consistency Loss that enhances morphological fidelity in synthetic medical images and masks.

Findings

Siamese-Diffusion improves SANet's mDice by 3.6% and mIoU by 4.4% on Polyps.

It enhances UNet's performance by 1.52% mDice and 1.64% mIoU on ISIC2018.

The method outperforms traditional mask-only models in generating high-quality synthetic data.

Abstract

Deep learning has revolutionized medical image segmentation, yet its full potential remains constrained by the paucity of annotated datasets. While diffusion models have emerged as a promising approach for generating synthetic image-mask pairs to augment these datasets, they paradoxically suffer from the same data scarcity challenges they aim to mitigate. Traditional mask-only models frequently yield low-fidelity images due to their inability to adequately capture morphological intricacies, which can critically compromise the robustness and reliability of segmentation models. To alleviate this limitation, we introduce Siamese-Diffusion, a novel dual-component model comprising Mask-Diffusion and Image-Diffusion. During training, a Noise Consistency Loss is introduced between these components to enhance the morphological fidelity of Mask-Diffusion in the parameter space. During sampling, only Mask-Diffusion is used, ensuring diversity and scalability. Comprehensive experiments demonstrate the superiority of our method. Siamese-Diffusion boosts SANet's mDice and mIoU by 3.6% and 4.4% on the Polyps, while UNet improves by 1.52% and 1.64% on the ISIC2018. Code is available at GitHub.