Echocardiography to Cardiac MRI View Transformation for Real-Time Blind Restoration

TL;DR

This paper introduces a Cycle-GAN based method to transform echocardiography images into high-quality, artifact-free cardiac MRI views, enhancing diagnostic capabilities and accessibility.

Contribution

It presents the first deep learning approach to convert echocardiography into cardiac MRI views using a novel dataset and Cycle-GAN architecture.

Findings

Synthetic MRI views are indistinguishable from real ones according to cardiologists.

The method achieves high-quality, artifact-free MRI synthesis from echocardiography.

78.9% of diagnoses preferred synthetic MRI over original echocardiography.

Abstract

Echocardiography is the most widely used imaging to monitor cardiac functions, serving as the first line in early detection of myocardial ischemia and infarction. However, echocardiography often suffers from several artifacts including sensor noise, lack of contrast, severe saturation, and missing myocardial segments which severely limit its usage in clinical diagnosis. In recent years, several machine learning methods have been proposed to improve echocardiography views. Yet, these methods usually address only a specific problem (e.g. denoising) and thus cannot provide a robust and reliable restoration in general. On the other hand, cardiac MRI provides a clean view of the heart without suffering such severe issues. However, due to its significantly higher cost, it is often only afforded by a few major hospitals, hence hindering its use and accessibility. In this pilot study, we propose a novel approach to transform echocardiography into the cardiac MRI view. For this purpose, Echo2MRI dataset, consisting of echocardiography and real cardiac MRI image pairs, is composed and will be shared publicly. A dedicated Cycle-consistent Generative Adversarial Network (Cycle-GAN) is trained to learn the transformation from echocardiography frames to cardiac MRI views. An extensive set of qualitative evaluations shows that the proposed transformer can synthesize high-quality artifact-free synthetic cardiac MRI views from a given sequence of echocardiography frames. Medical evaluations performed by a group of cardiologists further demonstrate that synthetic MRI views are indistinguishable from their original counterparts and are preferred over their initial sequence of echocardiography frames for diagnosis in 78.9% of the cases.