EchoSim4D: A Proof-of-Concept Gamified XR Echocardiography Training Simulator for Neonates using 4D Ultrasound Volume

TL;DR

EchoSim4D is a novel XR-based simulator that visualizes 4D ultrasound data for neonatal heart training, improving diagnostic skills through gamified, real-time volume visualization and sensor integration.

Contribution

This paper presents a new pipeline for visualizing 4D ultrasound volumes in Unity, integrating sensor-equipped manikins for realistic neonatal echocardiography training.

Findings

High visual fidelity achieved in 4D ultrasound visualization

Effective training demonstrated with postgraduate students

Potential for improved neonatal echocardiography education

Abstract

Neonatal echocardiography is vital for early detection of heart anomalies in newborns, enabling timely, non-invasive interventions where 4D ultrasound, adds the dimension of time to 3D imaging, enhances diagnostic capabilities by visualizing real-time heart dynamics. However, training for 4D neonatal echocardiography is limited by the lack of simulators that support 4D Ultrasound volume visualization within gamified environments. This paper introduces EchoSim4D, an XR-based simulator leveraging novel pipeline for visualizing 4D volume data in Unity, incorporating real-time volume reconstruction, and a preloaded version optimized for low-end systems. EchoSim4D integrates a sensor-equipped manikin and a custom 3D-printed transducer with a 6-DOF sensor, replicating the precise probe maneuvers necessary for neonatal echocardiography. In a validation study with postgraduate medical students (0-5 years of experience), supervised by a domain expert, EchoSim4D demonstrated high visual fidelity and training efficacy. Findings suggest that 4D visualization techniques hold significant potential for advancing medical training in neonatal echocardiography.