EXR: An Interactive Immersive EHR Visualization in Extended Reality

TL;DR

This paper introduces an XR platform for immersive, interactive visualization of EHRs, integrating medical imaging and AI segmentation to enhance clinical decision-making in a shared 3D environment.

Contribution

It presents a novel modular XR system that visualizes structured and unstructured EHR data in 3D, enabling intuitive exploration and collaboration for healthcare applications.

Findings

Demonstrated system with synthetic EHR and CT data

Integrated FHIR data with volumetric imaging and AI segmentation

Showed potential for next-generation clinical decision-support

Abstract

This paper presents the design and implementation of an Extended Reality (XR) platform for immersive, interactive visualization of Electronic Health Records (EHRs). The system extends beyond conventional 2D interfaces by visualizing both structured and unstructured patient data into a shared 3D environment, enabling intuitive exploration and real-time collaboration. The modular infrastructure integrates FHIR-based EHR data with volumetric medical imaging and AI-generated segmentation, ensuring interoperability with modern healthcare systems. The platform's capabilities are demonstrated using synthetic EHR datasets and computed tomography (CT)-derived spine models processed through an AI-powered segmentation pipeline. This work suggests that such integrated XR solutions could form the foundation for next-generation clinical decision-support tools, where advanced data infrastructures are directly accessible in an interactive and spatially rich environment.