Bridging Radiology and Pathology: A DICOM-Based Framework for Multimodal Mapping and Integrated Visualization

TL;DR

This paper presents a DICOM-based framework that automates multimodal image registration and visualization, enhancing collaboration between radiology and pathology for improved disease diagnosis and research.

Contribution

It introduces an interdisciplinary toolbox that automates data pairing and integrates radiology and pathology images within a scalable, reproducible environment.

Findings

Automated image registration improves multimodal analysis efficiency.

The platform facilitates cross-disciplinary collaboration and research.

Enhances visualization and interpretation of combined radiology and pathology data.

Abstract

Accurate disease diagnosis depends on effective collaboration between medical specialties, yet departments often use distinct data systems and proprietary formats. This heterogeneity hinders joint analysis and integration of complementary diagnostic information. The use of separate viewers for each modality further restricts cross-specialty collaboration. Although multimodal integration, particularly between radiology and pathology, has demonstrated potential for identifying novel biomarkers, it still relies heavily on manual, time-consuming data pairing. This project introduces an interdisciplinary toolbox that can operate within the Kaapana framework or as a standalone tool to bridge radiology and pathology. By linking modalityspecific viewers and extending them with automated image registration and alignment, the platform enables efficient, scalable multimodal analysis. The integrated environment promotes reproducible workflows, accelerates crossdisciplinary research, and facilitates deeper insights into disease mechanisms and patient care.