LLM Augmented Intervenable Multimodal Adaptor for Post-operative Complication Prediction in Lung Cancer Surgery

TL;DR

This paper introduces MIRACLE, a deep learning framework that integrates clinical and radiological data with an interventional module for improved, interpretable prediction of postoperative complications in lung cancer surgery.

Contribution

MIRACLE is a novel multimodal deep learning architecture with an interventional component that enhances prediction accuracy and interpretability in clinical postoperative risk assessment.

Findings

MIRACLE outperforms traditional models in predicting complications.

The hyperspherical embedding improves feature robustness.

Interventional module provides actionable insights for clinicians.

Abstract

Postoperative complications remain a critical concern in clinical practice, adversely affecting patient outcomes and contributing to rising healthcare costs. We present MIRACLE, a deep learning architecture for prediction of risk of postoperative complications in lung cancer surgery by integrating preoperative clinical and radiological data. MIRACLE employs a hyperspherical embedding space fusion of heterogeneous inputs, enabling the extraction of robust, discriminative features from both structured clinical records and high-dimensional radiological images. To enhance transparency of prediction and clinical utility, we incorporate an interventional deep learning module in MIRACLE, that not only refines predictions but also provides interpretable and actionable insights, allowing domain experts to interactively adjust recommendations based on clinical expertise. We validate our approach on POC-L, a real-world dataset comprising 3,094 lung cancer patients who underwent surgery at Roswell Park Comprehensive Cancer Center. Our results demonstrate that MIRACLE outperforms various traditional machine learning models and contemporary large language models (LLM) variants alone, for personalized and explainable postoperative risk management.