Deep learning-based multimodal approach for non-invasive prediction and prognostic analysis of immune and angiogenic biomarkers in extrahepatic cholangiocarcinoma
Jiong Liu, Zhitao Cheng, Ruidan Yang, Yinfei Fan, Yue Shu, Yong Tang, Jian Shu

TL;DR
This study uses deep learning and MRI data to non-invasively predict immune and angiogenic biomarkers in cholangiocarcinoma patients, aiding in personalized treatment planning.
Contribution
A novel deep learning-based multimodal framework for non-invasive prediction of PD-L1 and VEGF in extrahepatic cholangiocarcinoma.
Findings
The model achieved AUC 0.71 for PD-L1 and 0.85 for VEGF prediction.
Combining imaging and radiomic features improved performance over single-modality methods.
Predicted biomarkers were significantly associated with patient survival.
Abstract
This study aims to develop a deep learning (DL)-based multimodal framework that integrates magnetic resonance imaging (MRI), clinical, and laboratory data to predict programmed death ligand 1 (PD-L1) and vascular endothelial growth factor (VEGF) expression in Extrahepatic cholangiocarcinoma (eCCA) patients and assess the prognostic value. A retrospective cohort study involving 96 patients with eCCA was conducted across two institutions. A total of 16050 raw MRI images (11505 T1WI, 2371 T2WI, 2372 DWI) and 1570 tumor-containing images (990 T1WI, 289 T2WI, 291 DWI) were analyzed. Radiomic feature extraction was performed manually segmented tumor regions from MRI scans. The multimodal DL framework integrated DL features extracted from images and radiomic features as well as clinical-laboratory features through a repeated attention mechanism. Prognostic stratification was performed using…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCholangiocarcinoma and Gallbladder Cancer Studies · Radiomics and Machine Learning in Medical Imaging · Hepatocellular Carcinoma Treatment and Prognosis
