Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer's Disease
Ahmed Sharshar, Yasser Ashraf, Tameem Bakr, Salma Hassan, Hosam Elgendy, Mohammad Yaqub, Mohsen Guizani

TL;DR
OmniBrain is a novel multimodal framework integrating MRI, radiomics, gene expression, and clinical data, achieving high accuracy and robustness in Alzheimer's disease classification while providing explainability for clinical trust.
Contribution
The paper introduces OmniBrain, a unified multimodal model with cross-attention and modality dropout, improving accuracy, generalization, robustness, and interpretability over existing methods.
Findings
Achieves 92.2% accuracy on ANMerge dataset.
Generalizes to MRI-only ADNI dataset with 70.4% accuracy.
Provides explainability highlighting relevant brain regions and genes.
Abstract
Alzheimer's disease affects over 55 million people worldwide and is projected to more than double by 2050, necessitating rapid, accurate, and scalable diagnostics. However, existing approaches are limited because they cannot achieve clinically acceptable accuracy, generalization across datasets, robustness to missing modalities, and explainability all at the same time. This inability to satisfy all these requirements simultaneously undermines their reliability in clinical settings. We propose OmniBrain, a multimodal framework that integrates brain MRI, radiomics, gene expression, and clinical data using a unified model with cross-attention and modality dropout. OmniBrain achieves accuracy on the ANMerge dataset and generalizes to the MRI-only ADNI dataset with accuracy, outperforming unimodal and prior multimodal approaches. Explainability analyses…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
