TL;DR
MAGNET is a novel graph neural network that effectively handles missing modalities in multimodal biological data, improving cancer classification accuracy with scalable, adaptive fusion strategies.
Contribution
Introduces MAGNET, a missing-modality-aware GNN with dynamic attention and patient graph construction, addressing scalability and flexibility issues in multimodal data fusion.
Findings
MAGNET outperforms state-of-the-art methods on three multiomics datasets.
The model's complexity scales linearly with the number of modalities.
MAGNET effectively handles real-world missingness in multimodal data.
Abstract
A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing modalities, or make predictions directly with partial modalities. However, most of these methods rely on inflexible, patient-agnostic fusion strategies and do not scale computationally to the combinatorial growth of missing-modality patterns as the number of modalities increases. To address these limitations, we propose MAGNET (Missing-modality-Aware Graph neural NETwork) to enhance multimodal prediction with partial modalities, featuring a dynamic patient-modality multi-head attention mechanism to fuse lower-dimensional modality embeddings based on their contribution and missingness. MAGNET fusion's complexity increases linearly with the number of…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMachine Learning in Healthcare · Advanced Graph Neural Networks · AI in cancer detection
