Multi-Atlas Brain Network Classification through Consistency Distillation and Complementary Information Fusion
Jiaxing Xu, Mengcheng Lan, Xia Dong, Kai He, Wei Zhang, Qingtian Bian, Yiping Ke

TL;DR
This paper introduces AIDFusion, a novel neural network that integrates multiple brain atlases to improve the classification of brain disorders using fMRI data, ensuring consistency and interpretability.
Contribution
AIDFusion employs a disentangle Transformer and message-passing to effectively fuse multi-atlas brain network information, addressing previous limitations in consistency and ROI-level exchange.
Findings
Outperforms state-of-the-art methods on four disease datasets.
Enhances cross-atlas consistency and interpretability.
Demonstrates efficiency and robustness in brain network classification.
Abstract
In the realm of neuroscience, identifying distinctive patterns associated with neurological disorders via brain networks is crucial. Resting-state functional magnetic resonance imaging (fMRI) serves as a primary tool for mapping these networks by correlating blood-oxygen-level-dependent (BOLD) signals across different brain regions, defined as regions of interest (ROIs). Constructing these brain networks involves using atlases to parcellate the brain into ROIs based on various hypotheses of brain division. However, there is no standard atlas for brain network classification, leading to limitations in detecting abnormalities in disorders. Some recent methods have proposed utilizing multiple atlases, but they neglect consistency across atlases and lack ROI-level information exchange. To tackle these limitations, we propose an Atlas-Integrated Distillation and Fusion network (AIDFusion) to…
Peer Reviews
Decision·Submitted to ICLR 2025
This approach is well-motivated, as there is no consensus on the number of atlases to use. Using a single atlas conforms to the biases induced that particular atlas, and using multiple atlases involves the use of novel methods which do not regularize consistency across multiple atlases. The proposed approach aims to achieve both consistency across multiple atlases as well as providing their model ROI-level "information exchange." Accomplishing these two aims required the development and use of s
In addition to my recommendation for acceptance, I enumerate some concerns I have below: 1. The technical claims are not fully supported. The "identity embedding" is either mis-named or its explanation is unclear. The embedding is not identity; it seems instead to simply be a learnable embedding. It is unclear whether the parameters of the MLP in Eq. 1 are learnable. If so, what is the purpose behind W_ID? 2. The efficacy of the "disentangle Transformer" is not fully supported. How well are con
- The use of [transformer registers](https://arxiv.org/abs/2309.16588) (herein called “incompatible nodes”) for potentially filtering out incompatible information across atlases is a novel and interesting application. - The use of spatial distances between regions of interest in the brain when constructing the message-passing framework is interesting and, to my limited knowledge, not commonly done. - Generally clearly and straightforwardly presented.
I do not work in this specific subfield and would be happy to revisit my score and look forward to the discussion phase. I also did not read the appendix so please correct me if I missed something. ### 1. Unclear motivation for transformer-based approach on processed connectomes The datasets in fMRI connectomics are (understandably) limited in sample size, ranging here from N=60 to N=1300. However, it is unclear how the submission can adequately train transformers on 60 data samples. Without
1. The idea of learning unified representation from multiple brain networks is promising to improve classification performance. 2. Multiple techniques are proposed to facilitate the unified representation learning, e.g., disentangle transformer, inter-atlas message-passing, and multi-level consistency.
1. The brain networks from different atlases will contain atlas-consistent information and atlas-specific information, both types of information may be informative for classification. While the proposed method adopts several techniques to get enhanced atlas-consistent information, the atlas-specific information may not be effectively captured. Not sure if the proposed disentangle transformer may discard atlas-specific information that are useful for classification. 2. As demonstrate in the exper
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications
MethodsDense Connections · Residual Connection · Dropout · Layer Normalization · Adam · Byte Pair Encoding · Absolute Position Encodings · Softmax · Attention Is All You Need · Linear Layer
