Multiple Inputs and Mixwd data for Alzheimer's Disease Classification Based on 3D Vision Transformer

TL;DR

This paper introduces MIMD-3DVT, a novel 3D Vision Transformer model that integrates multiple data sources and 3D brain imaging to improve Alzheimer's disease classification accuracy.

Contribution

The study presents a new multi-input, mixed data 3D Vision Transformer that captures spatial and contextual information for better diagnosis of Alzheimer's.

Findings

Achieved 97.14% accuracy in classifying Alzheimer's disease.

Outperformed existing state-of-the-art methods.

Effectively integrated diverse data sources for improved diagnosis.

Abstract

The current methods for diagnosing Alzheimer Disease using Magnetic Resonance Imaging (MRI) have significant limitations. Many previous studies used 2D Transformers to analyze individual brain slices independently, potentially losing critical 3D contextual information. Region of interest-based models often focus on only a few brain regions despite Alzheimer's affecting multiple areas. Additionally, most classification models rely on a single test, whereas diagnosing Alzheimer's requires a multifaceted approach integrating diverse data sources for a more accurate assessment. This study introduces a novel methodology called the Multiple Inputs and Mixed Data 3D Vision Transformer (MIMD-3DVT). This method processes consecutive slices together to capture the feature dimensions and spatial information, fuses multiple 3D ROI imaging data inputs, and integrates mixed data from demographic factors, cognitive assessments, and brain imaging. The proposed methodology was experimentally evaluated using a combined dataset that included the Alzheimer's Disease Neuroimaging Initiative (ADNI), the Australian Imaging, Biomarker, and Lifestyle Flagship Study of Ageing (AIBL), and the Open Access Series of Imaging Studies (OASIS). Our MIMD-3DVT, utilizing single or multiple ROIs, achieved an accuracy of 97.14%, outperforming the state-of-the-art methods in distinguishing between Normal Cognition and Alzheimer's Disease.