MultimodalCNN-PD: a Parkinson’s disease diagnostics framework using multimodal convolutional neural network

TL;DR

This paper introduces a new AI framework that combines brain scans and patient data to accurately detect Parkinson's disease at early stages.

Contribution

A novel multimodal deep learning framework for PD diagnosis that integrates MRI and clinical metadata with improved efficiency and accuracy.

Findings

The model achieved 97.5% accuracy on the PPMI dataset for classifying normal, prodromal, and diagnosed PD cases.

External validation on OASIS-3 showed 96.2% accuracy with strong generalizability across different populations.

Key components like Mobile CBAM and MGCA++ significantly improved performance while reducing computational costs.

Abstract

Parkinson’s disease (PD) is a prevalent neurodegenerative disorder that severely affects motor and cognitive functions. Early diagnosis, particularly during the prodromal phase, is critical for effective intervention.

This study presents MultimodalCNN-PD++, a deep learning model that integrates Magnetic Resonance Imaging (MRI) with clinical metadata (including motor/cognitive assessments, demographic data, and genetic biomarkers) to enhance PD classification. The model employs a lightweight EfficientNetB0 backbone, Mobile Convolutional Block Attention Modules (Mobile CBAM), and an enhanced Meta-Guided Cross-Attention (MGCA++) mechanism. A three-stage hierarchical feature selection method identifies the most discriminative clinical features, while metadata is processed with BioClinicalBERT using Low-Rank Adaptation (LoRA).

Validated on the Parkinson’s Progression Markers Initiative (PPMI) dataset, the model achieved 97.5% accuracy in distinguishing Normal Control, prodromal PD, and diagnosed PD cases, with reduced parameters and computational costs. External validation on the OASIS-3 dataset confirmed robust generalizability (96.2% accuracy) despite demographic and acquisition protocol variations. Ablation studies highlighted the contributions of Mobile CBAM, MGCA++, hierarchical feature selection, and BioClinicalBERT-LoRA.

This framework sets a new benchmark for multiclass PD diagnosis, demonstrating strong potential as a clinically deployable AI tool for early detection and personalized management of neurodegenerative diseases.

Figures