Enhancing SHAP Explainability for Diagnostic and Prognostic ML Models in Alzheimer Disease

TL;DR

This paper develops a multi-level framework to evaluate the robustness and consistency of SHAP explanations in Alzheimer's disease ML models, enhancing trustworthiness for clinical use.

Contribution

It introduces a comprehensive explainability framework that assesses SHAP explanation stability across disease stages, models, and tasks, addressing gaps in robustness validation.

Findings

SHAP explanations are dominated by cognitive and functional markers.

High SHAP-SHAP consistency across diagnosis and prognosis models.

Stable domain-level contributions with minimal genetic feature shifts.

Abstract

Alzheimer disease (AD) diagnosis and prognosis increasingly rely on machine learning (ML) models. Although these models provide good results, clinical adoption is limited by the need for technical expertise and the lack of trustworthy and consistent model explanations. SHAP (SHapley Additive exPlanations) is com-monly used to interpret AD models, but existing studies tend to focus on explanations for isolated tasks, providing little evidence about their robustness across disease stages, model architectures, or prediction objectives. This paper proposes a multi-level explainability framework that measures the coherence, stabil-ity and consistency of explanations by integrating: (1) within-model coherence metrics between feature importance and SHAP, (2) SHAP stability across AD boundaries, and (3) SHAP cross-task consistency be-tween diagnosis and prognosis. Using AutoML to optimize classifiers on the NACC dataset, we trained four diagnostic and four prognostic models covering the standard AD progression stages. Stability was then evaluated using correlation metrics, top-k feature overlap, SHAP sign consistency, and domain-level contribution ratios. Results show that cognitive and functional markers dominate SHAP explanations in both diagnosis and prognosis. SHAP-SHAP consistency between diagnostic and prognostic models was high across all classifiers, with 100% sign stability and minimal shifts in explanatory magnitude. Domain-level contributions also remained stable, with only minimal increases in genetic features for prognosis. These results demonstrate that SHAP explanations can be quantitatively vali-dated for robustness and transferability, providing clinicians with more reliable interpretations of ML pre-dictions.