Predicting Deterioration in Mild Cognitive Impairment with Survival Transformers, Extreme Gradient Boosting and Cox Proportional Hazard Modelling
Henry Musto, Daniel Stamate, Doina Logofatu, Daniel Stahl

TL;DR
This study introduces advanced survival analysis models using transformers and gradient boosting to predict cognitive decline in MCI patients, demonstrating improved accuracy and stability over traditional methods with metabolomics data.
Contribution
The paper presents novel survival machine learning models, specifically transformers and XGBoost, applied to metabolomics data for better prediction of dementia progression.
Findings
Transformer and XGBoost models achieved higher C-index scores (0.85 and 0.8) than Cox model (0.77).
Survival machine learning models showed greater stability than traditional Cox analysis.
Advanced models improve early detection of cognitive deterioration in MCI.
Abstract
The paper proposes a novel approach of survival transformers and extreme gradient boosting models in predicting cognitive deterioration in individuals with mild cognitive impairment (MCI) using metabolomics data in the ADNI cohort. By leveraging advanced machine learning and transformer-based techniques applied in survival analysis, the proposed approach highlights the potential of these techniques for more accurate early detection and intervention in Alzheimer's dementia disease. This research also underscores the importance of non-invasive biomarkers and innovative modelling tools in enhancing the accuracy of dementia risk assessments, offering new avenues for clinical practice and patient care. A comprehensive Monte Carlo simulation procedure consisting of 100 repetitions of a nested cross-validation in which models were trained and evaluated, indicates that the survival machine…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHealth, Environment, Cognitive Aging
MethodsAttention Is All You Need · Linear Layer · Position-Wise Feed-Forward Layer · Label Smoothing · Byte Pair Encoding · Absolute Position Encodings · Softmax · Layer Normalization · Dropout · Dense Connections
