Improving Generalizability of Hip Fracture Risk Prediction via Domain Adaptation Across Multiple Cohorts

TL;DR

This study demonstrates that combining multiple domain adaptation techniques significantly improves the generalizability of hip fracture risk prediction models across diverse cohorts, without requiring outcome labels in target datasets.

Contribution

It introduces an outcome-free, multi-method domain adaptation approach that enhances model transferability across cohorts in hip fracture risk prediction.

Findings

Combined domain adaptation methods outperform baseline models.

Highest AUC achieved was 0.95 with multiple methods.

Outcome-free adaptation enables better generalization in real-world settings.

Abstract

Clinical risk prediction models often fail to be generalized across cohorts because underlying data distributions differ by clinical site, region, demographics, and measurement protocols. This limitation is particularly pronounced in hip fracture risk prediction, where the performance of models trained on one cohort (the source cohort) can degrade substantially when deployed in other cohorts (target cohorts). We used a shared set of clinical and DXA-derived features across three large cohorts - the Study of Osteoporotic Fractures (SOF), the Osteoporotic Fractures in Men Study (MrOS), and the UK Biobank (UKB), to systematically evaluate the performance of three domain adaptation methods - Maximum Mean Discrepancy (MMD), Correlation Alignment (CORAL), and Domain - Adversarial Neural Networks (DANN) and their combinations. For a source cohort with males only and a source cohort with females only, domain-adaptation methods consistently showed improved performance than the no-adaptation baseline (source-only training), and the use of combinations of multiple domain adaptation methods delivered the largest and most stable gains. The method that combines MMD, CORAL, and DANN achieved the highest discrimination with the area under curve (AUC) of 0.88 for a source cohort with males only and 0.95 for a source cohort with females only), demonstrating that integrating multiple domain adaptation methods could produce feature representations that are less sensitive to dataset differences. Unlike existing methods that rely heavily on supervised tuning or assume known outcomes of samples in target cohorts, our outcome-free approaches enable the model selection under realistic deployment conditions and improve generalization of models in hip fracture risk prediction.