Multi-Centre Validation of a Deep Learning Model for Scoliosis Assessment

TL;DR

This study validates a deep learning software for scoliosis assessment across multiple centers, showing it closely matches expert radiologists in measuring Cobb angles and grading severity, potentially improving clinical workflow efficiency.

Contribution

The paper presents a multi-centre validation of a fully automated deep learning tool for scoliosis measurement, demonstrating its accuracy and reliability compared to expert radiologists.

Findings

AI achieved mean absolute error of ~3.9 degrees in Cobb angle measurement.

High correlation coefficients (r > 0.88) with radiologists indicate strong agreement.

Cohen kappa scores suggest moderate to substantial agreement in severity grading.

Abstract

Scoliosis affects roughly 2 to 4 percent of adolescents, and treatment decisions depend on precise Cobb angle measurement. Manual assessment is time consuming and subject to inter observer variation. We conducted a retrospective, multi centre evaluation of a fully automated deep learning software (Carebot AI Bones, Spine Measurement functionality; Carebot s.r.o.) on 103 standing anteroposterior whole spine radiographs collected from ten hospitals. Two musculoskeletal radiologists independently measured each study and served as reference readers. Agreement between the AI and each radiologist was assessed with Bland Altman analysis, mean absolute error (MAE), root mean squared error (RMSE), Pearson correlation coefficient, and Cohen kappa for four grade severity classification. Against Radiologist 1 the AI achieved an MAE of 3.89 degrees (RMSE 4.77 degrees) with a bias of 0.70 degrees and limits of agreement from minus 8.59 to plus 9.99 degrees. Against Radiologist 2 the AI achieved an MAE of 3.90 degrees (RMSE 5.68 degrees) with a bias of 2.14 degrees and limits from minus 8.23 to plus 12.50 degrees. Pearson correlations were r equals 0.906 and r equals 0.880 (inter reader r equals 0.928), while Cohen kappa for severity grading reached 0.51 and 0.64 (inter reader kappa 0.59). These results demonstrate that the proposed software reproduces expert level Cobb angle measurements and categorical grading across multiple centres, suggesting its utility for streamlining scoliosis reporting and triage in clinical workflows.