Learning Interpretable Point-Based Clinical Risk Scores via Direct Optimization

TL;DR

This paper introduces new machine learning algorithms for directly optimizing interpretable, integer-weighted clinical risk scores, enhancing their accuracy and computational efficiency compared to traditional methods.

Contribution

The authors develop a flexible greedy optimization approach for learning additive scoring models with explicit optimality objectives, improving upon existing rounding and integer programming methods.

Findings

Successfully applied to EHR data to predict post-discharge mortality.

Demonstrated improved accuracy and interpretability over traditional scoring methods.

Conducted simulation studies confirming finite-sample effectiveness.

Abstract

Many clinical risk scores are deployed as additive rules with nonnegative integer points assigned to relevant binary predictive features. These integer weights not only make the score easier to use in practice but also promote sparsity in the resulting prediction model. Such risk scores are often derived by first fitting a regression model and then rounding the estimated coefficients to the nearest integer after appropriate scaling. This approach is computationally fast but does not guarantee optimality of the resulting score. Alternatively, one may search over all possible integer weights to directly optimize a value function by posing the problem as an integer programming task. However, the associated computational burden can be substantial, especially when the value function is nonconcave or even discontinuous. In this paper, we develop new machine learning algorithms that employ a flexible greedy optimization strategy to learn such additive scoring directly under explicit and sensible optimality objectives. We apply the proposed method to a large electronic health record (EHR) cohort in Epic Cosmos to construct an integer-weighted comorbidity score for measuring the risk of post-discharge mortality. We also conduct a simulation study to examine the finite-sample operating characteristics.