Prognostic Adjustment with Efficient Estimators to Unbiasedly Leverage Historical Data in Randomized Trials

TL;DR

This paper introduces an extension of prognostic adjustment using nonparametric efficient estimators to improve the accuracy and power of small randomized trials by leveraging historical data without bias.

Contribution

It develops a new methodology applying nonparametric efficient estimators for prognostic adjustment, enhancing trial analysis with theoretical guarantees and empirical validation.

Findings

Prognostic adjustment increases efficiency in small trials.

The method remains unbiased despite population shifts.

Simulations show improved power with the new estimators.

Abstract

Although randomized controlled trials (RCTs) are a cornerstone of comparative effectiveness, they typically have much smaller sample size than observational studies because of financial and ethical considerations. Therefore there is interest in using plentiful historical data (either observational data or prior trials) to reduce trial sizes. Previous estimators developed for this purpose rely on unrealistic assumptions, without which the added data can bias the treatment effect estimate. Recent work proposed an alternative method (prognostic covariate adjustment) that imposes no additional assumptions and increases efficiency in trial analyses. The idea is to use historical data to learn a prognostic model: a regression of the outcome onto the covariates. The predictions from this model, generated from the RCT subjects' baseline variables, are then used as a covariate in a linear regression analysis of the trial data. In this work, we extend prognostic adjustment to trial analyses with nonparametric efficient estimators, which are more powerful than linear regression. We provide theory that explains why prognostic adjustment improves small-sample point estimation and inference without any possibility of bias. Simulations corroborate the theory: efficient estimators using prognostic adjustment compared to without provides greater power (i.e., smaller standard errors) when the trial is small. Population shifts between historical and trial data attenuate benefits but do not introduce bias. We showcase our estimator using clinical trial data provided by Novo Nordisk A/S that evaluates insulin therapy for individuals with type II diabetes.