Identification and estimation of causal effects using non-concurrent controls in platform trials

TL;DR

This paper examines how to accurately estimate treatment effects in platform trials that include both concurrent and non-concurrent controls, emphasizing robust methods and efficiency considerations.

Contribution

It advocates for targeting the concurrent average treatment effect with covariate adjustment to improve efficiency without unwarranted assumptions.

Findings

Using covariate-adjusted doubly robust estimators improves precision.

Collecting prognostic variables is more crucial than relying on non-concurrent controls.

Targeting ATE involves untestable extrapolation assumptions.

Abstract

Platform trials are multi-arm designs that simultaneously evaluate multiple treatments for a single disease within the same overall trial structure. Unlike traditional randomized controlled trials, they allow treatment arms to enter and exit the trial at distinct times while maintaining a control arm throughout. This control arm comprises both concurrent controls, where participants are randomized concurrently to either the treatment or control arm, and non-concurrent controls, who enter the trial when the treatment arm under study is unavailable. While flexible, platform trials introduce the challenge of using non-concurrent controls, raising questions about estimating treatment effects. Specifically, which estimands should be targeted? Under what assumptions can these estimands be identified and estimated? Are there any efficiency gains? In this paper, we discuss issues related to the identification and estimation assumptions of common choices of estimand. We conclude that the most robust strategy to increase efficiency without imposing unwarranted assumptions is to target the concurrent average treatment effect (cATE), the ATE among only concurrent units, using a covariate-adjusted doubly robust estimator. Our studies suggest that, for the purpose of obtaining efficiency gains, collecting important prognostic variables is more important than relying on non-concurrent controls. We also discuss the perils of targeting ATE due to an untestable extrapolation assumption that will often be invalid. We provide simulations illustrating our points and an application to the ACTT platform trial, resulting in a 20% improvement in precision compared to the naive estimator that ignores non-concurrent controls and prognostic variables.