Distal Causal Excursion Effects: Modeling Long-Term Effects of Time-Varying Treatments in Micro-Randomized Trials

TL;DR

This paper introduces the distal causal excursion effect (DCEE), a new method for quantifying long-term impacts of time-varying treatments in micro-randomized trials, addressing a key gap in causal inference for digital interventions.

Contribution

The paper proposes the DCEE estimand and two robust estimators, enabling long-term causal effect analysis in MRTs with many decision points, validated through simulations and real data.

Findings

Earlier prompts have a stronger long-term effect.

Timing of interventions influences long-term outcomes.

Proposed methods are robust to outcome model misspecification.

Abstract

Micro-randomized trials (MRTs) play a crucial role in optimizing digital interventions. In an MRT, each participant is sequentially randomized among treatment options hundreds of times. While the interventions tested in MRTs target short-term behavioral responses (proximal outcomes), their ultimate goal is to drive long-term behavior change (distal outcomes). However, existing causal inference methods, such as the causal excursion effect, are limited to proximal outcomes, making it challenging to quantify the long-term impact of interventions. To address this gap, we introduce the distal causal excursion effect (DCEE), a novel estimand that quantifies the long-term effect of time-varying treatments. The DCEE contrasts distal outcomes under two excursion policies while marginalizing over most treatment assignments, enabling a parsimonious and interpretable causal model even with a large number of decision points. We propose two estimators for the DCEE -- one with cross-fitting and one without -- both robust to misspecification of the outcome model. We establish their asymptotic properties and validate their performance through simulations. We apply our method to the HeartSteps MRT to assess the impact of activity prompts on long-term habit formation. Our findings suggest that prompts delivered earlier in the study have a stronger long-term effect than those delivered later, underscoring the importance of intervention timing in behavior change. This work provides the critically needed toolkit for scientists working on digital interventions to assess long-term causal effects using MRT data.