Using causal diagrams to assess parallel trends in difference-in-differences studies

TL;DR

This paper develops a causal diagram-based framework to assess the plausibility of the parallel trends assumption in difference-in-differences studies, providing conditions to reject or support this assumption.

Contribution

It introduces a scale-independent, diagram-based method under a linear faithfulness assumption to evaluate parallel trends in DID analyses.

Findings

Parallel trends can be rejected if treatment is affected by pre-treatment outcomes.

Unmeasured confounders affecting treatment and pre-treatment outcomes can violate parallel trends.

Pre-treatment outcomes influencing post-treatment outcomes can also violate the assumption.

Abstract

Difference-in-differences (DID) is popular because it can allow for unmeasured confounding when the key assumption of parallel trends holds. However, there exists little guidance on how to decide a priori whether this assumption is reasonable. We attempt to develop such guidance by considering the relationship between a causal diagram and the parallel trends assumption. This is challenging because parallel trends is scale-dependent and causal diagrams are generally scale-independent. We develop conditions under which, given a nonparametric causal diagram, one can reject or fail to reject parallel trends. In particular, we adopt a linear faithfulness assumption, which states that all graphically connected variables are correlated, and which is often reasonable in practice. We show that parallel trends can be rejected if either (i) the treatment is affected by pre-treatment outcomes, or (ii) there exist unmeasured confounders for the effect of treatment on pre-treatment outcomes that are not confounders for the post-treatment outcome, or vice versa (more precisely, the two outcomes possess distinct minimally sufficient sets). We also argue that parallel trends should be strongly questioned if (iii) the pre-treatment outcomes affect the post-treatment outcomes (though the two can be correlated) since there exist reasonable semiparametric models in which such an effect violates parallel trends. When (i-iii) are absent, a necessary and sufficient condition for parallel trends is that the association between the common set of confounders and the potential outcomes is constant on an additive scale, pre- and post-treatment. These conditions are similar to, but more general than, those previously derived in linear structural equations models. We discuss our approach in the context of the effect of Medicaid expansion under the U.S. Affordable Care Act on health insurance coverage rates.