Bias and response heterogeneity in an air quality data set

TL;DR

This paper discusses the importance of addressing bias and heterogeneity in observational air quality studies, demonstrating a reliable local control method that reveals subgroup differences and challenges previous global claims about air quality and longevity.

Contribution

It explicates the Local Control method for analyzing observational data, highlighting its effectiveness in revealing subgroup heterogeneity and reducing bias in air quality research.

Findings

Heterogeneity exists in the effect of air quality on longevity.

The global claim of increased longevity with better air quality is not uniformly supported.

Local Control method helps identify subgroup-specific effects.

Abstract

It is well-known that claims coming from observational studies often fail to replicate when rigorously re-tested. The technical problems include multiple testing, multiple modeling and bias. Any or all of these problems can give rise to claims that will fail to replicate. There is a need for statistical methods that are easily applied, are easy to understand, and are likely to give reliable results. In particular, simple ways for reducing the influence of bias are essential. In this paper, the Local Control method developed by Robert Obenchain is explicated using a small air quality/longevity data set first analyzed in the New England Journal of Medicine. The benefits of our paper are twofold. First, we describe a reliable strategy for analysis of observational data. Second and importantly, the global claim that longevity increases with improvements in air quality made in the NEJM paper needs to be modified. There is subgroup heterogeneity in the effect of air quality on longevity (one size does not fit all), and this heterogeneity is largely explained by factors other than air quality.