Fast Uncertainty Quantification for Kernel-Based Estimators in Large-Scale Causal Inference

TL;DR

This paper introduces a scalable method for uncertainty quantification in large-scale kernel-based causal inference, enabling efficient bootstrap inference on massive datasets without sacrificing accuracy.

Contribution

We extend the causal Bag of Little Bootstraps algorithm to kernel methods, allowing fast, accurate uncertainty quantification in large-scale causal inference tasks.

Findings

Method achieves nominal coverage with less computational cost.

Demonstrated on real-world NVSS dataset for birth weight analysis.

Effective in large datasets where standard bootstrap is infeasible.

Abstract

Kernel methods are widely used in causal inference for tasks such as treatment effect estimation, policy evaluation, and policy learning. The bootstrap is a standard tool for uncertainty quantification because of its broad applicability. As increasingly large datasets become available, such as the 2023 U.S. Natality data from the National Vital Statistics System (NVSS), which includes 3,596,017 registered births, the computational demands of these methods increase substantially. Kernel methods are known to scale poorly with sample size, and this limitation is further exacerbated by the repeated re-fitting required by the bootstrap. As a result, bootstrap-based inference for kernel-based estimators can become computationally infeasible in large-scale settings. In this paper, we address these challenges by extending the causal Bag of Little Bootstraps (cBLB) algorithm to kernel methods. Our approach achieves computational scalability by combining subsampling and resampling while preserving first-order uncertainty quantification and asymptotically correct coverage. We evaluate the method across three representative implementations: kernelized augmented outcome-weighted learning, kernel-based minimax weighting, and double machine learning with kernel support vector machines. We show in simulations that our method yields confidence intervals with nominal coverage at a fraction of the computational cost. We further demonstrate its utility in a real-world application by estimating the effect of any amount of smoking on birth weight, as well as the optimal treatment regime, using the NVSS dataset, where the standard bootstrap is prohibitively expensive computationally and effectively infeasible at this scale.