Supergeo Design: Generalized Matching for Geographic Experiments
Aiyou Chen, Nick Doudchenko, Shunhua Jiang, Cliff Stein, Bicheng Ying

TL;DR
This paper introduces a generalized matching method called Supergeo Design for geographic experiments, formulated as an NP-hard problem, which improves matching quality and avoids bias, demonstrated through real-world advertising data.
Contribution
It formulates the supergeo matching as a mixed-integer program, providing a new approach that enhances matching quality in geographic experiments beyond standard methods.
Findings
Supergeo design often outperforms standard matching in quality.
The proposed method avoids bias associated with trimming techniques.
Empirical results on advertising data validate the approach.
Abstract
We propose a generalization of the standard matched pairs design in which experimental units (often geographic regions or geos) may be combined into larger units/regions called "supergeos" in order to improve the average matching quality. Unlike optimal matched pairs design which can be found in polynomial time (Lu et al. 2011), this generalized matching problem is NP-hard. We formulate it as a mixed-integer program (MIP) and show that experimental design obtained by solving this MIP can often provide a significant improvement over the standard design regardless of whether the treatment effects are homogeneous or heterogeneous. Furthermore, we present the conditions under which trimming techniques that often improve performance in the case of homogeneous effects (Chen and Au, 2022), may lead to biased estimates and show that the proposed design does not introduce such bias. We use…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEconomic and Environmental Valuation · Consumer Market Behavior and Pricing · Optimal Experimental Design Methods
