The Balanced Up-Down Walk

TL;DR

The paper introduces the Balanced Up-Down (BUD) walk, a new Markov chain for efficiently sampling balanced graph partitions, improving over existing methods in fairness and exploration of the state space.

Contribution

It proposes the BUD walk, a novel Markov chain that maintains balanced subtrees during sampling, with theoretical analysis and empirical validation.

Findings

BUD walk samples from a known invariant measure.

BUD walk is irreducible in cases where ReCom is not.

Empirical results show BUD's improved performance over existing methods.

Abstract

Markov chains based on spanning trees have been hugely influential in algorithms for assessing fairness in political redistricting. The input graph represents the geographic building blocks of a jurisdiction. The goal is to output a large ensemble of random graph partitions, which is done by drawing and splitting random spanning trees. Crucially, these subtrees must be balanced, since political districts are required to have equal population. The Up-Down walk (on trees or forests) repeatedly adds a random edge then deletes a random edge to produce a new tree or forest; it can be used to efficiently generate a large ensemble, but the rejection rate to maintain balance grows exponentially with the number of parts. ReCom, the most widely-used class of Markov chains, circumvents this complexity barrier by merging and splitting pairs of districts at a time. This runs fast in practice but can have trouble exploring the state space. To overcome these efficiency and mixing barriers, we propose a new Markov chain called the Balanced Up-Down (BUD) walk. The main idea is to run the Up-Down walk on the space of trees, but require all steps to preserve the property that the tree is splittable into balanced subtrees. The BUD walk samples from a known invariant measure under exact balance. We prove that the BUD walk is irreducible in several cases, including a regime where ReCom is not irreducible. Running the BUD walk efficiently presents algorithmic challenges, especially when parts are allowed to deviate from their ideal size. A key subroutine is determining whether a tree is splittable into approximately-balanced subtrees. We give an improved analysis of an existing algorithm for this problem and prove that the associated counting problem is #P-complete. We empirically validate the usefulness of the BUD walk by comparing its performance to that of other existing methods for sampling partitions.