Attainability of Two-Point Testing Rates for Finite-Sample Location Estimation

TL;DR

This paper investigates when the two-point testing lower bound for mean estimation can be nearly attained, providing an algorithm for certain distribution classes and establishing limitations for others.

Contribution

It introduces a near-linear time, parameter-free algorithm that nearly attains the two-point testing rate for mixtures of symmetric, log-concave distributions and clarifies attainability limits for unimodal and symmetric distributions.

Findings

Algorithm nearly attains the two-point testing rate for certain mixture distributions.

Two-point testing rate is not nearly attainable for symmetric, unimodal distributions.

Nearly attains the rate for unimodal distributions but not for symmetric ones.

Abstract

Le Cam's two-point testing method yields perhaps the simplest lower bound for estimating the mean of a distribution: roughly, if it is impossible to well-distinguish a distribution centered at $\mu$ from the same distribution centered at $\mu+\Delta$, then it is impossible to estimate the mean by better than $\Delta/2$. It is setting-dependent whether or not a nearly matching upper bound is attainable. We study the conditions under which the two-point testing lower bound can be attained for univariate mean estimation; both in the setting of location estimation (where the distribution is known up to translation) and adaptive location estimation (unknown distribution). Roughly, we will say an estimate nearly attains the two-point testing lower bound if it incurs error that is at most polylogarithmically larger than the Hellinger modulus of continuity for $\tilde{\Omega}(n)$ samples. Adaptive location estimation is particularly interesting as some distributions admit much better guarantees than sub-Gaussian rates (e.g. $\operatorname{Unif}(\mu-1,\mu+1)$ permits error $\Theta(\frac{1}{n})$, while the sub-Gaussian rate is $\Theta(\frac{1}{\sqrt{n}})$), yet it is not obvious whether these rates may be adaptively attained by one unified approach. Our main result designs an algorithm that nearly attains the two-point testing rate for mixtures of symmetric, log-concave distributions with a common mean. Moreover, this algorithm runs in near-linear time and is parameter-free. In contrast, we show the two-point testing rate is not nearly attainable even for symmetric, unimodal distributions. We complement this with results for location estimation, showing the two-point testing rate is nearly attainable for unimodal distributions, but unattainable for symmetric distributions.