Improving and extending the testing of distributions for shape-restricted properties

TL;DR

This paper introduces more efficient algorithms for distribution testing of shape-restricted properties, extending the scope to the conditional sampling model and simplifying the process of partitioning for property testing.

Contribution

It presents a simpler, more efficient algorithm for the basic model and extends algorithms to the conditional model for a broader class of properties.

Findings

More efficient algorithms for distribution testing.

Extension of testing methods to the conditional sampling model.

Introduction of a new partitioning technique for testing.

Abstract

Distribution testing deals with what information can be deduced about an unknown distribution over $\{1,\ldots,n\}$, where the algorithm is only allowed to obtain a relatively small number of independent samples from the distribution. In the extended conditional sampling model, the algorithm is also allowed to obtain samples from the restriction of the original distribution on subsets of $\{1,\ldots,n\}$. In 2015, Canonne, Diakonikolas, Gouleakis and Rubinfeld unified several previous results, and showed that for any property of distributions satisfying a "decomposability" criterion, there exists an algorithm (in the basic model) that can distinguish with high probability distributions satisfying the property from distributions that are far from it in the variation distance. We present here a more efficient yet simpler algorithm for the basic model, as well as very efficient algorithms for the conditional model, which until now was not investigated under the umbrella of decomposable properties. Additionally, we provide an algorithm for the conditional model that handles a much larger class of properties. Our core mechanism is a way of efficiently producing an interval-partition of $\{1,\ldots,n\}$ that satisfies a "fine-grain" quality. We show that with such a partition at hand we can directly move forward with testing individual intervals, instead of first searching for the "correct" partition of $\{1,\ldots,n\}$.