# Efficient Truncated Statistics with Unknown Truncation

**Authors:** Vasilis Kontonis, Christos Tzamos, Manolis Zampetakis

arXiv: 1908.01034 · 2019-08-06

## TL;DR

This paper introduces an efficient algorithm for estimating Gaussian parameters from truncated samples when the truncation set is unknown, with performance depending on the set's Gaussian surface area, applicable to various complex sets.

## Contribution

It presents the first computationally and sample-efficient method for Gaussian estimation under unknown truncation sets, extending previous work to more complex and realistic scenarios.

## Key findings

- Algorithm works for intersections of halfspaces, polynomial threshold functions, and convex sets.
- Performance depends on the Gaussian surface area of the truncation set.
- There are fundamental limits on learnability based on set complexity.

## Abstract

We study the problem of estimating the parameters of a Gaussian distribution when samples are only shown if they fall in some (unknown) subset $S \subseteq \R^d$. This core problem in truncated statistics has long history going back to Galton, Lee, Pearson and Fisher. Recent work by Daskalakis et al. (FOCS'18), provides the first efficient algorithm that works for arbitrary sets in high dimension when the set is known, but leaves as an open problem the more challenging and relevant case of unknown truncation set.   Our main result is a computationally and sample efficient algorithm for estimating the parameters of the Gaussian under arbitrary unknown truncation sets whose performance decays with a natural measure of complexity of the set, namely its Gaussian surface area. Notably, this algorithm works for large families of sets including intersections of halfspaces, polynomial threshold functions and general convex sets. We show that our algorithm closely captures the tradeoff between the complexity of the set and the number of samples needed to learn the parameters by exhibiting a set with small Gaussian surface area for which it is information theoretically impossible to learn the true Gaussian with few samples.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1908.01034/full.md

## Figures

4 figures with captions in the complete paper: https://tomesphere.com/paper/1908.01034/full.md

## References

35 references — full list in the complete paper: https://tomesphere.com/paper/1908.01034/full.md

---
Source: https://tomesphere.com/paper/1908.01034