# Learning from satisfying assignments under continuous distributions

**Authors:** Cl\'ement L. Canonne, Anindya De, Rocco A. Servedio

arXiv: 1907.01619 · 2019-07-04

## TL;DR

This paper explores the learnability of distributions over continuous domains defined by the satisfying assignments of low-complexity Boolean functions, providing algorithms and hardness results for different degrees of polynomial threshold functions under various distributions.

## Contribution

It extends the framework of learning from satisfying assignments to continuous domains, analyzing the learnability of distributions defined by low-degree polynomial threshold functions under different background distributions.

## Key findings

- Efficient learning algorithms for degree-1 PTFs under log-concave distributions.
- Hardness results for degree-2 PTFs under log-concave distributions.
- Efficient algorithms for degree-2 PTFs under normal distributions.

## Abstract

What kinds of functions are learnable from their satisfying assignments? Motivated by this simple question, we extend the framework of De, Diakonikolas, and Servedio [DDS15], which studied the learnability of probability distributions over $\{0,1\}^n$ defined by the set of satisfying assignments to "low-complexity" Boolean functions, to Boolean-valued functions defined over continuous domains. In our learning scenario there is a known "background distribution" $\mathcal{D}$ over $\mathbb{R}^n$ (such as a known normal distribution or a known log-concave distribution) and the learner is given i.i.d. samples drawn from a target distribution $\mathcal{D}_f$, where $\mathcal{D}_f$ is $\mathcal{D}$ restricted to the satisfying assignments of an unknown low-complexity Boolean-valued function $f$. The problem is to learn an approximation $\mathcal{D}'$ of the target distribution $\mathcal{D}_f$ which has small error as measured in total variation distance.   We give a range of efficient algorithms and hardness results for this problem, focusing on the case when $f$ is a low-degree polynomial threshold function (PTF). When the background distribution $\mathcal{D}$ is log-concave, we show that this learning problem is efficiently solvable for degree-1 PTFs (i.e.,~linear threshold functions) but not for degree-2 PTFs. In contrast, when $\mathcal{D}$ is a normal distribution, we show that this learning problem is efficiently solvable for degree-2 PTFs but not for degree-4 PTFs. Our hardness results rely on standard assumptions about secure signature schemes.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1907.01619/full.md

## References

27 references — full list in the complete paper: https://tomesphere.com/paper/1907.01619/full.md

---
Source: https://tomesphere.com/paper/1907.01619