What Can We Learn Privately?
Shiva Prasad Kasiviswanathan, Homin K. Lee, Kobbi Nissim, Sofya, Raskhodnikova, and Adam Smith

TL;DR
This paper explores the capabilities and limitations of private learning algorithms, demonstrating that many concept classes can be learned privately with minimal sample sizes, and characterizing local private learning.
Contribution
It proves that any concept class learnable non-privately with polynomial complexity can be learned privately with similar efficiency, and characterizes local private learning algorithms as equivalent to the SQ model.
Findings
Private agnostic learning is possible with logarithmic sample size in concept class size.
A polynomial-time private PAC learner is provided for parity functions.
A separation between interactive and noninteractive local learning algorithms is established.
Abstract
Learning problems form an important category of computational tasks that generalizes many of the computations researchers apply to large real-life data sets. We ask: what concept classes can be learned privately, namely, by an algorithm whose output does not depend too heavily on any one input or specific training example? More precisely, we investigate learning algorithms that satisfy differential privacy, a notion that provides strong confidentiality guarantees in contexts where aggregate information is released about a database containing sensitive information about individuals. We demonstrate that, ignoring computational constraints, it is possible to privately agnostically learn any concept class using a sample size approximately logarithmic in the cardinality of the concept class. Therefore, almost anything learnable is learnable privately: specifically, if a concept class is…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPrivacy-Preserving Technologies in Data · Machine Learning and Algorithms · Cryptography and Data Security
