List Sample Compression and Uniform Convergence
Steve Hanneke, Shay Moran, and Tom Waknine

TL;DR
This paper explores the applicability of classical PAC learning principles to list learning, revealing that uniform convergence remains equivalent to learnability, but sample compression fails in certain list learning scenarios, refuting a longstanding conjecture.
Contribution
It demonstrates that uniform convergence retains its equivalence to learnability in list PAC learning, but provides counterexamples showing sample compression does not always hold, refuting previous conjectures.
Findings
Uniform convergence remains equivalent to learnability in list PAC learning.
Counterexamples show certain list-learnable classes cannot be compressed.
Sample compression conjecture is refuted for list learning with specific label spaces.
Abstract
List learning is a variant of supervised classification where the learner outputs multiple plausible labels for each instance rather than just one. We investigate classical principles related to generalization within the context of list learning. Our primary goal is to determine whether classical principles in the PAC setting retain their applicability in the domain of list PAC learning. We focus on uniform convergence (which is the basis of Empirical Risk Minimization) and on sample compression (which is a powerful manifestation of Occam's Razor). In classical PAC learning, both uniform convergence and sample compression satisfy a form of `completeness': whenever a class is learnable, it can also be learned by a learning rule that adheres to these principles. We ask whether the same completeness holds true in the list learning setting. We show that uniform convergence remains…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Data Compression Techniques · Distributed Sensor Networks and Detection Algorithms · Sparse and Compressive Sensing Techniques
MethodsFocus
