The Weak Supervision Landscape
Rafael Poyiadzi, Daniel Bacaicoa-Barber, Jesus Cid-Sueiro, Miquel, Perello-Nieto, Peter Flach, Raul Santos-Rodriguez

TL;DR
This paper introduces a framework to categorize various weak supervision methods, aiding dataset annotators and machine learning practitioners in understanding and choosing appropriate annotation strategies.
Contribution
It proposes a comprehensive framework with key dimensions to classify and relate different weak supervision approaches, clarifying their implications for machine learning.
Findings
Framework covers most existing weak supervision approaches
Helps practitioners understand annotation implications
Facilitates navigation of weak supervision options
Abstract
Many ways of annotating a dataset for machine learning classification tasks that go beyond the usual class labels exist in practice. These are of interest as they can simplify or facilitate the collection of annotations, while not greatly affecting the resulting machine learning model. Many of these fall under the umbrella term of weak labels or annotations. However, it is not always clear how different alternatives are related. In this paper we propose a framework for categorising weak supervision settings with the aim of: (1) helping the dataset owner or annotator navigate through the available options within weak supervision when prescribing an annotation process, and (2) describing existing annotations for a dataset to machine learning practitioners so that we allow them to understand the implications for the learning process. To this end, we identify the key elements that…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMachine Learning and Data Classification · Imbalanced Data Classification Techniques · Anomaly Detection Techniques and Applications
