Weakly Supervised Learning Creates a Fusion of Modeling Cultures

TL;DR

This paper discusses the challenges and recent developments in weakly supervised learning, emphasizing the integration of data modeling to improve stability and reliability over traditional algorithmic approaches.

Contribution

It highlights the importance of combining data modeling with algorithmic methods in weak supervision to enhance model stability and accuracy.

Findings

Weak supervision often leads to unstable results with pure algorithmic models.

Integrating data modeling can improve the robustness of weakly supervised learning.

Recent developments focus on hybrid approaches combining data and algorithmic modeling.

Abstract

The past two decades have witnessed the great success of the algorithmic modeling framework advocated by Breiman et al. (2001). Nevertheless, the excellent prediction performance of these black-box models rely heavily on the availability of strong supervision, i.e. a large set of accurate and exact ground-truth labels. In practice, strong supervision can be unavailable or expensive, which calls for modeling techniques under weak supervision. In this comment, we summarize the key concepts in weakly supervised learning and discuss some recent developments in the field. Using algorithmic modeling alone under a weak supervision might lead to unstable and misleading results. A promising direction would be integrating the data modeling culture into such a framework.