10 Years of Fair Representations: Challenges and Opportunities
Mattia Cerrato, Marius K\"oppel, Philipp Wolf, Stefan Kramer

TL;DR
This paper reviews a decade of Fair Representation Learning, analyzing its theoretical limitations and presenting extensive experiments that challenge the effectiveness of current methods in removing sensitive information.
Contribution
It provides a comprehensive review of FRL's development, revisits its theoretical foundations, and introduces large-scale AutoML experiments to evaluate its practical effectiveness.
Findings
Deterministic FRL methods struggle to fully remove sensitive information.
Recent deep learning theory highlights the hardness of eliminating undesired data.
AutoML-based adversarial testing reveals limitations of current fair representations.
Abstract
Fair Representation Learning (FRL) is a broad set of techniques, mostly based on neural networks, that seeks to learn new representations of data in which sensitive or undesired information has been removed. Methodologically, FRL was pioneered by Richard Zemel et al. about ten years ago. The basic concepts, objectives and evaluation strategies for FRL methodologies remain unchanged to this day. In this paper, we look back at the first ten years of FRL by i) revisiting its theoretical standing in light of recent work in deep learning theory that shows the hardness of removing information in neural network representations and ii) presenting the results of a massive experimentation (225.000 model fits and 110.000 AutoML fits) we conducted with the objective of improving on the common evaluation scenario for FRL. More specifically, we use automated machine learning (AutoML) to adversarially…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCambodian History and Society
MethodsTroubleshooting Guide: Canon Printer Showing Offline · Sparse Evolutionary Training
