Cascaded Debiasing: Studying the Cumulative Effect of Multiple Fairness-Enhancing Interventions
Bhavya Ghai, Mihir Mishra, Klaus Mueller

TL;DR
This paper empirically investigates the cumulative effects of multiple fairness interventions in machine learning pipelines, revealing complex interactions that influence fairness, utility, and group disparities across various datasets and metrics.
Contribution
It provides the first extensive empirical analysis of combined fairness interventions, offering insights and recommendations for designing fair ML pipelines.
Findings
Multiple interventions generally improve fairness and reduce utility loss.
Adding more interventions does not always lead to better fairness or utility.
Certain intervention combinations optimize fairness and utility for specific metrics.
Abstract
Understanding the cumulative effect of multiple fairness enhancing interventions at different stages of the machine learning (ML) pipeline is a critical and underexplored facet of the fairness literature. Such knowledge can be valuable to data scientists/ML practitioners in designing fair ML pipelines. This paper takes the first step in exploring this area by undertaking an extensive empirical study comprising 60 combinations of interventions, 9 fairness metrics, 2 utility metrics (Accuracy and F1 Score) across 4 benchmark datasets. We quantitatively analyze the experimental data to measure the impact of multiple interventions on fairness, utility and population groups. We found that applying multiple interventions results in better fairness and lower utility than individual interventions on aggregate. However, adding more interventions do no always result in better fairness or worse…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEthics and Social Impacts of AI
