Fairness for the People, by the People: Minority Collective Action
Omri Ben-Dov, Samira Samadi, Amartya Sanyal, Alexandru \c{T}ifrea

TL;DR
This paper introduces a novel framework called Algorithmic Collective Action, enabling minority groups to improve fairness in machine learning models by strategically relabeling their data, without changing the model training process.
Contribution
It proposes three practical, model-agnostic methods for minority groups to induce fairness through data relabeling, validated on real-world datasets.
Findings
Minority groups can significantly reduce unfairness
Small impact on overall prediction error
Framework is model-agnostic and practical
Abstract
Machine learning models often preserve biases present in training data, leading to unfair treatment of certain minority groups. Despite an array of existing firm-side bias mitigation techniques, they typically incur utility costs and require organizational buy-in. Recognizing that many models rely on user-contributed data, end-users can induce fairness through the framework of Algorithmic Collective Action, where a coordinated minority group strategically relabels its own data to enhance fairness, without altering the firm's training process. We propose three practical, model-agnostic methods to approximate ideal relabeling and validate them on real-world datasets. Our findings show that a subgroup of the minority can substantially reduce unfairness with a small impact on the overall prediction error.
Peer Reviews
Decision·Submitted to ICLR 2026
+ The underlying idea holds merit, and is a nice, complementary approach to how fairness has been viewed primarily from firm-side. + The experiments also support that with the right “label flipping”, we can improve fairness.
While the idea is interesting, I believe there are a number of technical, practical/logical issues with it, as detailed below, as well as some lack of clarity on contributions. - One of the main issues with ignoring the firm-side perspective is that the firm, after all, is after predictive accuracy. If the firm notices that some users are sending data to it that is decreasing its accuracy on the “majority” group (which label flipping by the "minority" group will likely do), then the firm will c
- Overall the paper is well-written and easy to follow. - Shifts fairness work from firms to users is an interesting idea. The proposed algorithms are intuitive, easy to implement, and computationally efficient, making them appealing for real-world use by non-institutional actors. - The experiment covers multiple datasets with analyses of Pareto frontiers, label-flip efficiency, and sensitivity to limited majority information. - Analysis is good to have for understanding when and why minority-on
1. Comparisons are limited to random flipping and a few firm-side methods. I would suggest incorporating more recent pre-processing baselines (e.g., those fair subsampling or reweighting methods from existing packages[1,2]). 2. The concept of users manually relabeling their own data (e.g., resumes, engagement labels) is theoretically interesting but may not always reflect plausible or scalable user behavior. Discussion of realistic incentives, potential harms, or game-theoretic stability would e
- This paper frames the issue of fairness from a fresh and thought-provoking perspective. Rather than relying on traditional firm-side interventions, it shifts the focus to the user side, exploring how individuals from minority groups can collectively influence fairness without the company’s involvement. This user-driven framing feels both novel and insightful. - The proposed strategy draws on the concept of counterfactual fairness, asking what the predicted outcome would be if an individual’s
- The paper defines the minority and majority groups based on a binary sensitive attribute (for example, gender). However, in many real-world cases, bias may arise from other factors such as age, or even from interactions among multiple attributes (e.g., age + race + gender). Since the proposed method heavily relies on the definition of the minority group, it would be important to discuss how such groups should be identified or defined in practice. - The three relabeling methods appear quite heu
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEthics and Social Impacts of AI · Mobile Crowdsensing and Crowdsourcing · Explainable Artificial Intelligence (XAI)
