Controlling Gender Bias in Retrieval via a Backpack Architecture
Amirabbas Afzali, Amirreza Velae, Iman Ahmadi, Mohammad Aliannejadi

TL;DR
This paper introduces a novel Backpack architecture-based framework that effectively reduces gender bias in language model retrieval tasks while maintaining high performance levels.
Contribution
It presents a new debiasing method leveraging Backpack language models, addressing bias in ranking systems without significant performance loss.
Findings
Significant reduction in gender bias in retrieval tasks
Minimal impact on model performance
Effective application in ranking systems
Abstract
The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When LLMs are integrated into ranking systems, they can propagate these biases, leading to unfair outcomes in critical applications such as search engines and recommendation systems. Backpack Language Models, unlike traditional transformer-based models that treat text sequences as monolithic structures, generate outputs as weighted combinations of non-contextual, learned word aspects, also known as senses. Leveraging this architecture, we propose a framework for debiasing ranking tasks. Our experimental results show that this framework effectively mitigates gender bias in text retrieval and ranking with minimal degradation in performance.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Ethics and Social Impacts of AI · Information Retrieval and Search Behavior
