TL;DR
This paper investigates how outliers affect fairness in ranking systems, formalizes their impact, and introduces OMIT, a method to improve fair exposure by suppressing outliers in top-k rankings, demonstrated on academic datasets.
Contribution
The paper formalizes outlier influence on fairness in ranking, presents an outlier detection-based method (OMIT), and shows its effectiveness in improving fairness while maintaining utility.
Findings
Outliers significantly influence exposure and fairness in rankings.
OMIT effectively suppresses outliers in top-k rankings.
Fairness improves with minimal utility loss using outlier-aware ranking.
Abstract
Traditional ranking systems are expected to sort items in the order of their relevance and thereby maximize their utility. In fair ranking, utility is complemented with fairness as an optimization goal. Recent work on fair ranking focuses on developing algorithms to optimize for fairness, given position-based exposure. In contrast, we identify the potential of outliers in a ranking to influence exposure and thereby negatively impact fairness. An outlier in a list of items can alter the examination probabilities, which can lead to different distributions of attention, compared to position-based exposure. We formalize outlierness in a ranking, show that outliers are present in realistic datasets, and present the results of an eye-tracking study, showing that users scanning order and the exposure of items are influenced by the presence of outliers. We then introduce OMIT, a method for fair…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
