Overview of the TREC 2022 Fair Ranking Track
Michael D. Ekstrand, Graham McDonald, Amifa Raj, Isaac Johnson

TL;DR
The paper reviews the 2022 TREC Fair Ranking Track, which focused on developing algorithms that ensure fair exposure for documents representing protected demographics in Wikipedia editing tasks.
Contribution
It introduces a resource allocation task aimed at promoting fair exposure of protected characteristics in Wikipedia editing, addressing systemic biases.
Findings
Implemented a fair ranking evaluation framework.
Demonstrated potential for reducing bias in document exposure.
Highlighted importance of fairness in information retrieval.
Abstract
The TREC Fair Ranking Track aims to provide a platform for participants to develop and evaluate novel retrieval algorithms that can provide a fair exposure to a mixture of demographics or attributes, such as ethnicity, that are represented by relevant documents in response to a search query. For example, particular demographics or attributes can be represented by the documents topical content or authors. The 2022 Fair Ranking Track adopted a resource allocation task. The task focused on supporting Wikipedia editors who are looking to improve the encyclopedia's coverage of topics under the purview of a WikiProject. WikiProject coordinators and/or Wikipedia editors search for Wikipedia documents that are in need of editing to improve the quality of the article. The 2022 Fair Ranking track aimed to ensure that documents that are about, or somehow represent, certain protected…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsWikis in Education and Collaboration
