Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent

TL;DR

This paper examines the importance of understanding and justifying racial categories in AI fairness, highlighting how unclear assumptions can cause harm and proposing a framework for transparency in racialization processes.

Contribution

It demonstrates the impact of ambiguous racial categories on dataset representation and model performance, and introduces CIRCSheets for documenting racialization assumptions.

Findings

Unclear racial categories lead to poor group representation.

Misaligned racialization can cause harm in AI applications.

CIRCSheets enhances transparency in racial category selection.

Abstract

Racial diversity has become increasingly discussed within the AI and algorithmic fairness literature, yet little attention is focused on justifying the choices of racial categories and understanding how people are racialized into these chosen racial categories. Even less attention is given to how racial categories shift and how the racialization process changes depending on the context of a dataset or model. An unclear understanding of \textit{who} comprises the racial categories chosen and \textit{how} people are racialized into these categories can lead to varying interpretations of these categories. These varying interpretations can lead to harm when the understanding of racial categories and the racialization process is misaligned from the actual racialization process and racial categories used. Harm can also arise if the racialization process and racial categories used are irrelevant or do not exist in the context they are applied. In this paper, we make two contributions. First, we demonstrate how racial categories with unclear assumptions and little justification can lead to varying datasets that poorly represent groups obfuscated or unrepresented by the given racial categories and models that perform poorly on these groups. Second, we develop a framework, CIRCSheets, for documenting the choices and assumptions in choosing racial categories and the process of racialization into these categories to facilitate transparency in understanding the processes and assumptions made by dataset or model developers when selecting or using these racial categories.