Reinforcing Stereotypes of Anger: Emotion AI on African American Vernacular English

TL;DR

This study reveals that emotion AI models exhibit racial bias, particularly overpredicting anger in African American Vernacular English, highlighting the need for culturally aware affective computing systems.

Contribution

It provides a comprehensive analysis of emotion AI bias against AAVE, demonstrating increased false positives and racial stereotypes, and emphasizes the importance of dialect-informed models.

Findings

Models show over twice the false positive rate for anger on AAVE compared to GAE.

AAVE-dense tweets are more likely to be misclassified as angry, especially by non-ingroup annotators.

Neighborhood demographics correlate with higher anger predictions, indicating racial bias in emotion AI.

Abstract

Automated emotion detection is widely used in applications ranging from well-being monitoring to high-stakes domains like mental health and hiring. However, models often rely on annotations that reflect dominant cultural norms, limiting model ability to recognize emotional expression in dialects often excluded from training data distributions, such as African American Vernacular English (AAVE). This study examines emotion recognition model performance on AAVE compared to General American English (GAE). We analyze 2.7 million tweets geo-tagged within Los Angeles. Texts are scored for strength of AAVE using computational approximations of dialect features. Annotations of emotion presence and intensity are collected on a dataset of 875 tweets with both high and low AAVE densities. To assess model accuracy on a task as subjective as emotion perception, we calculate community-informed "silver" labels where AAVE-dense tweets are labeled by African American, AAVE-fluent (ingroup) annotators. On our labeled sample, GPT and BERT-based models exhibit false positive prediction rates of anger on AAVE more than double than on GAE. SpanEmo, a popular text-based emotion model, increases false positive rates of anger from 25 percent on GAE to 60 percent on AAVE. Additionally, a series of linear regressions reveals that models and non-ingroup annotations are significantly more correlated with profanity-based AAVE features than ingroup annotations. Linking Census tract demographics, we observe that neighborhoods with higher proportions of African American residents are associated with higher predictions of anger (Pearson's correlation r = 0.27) and lower joy (r = -0.10). These results find an emergent safety issue of emotion AI reinforcing racial stereotypes through biased emotion classification. We emphasize the need for culturally and dialect-informed affective computing systems.