Cross-Lingual Probing and Community-Grounded Analysis of Gender Bias in Low-Resource Bengali

TL;DR

This paper investigates gender bias in Bengali language models, highlighting the limitations of English-centric bias detection methods and emphasizing community-driven, culturally sensitive approaches for more accurate bias identification.

Contribution

It introduces localized bias detection techniques for Bengali and demonstrates the importance of community insights to understand cultural biases in low-resource languages.

Findings

Gender bias in Bengali differs from English, requiring tailored detection methods.

English-based bias detection tools are limited when applied to Bengali.

Community-driven research reveals culturally specific biases often missed by automated systems.

Abstract

Large Language Models (LLMs) have achieved significant success in recent years; yet, issues of intrinsic gender bias persist, especially in non-English languages. Although current research mostly emphasizes English, the linguistic and cultural biases inherent in Global South languages, like Bengali, are little examined. This research seeks to examine the characteristics and magnitude of gender bias in Bengali, evaluating the efficacy of current approaches in identifying and alleviating bias. We use several methods to extract gender-biased utterances, including lexicon-based mining, computational classification models, translation-based comparison analysis, and GPT-based bias creation. Our research indicates that the straight application of English-centric bias detection frameworks to Bengali is severely constrained by language disparities and socio-cultural factors that impact implicit biases. To tackle these difficulties, we executed two field investigations inside rural and low-income areas, gathering authentic insights on gender bias. The findings demonstrate that gender bias in Bengali presents distinct characteristics relative to English, requiring a more localized and context-sensitive methodology. Additionally, our research emphasizes the need of integrating community-driven research approaches to identify culturally relevant biases often neglected by automated systems. Our research enhances the ongoing discussion around gender bias in AI by illustrating the need to create linguistic tools specifically designed for underrepresented languages. This study establishes a foundation for further investigations into bias reduction in Bengali and other Indic languages, promoting the development of more inclusive and fair NLP systems.