Socially Responsible Data for Large Multilingual Language Models

TL;DR

This paper discusses the ethical, social, and cultural challenges of collecting data for multilingual large language models, emphasizing community involvement and proposing guidelines for responsible data practices.

Contribution

It offers twelve recommendations for ethically and culturally responsible data collection for underrepresented languages in LLMs, based on recent scholarship and community engagement.

Findings

Highlighting ethical concerns in data collection for underrepresented languages

Proposing community-centered approaches and participatory design

Providing guidelines to mitigate exploitation and cultural insensitivity

Abstract

Large Language Models (LLMs) have rapidly increased in size and apparent capabilities in the last three years, but their training data is largely English text. There is growing interest in multilingual LLMs, and various efforts are striving for models to accommodate languages of communities outside of the Global North, which include many languages that have been historically underrepresented in digital realms. These languages have been coined as "low resource languages" or "long-tail languages", and LLMs performance on these languages is generally poor. While expanding the use of LLMs to more languages may bring many potential benefits, such as assisting cross-community communication and language preservation, great care must be taken to ensure that data collection on these languages is not extractive and that it does not reproduce exploitative practices of the past. Collecting data from languages spoken by previously colonized people, indigenous people, and non-Western languages raises many complex sociopolitical and ethical questions, e.g., around consent, cultural safety, and data sovereignty. Furthermore, linguistic complexity and cultural nuances are often lost in LLMs. This position paper builds on recent scholarship, and our own work, and outlines several relevant social, cultural, and ethical considerations and potential ways to mitigate them through qualitative research, community partnerships, and participatory design approaches. We provide twelve recommendations for consideration when collecting language data on underrepresented language communities outside of the Global North.