The role of team diversity in AI systems development

TL;DR

This study explores how team diversity influences AI development, revealing six key roles that diverse teams play in promoting fairness, bias mitigation, and inclusive decision-making across various projects and organizational contexts.

Contribution

It provides empirical insights into the social dynamics of AI teams, highlighting six roles of diversity in enhancing fairness and bias mitigation in AI systems.

Findings

Diverse teams help identify biases more effectively.

Diversity fosters empathy and inclusive decision-making.

Team diversity acts as a safeguard against systemic discrimination.

Abstract

The widespread integration of AI technologies has intensified concerns about fairness and bias, as these systems often perpetuate societal inequalities through flawed data and design choices. While software engineering research has largely concentrated on technical solutions, such as improving datasets and models, the social dynamics that shape AI outcomes remain underexplored. This study investigates the role of team diversity in the development of AI systems. Drawing from the experience of four AI focused teams working in a large software company operating in Brazil and Portugal, and collaborating with global clients, the study explores how diverse teams influence the development of AI systems. Using Grounded Theory, we conducted 25 interviews with software professionals involved in projects spanning domains such as education, energy, accessibility, and facial recognition. Although our study is conducted in an organizational setting, the variety of projects, from regional to multinational, ensures exposure to global development practices and diverse team dynamics, bringing a variety of perspectives into our findings. Our analysis revealed six key roles that team diversity played in AI development: diversifying perspectives for bias identification, bringing empathy to AI development, addressing systemic discrimination, supporting inclusive and participatory decision making, using diversity as a safeguard against bias, and fostering broadened thinking in problem solving. These findings highlight the importance of incorporating diverse perspectives in AI projects and offer practical recommendations for integrating fairness considerations into software development practices.