Software Fairness Testing in Practice

TL;DR

This paper explores the gap between academic fairness testing methods for AI and their practical adoption in industry, highlighting challenges and the need for accessible tools and guidelines.

Contribution

It provides empirical insights from industry practitioners on fairness testing challenges and emphasizes the necessity for practical solutions to bridge theory and practice.

Findings

Practitioners find fairness concepts difficult to interpret.

Lack of industry-aligned fairness testing tools hampers adoption.

Key challenges include data quality, metrics, and model interoperability.

Abstract

Software testing ensures that a system functions correctly, meets specified requirements, and maintains high quality. As artificial intelligence and machine learning (ML) technologies become integral to software systems, testing has evolved to address their unique complexities. A critical advancement in this space is fairness testing, which identifies and mitigates biases in AI applications to promote ethical and equitable outcomes. Despite extensive academic research on fairness testing, including test input generation, test oracle identification, and component testing, practical adoption remains limited. Industry practitioners often lack clear guidelines and effective tools to integrate fairness testing into real-world AI development. This study investigates how software professionals test AI-powered systems for fairness through interviews with 22 practitioners working on AI and ML projects. Our findings highlight a significant gap between theoretical fairness concepts and industry practice. While fairness definitions continue to evolve, they remain difficult for practitioners to interpret and apply. The absence of industry-aligned fairness testing tools further complicates adoption, necessitating research into practical, accessible solutions. Key challenges include data quality and diversity, time constraints, defining effective metrics, and ensuring model interoperability. These insights emphasize the need to bridge academic advancements with actionable strategies and tools, enabling practitioners to systematically address fairness in AI systems.