Towards User-Focused Cross-Domain Testing: Disentangling Accessibility, Usability, and Fairness

TL;DR

This paper explores the complex interactions among fairness, usability, and accessibility testing in AI-driven software development, based on a review of recent systematic studies, to clarify their boundaries and integration challenges.

Contribution

It provides a comprehensive analysis of how fairness testing intersects with usability and accessibility testing, highlighting practical challenges and insights from recent systematic reviews.

Findings

Fairness testing overlaps with usability and accessibility testing.

Challenges in integrating fairness testing into development processes.

Insights from 12 recent systematic reviews.

Abstract

Fairness testing is increasingly recognized as fundamental in software engineering, especially in the domain of data-driven systems powered by artificial intelligence. However, its practical integration into software development may pose challenges, given its overlapping boundaries with usability and accessibility testing. In this tertiary study, we explore these complexities using insights from 12 systematic reviews published in the past decade, shedding light on the nuanced interactions among fairness, usability, and accessibility testing and how they intersect within contemporary software development practices.