Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations

TL;DR

This paper explores ethics-based auditing (EBA) as a governance tool for ensuring automated decision-making systems adhere to ethical principles, discussing its design, implementation, and limitations to promote responsible AI deployment.

Contribution

It provides a theoretical framework for EBA, proposes seven design criteria, and analyzes various constraints affecting its effectiveness in ethical governance of ADMS.

Findings

EBA promotes transparency and procedural regularity in governance.

Seven criteria are proposed for effective EBA implementation.

Multiple constraints influence the feasibility and impact of EBA.

Abstract

Important decisions that impact human lives, livelihoods, and the natural environment are increasingly being automated. Delegating tasks to so-called automated decision-making systems (ADMS) can improve efficiency and enable new solutions. However, these benefits are coupled with ethical challenges. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine human self-determination. New governance mechanisms are thus needed that help organisations design and deploy ADMS in ways that are ethical, while enabling society to reap the full economic and social benefits of automation. In this article, we consider the feasibility and efficacy of ethics-based auditing (EBA) as a governance mechanism that allows organisations to validate claims made about their ADMS. Building on previous work, we define EBA as a structured process whereby an entity's present or past behaviour is assessed for consistency with relevant principles or norms. We then offer three contributions to the existing literature. First, we provide a theoretical explanation of how EBA can contribute to good governance by promoting procedural regularity and transparency. Second, we propose seven criteria for how to design and implement EBA procedures successfully. Third, we identify and discuss the conceptual, technical, social, economic, organisational, and institutional constraints associated with EBA. We conclude that EBA should be considered an integral component of multifaced approaches to managing the ethical risks posed by ADMS.