Identifying Roles, Requirements and Responsibilities in Trustworthy AI Systems

TL;DR

This paper explores the roles, requirements, and responsibilities involved in deploying trustworthy AI systems, emphasizing the importance of transparency and privacy to enable domain practitioners to assess AI suitability effectively.

Contribution

It introduces a framework for understanding key roles and their responsibilities in trustworthy AI deployment, highlighting the transparency-privacy tension.

Findings

Identification of key roles in AI deployment

Analysis of role-specific requirements and responsibilities

Discussion of transparency versus privacy challenges

Abstract

Artificial Intelligence (AI) systems are being deployed around the globe in critical fields such as healthcare and education. In some cases, expert practitioners in these domains are being tasked with introducing or using such systems, but have little or no insight into what data these complex systems are based on, or how they are put together. In this paper, we consider an AI system from the domain practitioner's perspective and identify key roles that are involved in system deployment. We consider the differing requirements and responsibilities of each role, and identify a tension between transparency and privacy that needs to be addressed so that domain practitioners are able to intelligently assess whether a particular AI system is appropriate for use in their domain.