Healthy Distrust in AI systems

TL;DR

This paper introduces the concept of 'healthy distrust' in AI, emphasizing justified skepticism in AI usage within social contexts to foster genuine trust and respect human autonomy.

Contribution

It conceptualizes healthy distrust as a necessary and justified stance towards AI, filling a gap in existing trust models across multiple disciplines.

Findings

Healthy distrust is a justified, careful stance towards AI.

It emphasizes respecting human autonomy in AI usage.

The concept bridges gaps in interdisciplinary trust theories.

Abstract

Under the slogan of trustworthy AI, much of contemporary AI research is focused on designing AI systems and usage practices that inspire human trust and, thus, enhance adoption of AI systems. However, a person affected by an AI system may not be convinced by AI system design alone -- neither should they, if the AI system is embedded in a social context that gives good reason to believe that it is used in tension with a person's interest. In such cases, distrust in the system may be justified and necessary to build meaningful trust in the first place. We propose the term "healthy distrust" to describe such a justified, careful stance towards certain AI usage practices. We investigate prior notions of trust and distrust in computer science, sociology, history, psychology, and philosophy, outline a remaining gap that healthy distrust might fill and conceptualize healthy distrust as a crucial part for AI usage that respects human autonomy.