The AI Double Standard: Humans Judge All AIs for the Actions of One

TL;DR

This research demonstrates that moral judgments of one AI or human agent can influence attitudes towards others, revealing a double standard where AIs are judged more harshly, affecting trust and HCI outcomes.

Contribution

The study provides empirical evidence of moral spillover effects in human-AI interactions and uncovers an asymmetry in how AIs and humans are judged after immoral actions.

Findings

Moral spillover increases negative judgments of both AIs and humans.

No difference in spillover effects between AI and human contexts in general.

Spillover persists in AI contexts even when agents are individuated, but not in human contexts.

Abstract

Robots and other artificial intelligence (AI) systems are widely perceived as moral agents responsible for their actions. As AI proliferates, these perceptions may become entangled via the moral spillover of attitudes towards one AI to attitudes towards other AIs. We tested how the seemingly harmful and immoral actions of an AI or human agent spill over to attitudes towards other AIs or humans in two preregistered experiments. In Study 1 (N = 720), we established the moral spillover effect in human-AI interaction by showing that immoral actions increased attributions of negative moral agency (i.e., acting immorally) and decreased attributions of positive moral agency (i.e., acting morally) and moral patiency (i.e., deserving moral concern) to both the agent (a chatbot or human assistant) and the group to which they belong (all chatbot or human assistants). There was no significant difference in the spillover effects between the AI and human contexts. In Study 2 (N = 684), we tested whether spillover persisted when the agent was individuated with a name and described as an AI or human, rather than specifically as a chatbot or personal assistant. We found that spillover persisted in the AI context but not in the human context, possibly because AIs were perceived as more homogeneous due to their outgroup status relative to humans. This asymmetry suggests a double standard whereby AIs are judged more harshly than humans when one agent morally transgresses. With the proliferation of diverse, autonomous AI systems, HCI research and design should account for the fact that experiences with one AI could easily generalize to perceptions of all AIs and negative HCI outcomes, such as reduced trust.