"Look! It's a Computer Program! It's an Algorithm! It's AI!": Does Terminology Affect Human Perceptions and Evaluations of Algorithmic Decision-Making Systems?

TL;DR

This research investigates how different terminology used for algorithmic decision-making systems influences laypeople's perceptions, trust, and evaluations, highlighting the importance of mindful language use in research and communication.

Contribution

The study demonstrates that terminology significantly impacts perceptions and evaluations of ADM systems, revealing the need for careful language choice in research and practice.

Findings

Terminology affects perceived complexity and trust in ADM systems.

Different terms lead to varying evaluations of system properties.

Language can be strategically used to influence perceptions.

Abstract

In the media, in policy-making, but also in research articles, algorithmic decision-making (ADM) systems are referred to as algorithms, artificial intelligence, and computer programs, amongst other terms. We hypothesize that such terminological differences can affect people's perceptions of properties of ADM systems, people's evaluations of systems in application contexts, and the replicability of research as findings may be influenced by terminological differences. In two studies (N = 397, N = 622), we show that terminology does indeed affect laypeople's perceptions of system properties (e.g., perceived complexity) and evaluations of systems (e.g., trust). Our findings highlight the need to be mindful when choosing terms to describe ADM systems, because terminology can have unintended consequences, and may impact the robustness and replicability of HCI research. Additionally, our findings indicate that terminology can be used strategically (e.g., in communication about ADM systems) to influence people's perceptions and evaluations of these systems.