Why They Disagree: Decoding Differences in Opinions about AI Risk on the Lex Fridman Podcast

TL;DR

This paper analyzes societal debates on AI risk, revealing that disagreements stem from fundamental differences in causal premises about complex systems and applicability of past theories, rather than moral values.

Contribution

It introduces a method using ensemble LLMs to analyze reasoning chains and identify core points of contention in AI risk debates.

Findings

Disagreements on AI existential risk stem from causal premises about design vs. emergence.

Disagreements on employment risks relate to applicability of evolutionary theories.

The analysis approach can be applied to other public risk debates.

Abstract

The emergence of transformative technologies often surfaces deep societal divisions, nowhere more evident than in contemporary debates about artificial intelligence (AI). A striking feature of these divisions is that they persist despite shared interests in ensuring that AI benefits humanity and avoiding catastrophic outcomes. This paper analyzes contemporary debates about AI risk, parsing the differences between the "doomer" and "boomer" perspectives into definitional, factual, causal, and moral premises to identify key points of contention. We find that differences in perspectives about existential risk ("X-risk") arise fundamentally from differences in causal premises about design vs. emergence in complex systems, while differences in perspectives about employment risks ("E-risks") pertain to different causal premises about the applicability of past theories (evolution) vs their inapplicability (revolution). Disagreements about these two forms of AI risk appear to share two properties: neither involves significant disagreements on moral values and both can be described in terms of differing views on the extent of boundedness of human rationality. Our approach to analyzing reasoning chains at scale, using an ensemble of LLMs to parse textual data, can be applied to identify key points of contention in debates about risk to the public in any arena.