Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation

TL;DR

This paper explores how Large Language Models (LLMs) are used both to spread and combat disinformation in online forums, revealing complex dynamics and strategies among different participants.

Contribution

It introduces a communication game simulation to analyze LLM roles in disinformation, highlighting their dual potential for misuse and mitigation.

Findings

LLMs are exploited differently by disinformers, moderators, and users.

Strategies vary based on participant roles and goals.

Implications for future LLM development and platform design.

Abstract

The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, can be weaponised to produce sophisticated and persuasive disinformation, yet they also hold promise for enhancing detection and mitigation strategies. This paper investigates the complex dynamics between LLMs and disinformation through a communication game that simulates online forums, inspired by the game Werewolf, with 25 participants. We analyse how Disinformers, Moderators, and Users leverage LLMs to advance their goals, revealing both the potential for misuse and combating disinformation. Our findings highlight the varying uses of LLMs depending on the participants' roles and strategies, underscoring the importance of understanding their effectiveness in this context. We conclude by discussing implications for future LLM development and online platform design, advocating for a balanced approach that empowers users and fosters trust while mitigating the risks of LLM-assisted disinformation.