Chatbots to strengthen democracy: An interdisciplinary seminar to train identifying argumentation techniques of science denial

TL;DR

This paper proposes an interdisciplinary seminar where students develop AI chatbots using Large Language Models to identify science denial techniques, aiming to enhance critical engagement and resilience against misinformation.

Contribution

It introduces a novel educational approach employing LLM-based chatbots to train users in recognizing and understanding science denial arguments.

Findings

Development of AI chatbots simulating science denial

Evaluation of chatbot effectiveness in educational settings

Feasibility of using LLMs for argumentation training

Abstract

In recent times, discussions on social media platforms have increasingly come under scrutiny due to the proliferation of science denial and fake news. Traditional solutions, such as regulatory actions, have been implemented to mitigate the spread of misinformation; however, these measures alone are not sufficient. To complement these efforts, educational approaches are becoming essential in empowering users to critically engage with misinformation. Conversation training, through serious games or personalized methods, has emerged as a promising strategy to help users handle science denial and toxic conversation tactics. This paper suggests an interdisciplinary seminar to explore the suitability of Large Language Models (LLMs) acting as a persona of a science denier to support people in identifying misinformation and improving resilience against toxic interactions. In the seminar, groups of four to five students will develop an AI-based chatbot that enables realistic interactions with science-denial argumentation structures. The task involves planning the setting, integrating a Large Language Model to facilitate natural dialogues, implementing the chatbot using the RASA framework, and evaluating the outcomes in a user study. It is crucial that users understand what they need to do during the interaction, how to conclude it, and how the relevant information is conveyed. The seminar does not aim to develop chatbots for practicing debunking but serves to teach AI technologies and test the feasibility of this idea for future applications. The chatbot seminar is conducted as a hybrid, parallel master's module at the participating educational institutions.