If Eleanor Rigby Had Met ChatGPT: A Study on Loneliness in a Post-LLM World

TL;DR

This study examines how widespread use of ChatGPT affects loneliness, revealing both potential benefits in engagement and significant risks in sensitive situations, raising ethical concerns and the need for targeted research and industry action.

Contribution

It provides an empirical analysis of ChatGPT interactions related to loneliness, highlighting risks and ethical issues not addressed by current deployment.

Findings

ChatGPT engaged well in loneliness-related conversations

Failed to respond appropriately to suicidal ideation and trauma

Higher incidence of toxic content, especially targeting women

Abstract

Warning: this paper discusses content related, but not limited to, violence, sex, and suicide. Loneliness, or the lack of fulfilling relationships, significantly impacts a person's mental and physical well-being and is prevalent worldwide. Previous research suggests that large language models (LLMs) may help mitigate loneliness. However, we argue that the use of widespread LLMs in services like ChatGPT is more prevalent--and riskier, as they are not designed for this purpose. To explore this, we analysed user interactions with ChatGPT outside of its marketed use as a task-oriented assistant. In dialogues classified as lonely, users frequently (37%) sought advice or validation, and received good engagement. However, ChatGPT failed in sensitive scenarios, like responding appropriately to suicidal ideation or trauma. We also observed a 35% higher incidence of toxic content, with women being 22x more likely to be targeted than men. Our findings underscore ethical and legal questions about this technology, and note risks like radicalisation or further isolation. We conclude with recommendations to research and industry to address loneliness.