GPT Chatbots for Alleviating Anxiety and Depression: A Pilot Randomized Controlled Trial with Afghan Women

TL;DR

This pilot RCT demonstrates that GPT-4 chatbots, especially when guided with empathetic instructions, can significantly reduce anxiety and depression among Afghan women, showing promise for accessible mental health support.

Contribution

First study to evaluate GPT-4 chatbots' effectiveness in reducing anxiety and depression in Afghan women through a randomized controlled trial.

Findings

Supportive GPT-4 chatbot reduced HADS scores significantly.

Higher linguistic alignment correlated with greater symptom reduction.

Perceived empathy was higher in the supportive chatbot group.

Abstract

In this study, we investigated the effects of GPT-4, with and without specific conversational instructions, on the mental health of Afghan women. These women face multifaceted challenges, including Taliban-imposed restrictions, societal inequalities, and domestic violence, adversely affecting their well-being. We conducted a randomized controlled trial with 60 participants, dividing them into three groups: GPT-4, a supportive listener (GPT-4 with empathetic engagement instructions), and a waiting list. The Hospital Anxiety and Depression Scale (HADS) was used to measure anxiety and depression before and after the intervention. Linguistic analysis of chat data examined personal pronouns, tones, emotions, and Language Style Matching (LSM). The supportive listener group showed a significant reduction in HADS scores compared to the other groups. Linguistic analysis revealed a more positive tone and higher LSM in the supportive listener group, with a significant negative correlation between LSM and changes in HADS scores, indicating greater linguistic alignment was linked to reductions in anxiety and depression. Perceived empathy ratings were also significantly higher in the supportive listener group. These findings highlight the potential of AI-driven interventions, like GPT-4, in providing accessible mental health support. However, such interventions should complement traditional psychotherapy, ensuring a collaborative approach to optimize therapeutic outcomes.