Can NLP Tackle Hate Speech in the Real World? Stakeholder-Informed Feedback and Survey on Counterspeech

TL;DR

This paper reviews NLP approaches to counterspeech, highlighting the gap between current research and community needs, and proposes stakeholder-informed practices to improve counterspeech interventions.

Contribution

It provides a systematic review of 74 NLP counterspeech studies and introduces stakeholder-informed practices through a participatory case study with NGOs.

Findings

Growing disconnect between NLP research and community needs

Stakeholder participation influences dataset creation and evaluation

Recommendations for re-centering stakeholder expertise in counterspeech

Abstract

Counterspeech, i.e. the practice of responding to online hate speech, has gained traction in NLP as a promising intervention. While early work emphasised collaboration with non-governmental organisation stakeholders, recent research trends have shifted toward automated pipelines that reuse a small set of legacy datasets, often without input from affected communities. This paper presents a systematic review of 74 NLP studies on counterspeech, analysing the extent to which stakeholder participation influences dataset creation, model development, and evaluation. To complement this analysis, we conducted a participatory case study with five NGOs specialising in online Gender-Based Violence (oGBV), identifying stakeholder-informed practices for counterspeech generation. Our findings reveal a growing disconnect between current NLP research and the needs of communities most impacted by toxic online content. We conclude with concrete recommendations for re-centring stakeholder expertise in counterspeech research.