Investigating the heterogenous effects of a massive content moderation intervention via Difference-in-Differences

TL;DR

This study evaluates the effects of Reddit's large-scale deplatforming intervention, revealing mixed outcomes including user departure, reduced toxicity, and increased toxicity among a small subset, providing nuanced insights into moderation effectiveness.

Contribution

The paper applies causal inference to analyze heterogenous effects of a major content moderation intervention, offering detailed insights into its varied impacts on user behavior.

Findings

15.6% of users left the platform

Overall toxicity decreased by 4.1%

A small subset increased toxicity and activity

Abstract

In today's online environments, users encounter harm and abuse on a daily basis. Therefore, content moderation is crucial to ensure their safety and well-being. However, the effectiveness of many moderation interventions is still uncertain. Here, we apply a causal inference approach to shed light on the effectiveness of The Great Ban, a massive social media deplatforming intervention on Reddit. We analyze 53M comments shared by nearly 34K users, providing in-depth results on both the intended and unintended consequences of the ban. Our causal analyses reveal that 15.6% of the moderated users abandoned the platform while the remaining ones decreased their overall toxicity by 4.1%. Nonetheless, a small subset of users exhibited marked increases in both the intensity and volume of toxic behavior, particularly among those whose activity levels changed after the intervention. However, these reactions were not accompanied by greater activity or engagement, suggesting that even the most toxic users maintained a limited overall impact. Our findings bring to light new insights on the effectiveness of deplatforming moderation interventions. Furthermore, they also contribute to informing future content moderation strategies and regulations.