The Chilling: Identifying Strategic Antisocial Behavior Online and Examining the Impact on Journalists

TL;DR

This paper introduces a novel tree-structured Transformer model to identify strategic antisocial behavior online, revealing its impact on journalists and suggesting platform interventions to mitigate toxicity.

Contribution

We develop a hierarchical Transformer classifier that detects attacker, supporter, and bystander behaviors and their strategies in online conversations, enabling analysis of their effects on journalists.

Findings

Attacker interactions correlate with reduced journalist posting activity.

The model effectively classifies user roles and strategies in Twitter conversations.

Online attacks have a measurable chilling effect on journalistic activity.

Abstract

On social platforms like Twitter, strategic targeted attacks are becoming increasingly common, especially against vulnerable groups such as female journalists. Two key challenges in identifying strategic online behavior are the complex structure of online conversations and the hidden nature of potential strategies that drive user behavior. To address these, we develop a new tree structured Transformer model that categorizes replies based on their hierarchical conversation structures. Extensive experiments demonstrate that our proposed classification model can effectively detect different user groups, namely attackers, supporters, and bystanders, and their latent strategies. To demonstrate the utility of our approach, we apply this classifier to real time Twitter data and conduct a series of quantitative analyses on the interactions between journalists with different groups of users. Our classification approach allows us to not only explore strategic behaviors of attackers but also those of supporters and bystanders who engage in online interactions. When examining the impact of online attacks, we find a strong correlation between the presence of attackers' interactions and chilling effects, where journalists tend to slow their subsequent posting behavior. This paper provides a deeper understanding of how different user groups engage in online discussions and highlights the detrimental effects of attacker presence on journalists, other users, and conversational outcomes. Our findings underscore the need for social platforms to develop tools that address coordinated toxicity. By detecting patterns of coordinated attacks early, platforms could limit the visibility of toxic content to prevent escalation. Additionally, providing journalists and users with tools for real time reporting could empower them to manage hostile interactions more effectively.