Reporting, Reviewing, and Responding to Harassment on Twitter

TL;DR

This study analyzes Twitter's harassment reporting process through a three-week project involving trusted flaggers, revealing insights into reporting patterns, platform responses, and challenges faced in managing online harassment.

Contribution

It provides a detailed examination of Twitter's harassment reporting and response system, including the role of trusted flaggers and the outcomes of reported cases.

Findings

Trusted flaggers assessed 811 reports in three weeks

Twitter suspended 70 accounts and issued 18 warnings

Challenges include reporting accuracy and platform response effectiveness

Abstract

When people experience harassment online, from individual threats or invective to coordinated campaigns of harassment, they have the option to report the harassers and content to the platform where the harassment has occurred. Platforms then evaluate harassment reports against terms of use and other policies to decide whether to remove content or take action against the alleged harasser--or not. On Twitter, harassing accounts can be deleted entirely, suspended (with content made unavailable pending appeal or specific changes), or sent a warning. Some platforms, including Twitter and YouTube, grant authorized reporters or trusted flaggers special privileges to identify and report inappropriate content on behalf of others. In November 2014, Twitter granted Women, Action, and the Media (WAM!) this authorized reporter status. In three weeks, WAM! reviewers assessed 811 incoming reports of harassment and escalated 161 reports to Twitter, ultimately seeing Twitter carry out 70 account suspensions, 18 warnings, and one deleted account. This document presents findings from this three-week project; it draws on both quantitative and qualitative methods. Findings focus on the people reporting and receiving harassment, the kinds of harassment that were reported, Twitter's response to harassment reports, the process of reviewing harassment reports, and challenges for harassment reporting processes.