Codes, Patterns and Shapes of Contemporary Online Antisemitism and Conspiracy Narratives -- an Annotation Guide and Labeled German-Language Dataset in the Context of COVID-19

TL;DR

This paper presents an annotation guide and a labeled German-language dataset of approximately 3,700 Telegram messages to facilitate research on antisemitic and conspiracy content related to COVID-19.

Contribution

It introduces a comprehensive annotation guideline and provides a labeled dataset for antisemitic and conspiracy narratives in German, addressing a gap in resources for non-English content.

Findings

Annotated dataset of 3,700 Telegram messages

Defined forms of antisemitism including encoded and post-Holocaust antisemitism

Facilitates future research on online antisemitic and conspiracy content

Abstract

Over the course of the COVID-19 pandemic, existing conspiracy theories were refreshed and new ones were created, often interwoven with antisemitic narratives, stereotypes and codes. The sheer volume of antisemitic and conspiracy theory content on the Internet makes data-driven algorithmic approaches essential for anti-discrimination organizations and researchers alike. However, the manifestation and dissemination of these two interrelated phenomena is still quite under-researched in scholarly empirical research of large text corpora. Algorithmic approaches for the detection and classification of specific contents usually require labeled datasets, annotated based on conceptually sound guidelines. While there is a growing number of datasets for the more general phenomenon of hate speech, the development of corpora and annotation guidelines for antisemitic and conspiracy content is still in its infancy, especially for languages other than English. We contribute to closing this gap by developing an annotation guide for antisemitic and conspiracy theory online content in the context of the COVID-19 pandemic. We provide working definitions, including specific forms of antisemitism such as encoded and post-Holocaust antisemitism. We use these to annotate a German-language dataset consisting of ~3,700 Telegram messages sent between 03/2020 and 12/2021.