White Paper: Challenges and Considerations for the Creation of a Large Labelled Repository of Online Videos with Questionable Content

TL;DR

This white paper discusses key challenges and considerations in creating a large, annotated online video repository with questionable content, focusing on labeling, collection, annotation, distribution, and annotator safety.

Contribution

It provides a comprehensive overview of the critical factors and best practices for developing a valuable and ethically responsible video dataset for AI research.

Findings

Identifies suitable labels for questionable content

Recommends collection and annotation strategies

Highlights measures to protect annotator well-being

Abstract

This white paper presents a summary of the discussions regarding critical considerations to develop an extensive repository of online videos annotated with labels indicating questionable content. The main discussion points include: 1) the type of appropriate labels that will result in a valuable repository for the larger AI community; 2) how to design the collection and annotation process, as well as the distribution of the corpus to maximize its potential impact; and, 3) what actions we can take to reduce risk of trauma to annotators.