Overview of the 2024 ALTA Shared Task: Detect Automatic AI-Generated Sentences for Human-AI Hybrid Articles

TL;DR

The 2024 ALTA shared task focuses on detecting AI-generated sentences within hybrid human-AI articles, presenting the task setup, evaluation methods, and system results.

Contribution

This paper introduces a new shared task for identifying AI-generated content in hybrid texts, expanding previous tasks to more complex real-world scenarios.

Findings

Systems achieved moderate detection accuracy

Hybrid text detection remains challenging

Benchmark results set a baseline for future research

Abstract

The ALTA shared tasks have been running annually since 2010. In 2024, the purpose of the task is to detect machine-generated text in a hybrid setting where the text may contain portions of human text and portions machine-generated. In this paper, we present the task, the evaluation criteria, and the results of the systems participating in the shared task.