The Eighth Dialog System Technology Challenge

TL;DR

The paper presents the eighth edition of a dialog system challenge, focusing on multi-domain task completion, response selection, scene-aware dialog, and schema-guided state tracking, with summaries of tasks, datasets, and system results.

Contribution

It introduces new challenge tracks, datasets, and evaluation methods for advancing end-to-end dialog system research across multiple complex tasks.

Findings

Overall trend towards end-to-end dialog systems

Improved performance in multi-domain task completion

Advancements in scene-aware and schema-guided dialog understanding

Abstract

This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.