The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam, Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud, Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki,, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi

TL;DR
The paper presents the eighth edition of a dialog system challenge, focusing on multi-domain task completion, response selection, scene-aware dialog, and schema-guided state tracking, with summaries of tasks, datasets, and system results.
Contribution
It introduces new challenge tracks, datasets, and evaluation methods for advancing end-to-end dialog system research across multiple complex tasks.
Findings
Overall trend towards end-to-end dialog systems
Improved performance in multi-domain task completion
Advancements in scene-aware and schema-guided dialog understanding
Abstract
This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSpeech and dialogue systems · Topic Modeling · Multi-Agent Systems and Negotiation
