Dialog System Technology Challenge 7

TL;DR

The paper summarizes the seventh Dialog System Technology Challenge, highlighting advancements in end-to-end dialog systems across sentence selection, generation, and audio-visual scene-aware tasks, with participants achieving impressive results.

Contribution

It provides a comprehensive overview of DSTC7, including new datasets, system submissions, and trends in end-to-end dialog system development.

Findings

Participants achieved state-of-the-art results.

New datasets facilitated diverse dialog tasks.

End-to-end models showed promising performance.

Abstract

This paper introduces the Seventh Dialog System Technology Challenges (DSTC), which use shared datasets to explore the problem of building dialog systems. Recently, end-to-end dialog modeling approaches have been applied to various dialog tasks. The seventh DSTC (DSTC7) focuses on developing technologies related to end-to-end dialog systems for (1) sentence selection, (2) sentence generation and (3) audio visual scene aware dialog. This paper summarizes the overall setup and results of DSTC7, including detailed descriptions of the different tracks and provided datasets. We also describe overall trends in the submitted systems and the key results. Each track introduced new datasets and participants achieved impressive results using state-of-the-art end-to-end technologies.