Fearless Steps Challenge Phase-1 Evaluation Plan

TL;DR

The Fearless Steps Challenge Phase-1 evaluates advanced speech and language systems on naturalistic audio in challenging environments, encouraging research submissions for a special session at INTERSPEECH 2019.

Contribution

This paper presents the evaluation plan for the inaugural Fearless Steps Challenge, focusing on large-scale, real-world speech tasks in difficult conditions.

Findings

Benchmark for large-scale speech systems in natural environments

Encourages diverse research submissions for speech applications

Establishes a platform for evaluating state-of-the-art speech technologies

Abstract

The Fearless Steps Challenge 2019 Phase-1 (FSC-P1) is the inaugural Challenge of the Fearless Steps Initiative hosted by the Center for Robust Speech Systems (CRSS) at the University of Texas at Dallas. The goal of this Challenge is to evaluate the performance of state-of-the-art speech and language systems for large task-oriented teams with naturalistic audio in challenging environments. Researchers may select to participate in any single or multiple of these challenge tasks. Researchers may also choose to employ the FEARLESS STEPS corpus for other related speech applications. All participants are encouraged to submit their solutions and results for consideration in the ISCA INTERSPEECH-2019 special session.