TL;DR
The GENEA Challenge 2020 provided a large-scale, crowdsourced evaluation of gesture generation systems on a common dataset, enabling direct comparison and benchmarking of recent data-driven approaches in co-speech gesture synthesis.
Contribution
This paper introduces the GENEA Challenge 2020, establishing a standardized benchmark for evaluating and comparing gesture generation systems using a shared dataset and evaluation pipeline.
Findings
Systems showed varied performance, highlighting strengths and weaknesses.
Crowdsourced evaluation provided diverse user preferences.
Benchmarking revealed the current state and gaps in gesture generation methods.
Abstract
Co-speech gestures, gestures that accompany speech, play an important role in human communication. Automatic co-speech gesture generation is thus a key enabling technology for embodied conversational agents (ECAs), since humans expect ECAs to be capable of multi-modal communication. Research into gesture generation is rapidly gravitating towards data-driven methods. Unfortunately, individual research efforts in the field are difficult to compare: there are no established benchmarks, and each study tends to use its own dataset, motion visualisation, and evaluation methodology. To address this situation, we launched the GENEA Challenge, a gesture-generation challenge wherein participating teams built automatic gesture-generation systems on a common dataset, and the resulting systems were evaluated in parallel in a large, crowdsourced user study using the same motion-rendering pipeline.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
