Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges
Shikib Mehri, Jinho Choi, Luis Fernando D'Haro, Jan Deriu, Maxine, Eskenazi, Milica Gasic, Kallirroi Georgila, Dilek Hakkani-Tur, Zekang Li,, Verena Rieser, Samira Shaikh, David Traum, Yi-Ting Yeh, Zhou Yu, Yizhe Zhang,, Chen Zhang
TL;DR
This report summarizes a workshop on the current state, limitations, and future research directions for automatic evaluation methods in dialog systems, emphasizing the rapid evolution of this research area.
Contribution
It provides a comprehensive overview of the challenges and promising future directions in automatic dialog evaluation research.
Findings
Current evaluation methods have significant limitations.
Identified promising research directions for improving dialog evaluation.
Emphasized the rapid evolution and importance of this research area.
Abstract
This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog. The workshop explored the current state of the art along with its limitations and suggested promising directions for future work in this important and very rapidly changing area of research.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Mental Health via Writing · Sentiment Analysis and Opinion Mining