TL;DR
This paper presents a novel interactive language learning framework inspired by Wittgenstein's language games, where humans and computers collaboratively learn and adapt to communicate effectively in a blocks world task.
Contribution
It introduces a new interactive setting for language learning, analyzes human strategies, and demonstrates rapid learning of semantic models with pragmatic modeling enhancements.
Findings
Using compositionality improves task performance.
Avoiding synonyms correlates with better success.
Pragmatic modeling accelerates computer learning.
Abstract
We introduce a new language learning setting relevant to building adaptive natural language interfaces. It is inspired by Wittgenstein's language games: a human wishes to accomplish some task (e.g., achieving a certain configuration of blocks), but can only communicate with a computer, who performs the actual actions (e.g., removing all red blocks). The computer initially knows nothing about language and therefore must learn it from scratch through interaction, while the human adapts to the computer's capabilities. We created a game in a blocks world and collected interactions from 100 people playing it. First, we analyze the humans' strategies, showing that using compositionality and avoiding synonyms correlates positively with task performance. Second, we compare computer strategies, showing how to quickly learn a semantic parsing model from scratch, and that modeling pragmatics…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
