Language learning from positive evidence, reconsidered: A simplicity-based approach
Anne S. Hsu (Department of Cognitive, Perceptual, Brain Sciences,, University College London), Nick Chater (Behavioural Science Group, Warwick, Business School, University of Warwick), Paul M.B. Vit\'anyi (CWI, Amsterdam)

TL;DR
This paper revisits how children can learn language from positive evidence alone by favoring the simplest grammatical encoding, providing formal results and empirical testability for this approach.
Contribution
It demonstrates that a simplicity-based learning model can successfully acquire language from positive evidence, addressing logical challenges in language acquisition theories.
Findings
Learners can acquire linguistic predictions and grammaticality judgements from positive evidence.
The simplicity approach scales to specific linguistic constructions.
The framework is empirically testable for human language acquisition.
Abstract
Children learn their native language by exposure to their linguistic and communicative environment, but apparently without requiring that their mistakes are corrected. Such learning from positive evidence has been viewed as raising logical problems for language acquisition. In particular, without correction, how is the child to recover from conjecturing an over-general grammar, which will be consistent with any sentence that the child hears? There have been many proposals concerning how this logical problem can be dissolved. Here, we review recent formal results showing that the learner has sufficient data to learn successfully from positive evidence, if it favours the simplest encoding of the linguistic input. Results include the ability to learn a linguistic prediction, grammaticality judgements, language production, and form-meaning mappings. The simplicity approach can also be…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques · Language and cultural evolution · Language Development and Disorders
