Self-Organizing Language
P. Myles Eugenio, Anthony Beavers

TL;DR
This paper presents a new neuro-symbolic memory model that self-organizes to produce emergent symbolic order, enabling language generation without data and offering insights into the origins of human language.
Contribution
It introduces a novel emergent local memory paradigm that bridges neuro-symbolic computation and explains language formation as a self-organizing process.
Findings
Memory demonstrates topological protection and emergent symbolic order.
Language can be produced without data through self-organizing dynamics.
Words arise as a side-effect of emergent symbolic order.
Abstract
We introduce a novel paradigm of emergent local memory. It is a continuous-learning completely-parallel content-addressable memory encoding global order. It demonstrates how local constraints on uncoordinated learning can produce topologically protected memories realizing emergent symbolic order. It is therefore a neuro-symbolic bridge. It further has the ability to produce human language without data, by exploiting its own self-organizing dynamics. It teaches us that words arise as a side-effect of emergent symbolic order, and that human language patterns at all structural levels reflect a universal mechanism of word formation (which is subregular). This work answers essential questions about the existence \& origin of all the human language data.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsOrigins and Evolution of Life · Language and cultural evolution · Cognitive Science and Education Research
