Self-Organizing Language

TL;DR

This paper presents a new neuro-symbolic memory model that self-organizes to produce emergent symbolic order, enabling language generation without data and offering insights into the origins of human language.

Contribution

It introduces a novel emergent local memory paradigm that bridges neuro-symbolic computation and explains language formation as a self-organizing process.

Findings

Memory demonstrates topological protection and emergent symbolic order.

Language can be produced without data through self-organizing dynamics.

Words arise as a side-effect of emergent symbolic order.

Abstract

We introduce a novel paradigm of emergent local memory. It is a continuous-learning completely-parallel content-addressable memory encoding global order. It demonstrates how local constraints on uncoordinated learning can produce topologically protected memories realizing emergent symbolic order. It is therefore a neuro-symbolic bridge. It further has the ability to produce human language without data, by exploiting its own self-organizing dynamics. It teaches us that words arise as a side-effect of emergent symbolic order, and that human language patterns at all structural levels reflect a universal mechanism of word formation (which is subregular). This work answers essential questions about the existence \& origin of all the human language data.