Memory makes computation universal, remember?

TL;DR

This paper argues that memory is the key to universal computation, showing that maintaining and accessing state is both necessary and sufficient for complex behavior across biological and artificial systems.

Contribution

It provides a formal proof that memory capabilities are fundamental for universal computation, unifying diverse systems under a common theoretical framework.

Findings

Memory enables universal computation through state maintenance and access.

Parallel systems like neural networks achieve universality via state retention.

Computational advances stem from improved memory, not processing complexity.

Abstract

Recent breakthroughs in AI capability have been attributed to increasingly sophisticated architectures and alignment techniques, but a simpler principle may explain these advances: memory makes computation universal. Memory enables universal computation through two fundamental capabilities: recursive state maintenance and reliable history access. We formally prove these requirements are both necessary and sufficient for universal computation. This principle manifests across scales, from cellular computation to neural networks to language models. Complex behavior emerges not from sophisticated processing units but from maintaining and accessing state across time. We demonstrate how parallel systems like neural networks achieve universal computation despite limitations in their basic units by maintaining state across iterations. This theoretical framework reveals a universal pattern: computational advances consistently emerge from enhanced abilities to maintain and access state rather than from more complex basic operations. Our analysis unifies understanding of computation across biological systems, artificial intelligence, and human cognition, reminding us that humanity's own computational capabilities have evolved in step with our technical ability to remember through oral traditions, writing, and now computing.