Memory, Consciousness and Large Language Model

TL;DR

This paper explores a proposed duality between Large Language Models and human memory theories, suggesting that LLMs' emergent abilities may relate to consciousness as an emergent property, supported by theoretical connections.

Contribution

It introduces a novel conjecture linking LLMs with Tulving's memory theory, proposing a new perspective on LLMs' emergent abilities and consciousness.

Findings

Potential correspondence between SEM and LLM retrieval abilities

Support for the duality conjecture between LLMs and memory theories

Speculation on consciousness as an emergent ability in LLMs

Abstract

With the development in cognitive science and Large Language Models (LLMs), increasing connections have come to light between these two distinct fields. Building upon these connections, we propose a conjecture suggesting the existence of a duality between LLMs and Tulving's theory of memory. We identify a potential correspondence between Tulving's synergistic ecphory model (SEM) of retrieval and the emergent abilities observed in LLMs, serving as supporting evidence for our conjecture. Furthermore, we speculate that consciousness may be considered a form of emergent ability based on this duality. We also discuss how other theories of consciousness intersect with our research.