Content Addressable Memory Without Catastrophic Forgetting by Heteroassociation with a Fixed Scaffold
Sugandha Sharma, Sarthak Chandra, Ila R. Fiete

TL;DR
The paper introduces MESH, a novel content-addressable memory architecture inspired by brain circuits, that avoids catastrophic forgetting and maintains high recall quality across a wide range of stored patterns.
Contribution
MESH factorizes internal dynamics and external association, enabling a CAM system without the memory cliff, outperforming existing models in information capacity.
Findings
MESH nearly saturates the information bound for CAM networks.
It maintains partial recall with increasing patterns, avoiding catastrophic loss.
Experimental results confirm theoretical advantages.
Abstract
Content-addressable memory (CAM) networks, so-called because stored items can be recalled by partial or corrupted versions of the items, exhibit near-perfect recall of a small number of information-dense patterns below capacity and a 'memory cliff' beyond, such that inserting a single additional pattern results in catastrophic loss of all stored patterns. We propose a novel CAM architecture, Memory Scaffold with Heteroassociation (MESH), that factorizes the problems of internal attractor dynamics and association with external content to generate a CAM continuum without a memory cliff: Small numbers of patterns are stored with complete information recovery matching standard CAMs, while inserting more patterns still results in partial recall of every pattern, with a graceful trade-off between pattern number and pattern richness. Motivated by the architecture of the Entorhinal-Hippocampal…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neural dynamics and brain function
MethodsClass-activation map
