Joint sparse coding and temporal dynamics support context reconfiguration

TL;DR

This paper explores how joint sparse coding and temporal dynamics in neural systems enable flexible context switching and memory retention, offering insights into brain function and artificial lifelong learning.

Contribution

It identifies joint sparse coding and temporal dynamics as key mechanisms for context reconfiguration and memory preservation in neural and artificial systems.

Findings

Sparsity reduces cross-context interference.

Temporal dynamics enhance context separability.

Networks with both properties improve lifelong learning retention.

Abstract

Adaptive behavior requires the brain to transition between distinct contexts while maintaining representations of prior experience. The ability to reconfigure neural representations without erasing previously acquired knowledge is central to learning in dynamic environments, yet the neural mechanisms that support this balance remain unclear. Understanding these mechanisms is also critical for addressing catastrophic forgetting in artificial systems designed for lifelong learning. Here, we identify joint sparse coding and temporal dynamics in both the mouse medial prefrontal cortex (mPFC) and computational networks as mechanisms that help preserve prior representations during context transitions. Specifically, sparsity in context-dependent representations reduces cross-context interference, whereas temporal dynamics within the network activity further enhance context separability across time. Strikingly, networks endowed with both properties, such as spiking neural networks, exhibit improved retention during lifelong learning without auxiliary heuristics. These findings establish joint sparse coding and temporal dynamics as a core mechanism supporting flexible context reconfiguration in lifelong learning and, through their activity constraining nature, as an energy-efficient architectural principle for stable adaptation. Together, they provide a mechanistic framework for understanding how the brain preserves prior knowledge while flexibly adapting to new contexts.