Memory, Space, and Planning: Multiscale Predictive Representations

TL;DR

This paper discusses how multiscale predictive memory structures in the brain's hippocampus and prefrontal cortex support flexible behavior, learning, and planning, with implications for artificial intelligence development.

Contribution

It highlights the organization of memory as multiscale predictive representations and their role in hippocampal and prefrontal cortex functions, advancing understanding of neural memory mechanisms.

Findings

Memory structures are organized as multiscale predictive representations.

Hippocampus and PFC support detailed recall and experience generalization.

Predictive memory structures are crucial for planning and flexible behavior.

Abstract

Memory is inherently entangled with prediction and planning. Flexible behavior in biological and artificial agents depends on the interplay of learning from the past and predicting the future in ever-changing environments. This chapter reviews computational, behavioral, and neural evidence suggesting these processes rely on learning the relational structure of experiences, known as cognitive maps, and draws two key takeaways. First, that these memory structures are organized as multiscale, compact predictive representations in hippocampal and prefrontal cortex, or PFC, hierarchies. Second, we argue that such predictive memory structures are crucial to the complementary functions of the hippocampus and PFC, both for enabling a recall of detailed and coherent past episodes as well as generalizing experiences at varying scales for efficient prediction and planning. These insights advance our understanding of memory and planning mechanisms in the brain and hold significant implications for advancing artificial intelligence systems.