Spiking Associative Memory for Spatio-Temporal Patterns

TL;DR

This paper introduces a stochastic learning rule called cyclic STDP that enables spiking neural networks to effectively store and recall spatio-temporal patterns with precise timing, advancing the development of biologically plausible associative memory systems.

Contribution

The paper presents a novel cyclic STDP learning rule and demonstrates its ability to create a reliable, short-term associative memory in spiking neural networks with precise temporal coding.

Findings

Effective pattern storage and recall demonstrated in simulations

The learning rule enables precise spike timing in associative memory

Design parameters and their roles are clarified

Abstract

Spike Timing Dependent Plasticity is form of learning that has been demonstrated in real cortical tissue, but attempts to use it for artificial systems have not produced good results. This paper seeks to remedy this with two significant advances. The first is the development a simple stochastic learning rule called cyclic STDP that can extract patterns encoded in the precise spiking times of a group of neurons. We show that a population of neurons endowed with this learning rule can act as an effective short-term associative memory, storing and reliably recalling a large set of pattern associations over an extended period of time. The second major theme examines the challenges associated with training a neuron to produce a spike at a precise time and for the fidelity of spike recall time to be maintained as further learning occurs. The strong constraint of working with precisely-timed spikes (so-called temporal coding) is mandated by the learning rule but is also consistent with the believe in the necessity of such an encoding scheme to render a spiking neural network a competitive solution for flexible intelligent systems in continuous learning environments. The encoding and learning rules are demonstrated in the design of a single-layer associative memory (an input layer consisting of 3,200 spiking neurons fully-connected to a similar sized population of memory neurons), which we simulate and characterise. Design considerations and clarification of the role of parameters under the control of the designer are explored.