Sequence learning in a spiking neuronal network with memristive synapses

TL;DR

This paper explores the use of memristive ReRAM devices as synapses in a spiking neural network for sequence learning, demonstrating their feasibility and robustness in neuromorphic hardware simulations.

Contribution

It introduces a simulation of a biologically inspired sequence learning model using ReRAM memristive devices as synapses, analyzing their impact on performance and resilience.

Findings

ReRAM devices can effectively replace biological synapses in sequence learning models.

The model shows resilience to device variability and synaptic failure.

Performance depends on device properties like conductance resolution and on-off ratios.

Abstract

Brain-inspired computing proposes a set of algorithmic principles that hold promise for advancing artificial intelligence. They endow systems with self learning capabilities, efficient energy usage, and high storage capacity. A core concept that lies at the heart of brain computation is sequence learning and prediction. This form of computation is essential for almost all our daily tasks such as movement generation, perception, and language. Understanding how the brain performs such a computation is not only important to advance neuroscience but also to pave the way to new technological brain-inspired applications. A previously developed spiking neural network implementation of sequence prediction and recall learns complex, high-order sequences in an unsupervised manner by local, biologically inspired plasticity rules. An emerging type of hardware that holds promise for efficiently running this type of algorithm is neuromorphic hardware. It emulates the way the brain processes information and maps neurons and synapses directly into a physical substrate. Memristive devices have been identified as potential synaptic elements in neuromorphic hardware. In particular, redox-induced resistive random access memories (ReRAM) devices stand out at many aspects. They permit scalability, are energy efficient and fast, and can implement biological plasticity rules. In this work, we study the feasibility of using ReRAM devices as a replacement of the biological synapses in the sequence learning model. We implement and simulate the model including the ReRAM plasticity using the neural simulator NEST. We investigate the effect of different device properties on the performance characteristics of the sequence learning model, and demonstrate resilience with respect to different on-off ratios, conductance resolutions, device variability, and synaptic failure.