The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware
Alpha Renner, Forrest Sheldon, Anatoly Zlotnik, Louis Tao, Andrew, Sornborger

TL;DR
This paper presents the first on-chip spiking neural network implementation of the backpropagation algorithm on neuromorphic hardware, demonstrating competitive accuracy and energy efficiency for edge computing applications.
Contribution
It introduces a neuromorphic, spiking backpropagation algorithm implemented on Intel's Loihi processor, enabling low-power, on-chip training of neural networks.
Findings
First fully on-chip spiking backpropagation implementation.
Achieves competitive accuracy on MNIST dataset.
Energy-delay product suitable for edge applications.
Abstract
The capabilities of natural neural systems have inspired new generations of machine learning algorithms as well as neuromorphic very large-scale integrated (VLSI) circuits capable of fast, low-power information processing. However, it has been argued that most modern machine learning algorithms are not neurophysiologically plausible. In particular, the workhorse of modern deep learning, the backpropagation algorithm, has proven difficult to translate to neuromorphic hardware. In this study, we present a neuromorphic, spiking backpropagation algorithm based on synfire-gated dynamical information coordination and processing, implemented on Intel's Loihi neuromorphic research processor. We demonstrate a proof-of-principle three-layer circuit that learns to classify digits from the MNIST dataset. To our knowledge, this is the first work to show a Spiking Neural Network (SNN) implementation…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neural Networks and Reservoir Computing
