Darwin3: A large-scale neuromorphic chip with a Novel ISA and On-Chip Learning

TL;DR

Darwin3 is a large-scale neuromorphic chip with a novel ISA and on-chip learning, enabling efficient, flexible SNN execution with significant memory and performance improvements over existing solutions.

Contribution

The paper introduces Darwin3, the largest neuromorphic chip to date, featuring a new ISA, innovative routing, and synaptic compression for enhanced scalability and efficiency.

Findings

Supported up to 2.35 million neurons, the largest in its class.

Achieved up to 28.3x code density improvement.

Reduced memory usage by up to 200.8x for CSNN mapping.

Abstract

Spiking Neural Networks (SNNs) are gaining increasing attention for their biological plausibility and potential for improved computational efficiency. To match the high spatial-temporal dynamics in SNNs, neuromorphic chips are highly desired to execute SNNs in hardware-based neuron and synapse circuits directly. This paper presents a large-scale neuromorphic chip named Darwin3 with a novel instruction set architecture(ISA), which comprises 10 primary instructions and a few extended instructions. It supports flexible neuron model programming and local learning rule designs. The Darwin3 chip architecture is designed in a mesh of computing nodes with an innovative routing algorithm. We used a compression mechanism to represent synaptic connections, significantly reducing memory usage. The Darwin3 chip supports up to 2.35 million neurons, making it the largest of its kind in neuron scale. The experimental results showed that code density was improved up to 28.3x in Darwin3, and neuron core fan-in and fan-out were improved up to 4096x and 3072x by connection compression compared to the physical memory depth. Our Darwin3 chip also provided memory saving between 6.8X and 200.8X when mapping convolutional spiking neural networks (CSNN) onto the chip, demonstrating state-of-the-art performance in accuracy and latency compared to other neuromorphic chips.