LASANA: Large-Scale Surrogate Modeling for Analog Neuromorphic Architecture Exploration

TL;DR

LASANA introduces machine learning-based surrogate models for analog neuromorphic components, enabling rapid and accurate exploration of large-scale architectures with significant speedup and minimal error.

Contribution

LASANA presents a novel data-driven surrogate modeling approach for analog neuromorphic circuits, improving simulation speed and accuracy for architecture exploration.

Findings

Up to 1000x faster than SPICE simulations.

Energy and latency predictions within 7% and 8% error.

Effective modeling of neuromorphic circuits like crossbar arrays and spiking neurons.

Abstract

Neuromorphic systems using in-memory or event-driven computing are motivated by the need for more energy-efficient processing of artificial intelligence workloads. Emerging neuromorphic architectures aim to combine traditional digital designs with the computational efficiency of analog computing and novel device technologies. A crucial problem in the rapid exploration and co-design of such architectures is the lack of tools for fast and accurate modeling and simulation. Typical mixed-signal design tools integrate a digital simulator with an analog solver like SPICE, which is prohibitively slow for large systems. By contrast, behavioral modeling of analog components is faster, but existing approaches are fixed to specific architectures with limited energy and performance modeling. In this paper, we propose LASANA, a novel approach that leverages machine learning to derive data-driven surrogate models of analog sub-blocks in a digital backend architecture. LASANA uses SPICE-level simulations of a circuit to train ML models that predict circuit energy, performance, and behavior at analog/digital interfaces. Such models can provide energy and performance annotation on top of existing behavioral models or function as replacements to analog simulation. We apply LASANA to an analog crossbar array and a spiking neuron circuit. Running MNIST and spiking MNIST, LASANA surrogates demonstrate up to three orders of magnitude speedup over SPICE, with energy, latency, and behavioral error less than 7%, 8%, and 2%, respectively.