Adaptive Spiking with Plasticity for Energy Aware Neuromorphic Systems

TL;DR

ASPEN is an adaptive, energy-aware neuromorphic technique that reduces spike activity and energy consumption in wearable systems by dynamically adjusting neuronal thresholds during training and inference.

Contribution

The paper introduces ASPEN, a novel method that adaptively controls energy use in neuromorphic systems through stochastic threshold perturbations, enhancing robustness and reducing spikes.

Findings

Significantly reduces spike counts and energy consumption.

Maintains accuracy comparable to state-of-the-art methods.

Supports dynamic energy control without complex reconfiguration.

Abstract

This paper presents ASPEN, a novel energy-aware technique for neuromorphic systems that could unleash the future of intelligent, always-on, ultra-low-power, and low-burden wearables. Our main research objectives are to explore the feasibility of neuromorphic computing for wearables, identify open research directions, and demonstrate the feasibility of developing an adaptive spiking technique for energy-aware computation, which can be game-changing for resource-constrained devices in always-on applications. As neuromorphic computing systems operate based on spike events, their energy consumption is closely related to spiking activity, i.e., each spike incurs computational and power costs; consequently, minimizing the number of spikes is a critical strategy for operating under constrained energy budgets. To support this goal, ASPEN utilizes stochastic perturbations to the neuronal threshold during training to not only enhance the network's robustness across varying thresholds, which can be controlled at inference time, but also act as a regularizer that improves generalization, reduces spiking activity, and enables energy control without the need for complex retraining or pruning. More specifically, ASPEN adaptively adjusts intrinsic neuronal parameters as a lightweight and scalable technique for dynamic energy control without reconfiguring the entire model. Our evaluation on neuromorphic emulator and hardware shows that ASPEN significantly reduces spike counts and energy consumption while maintaining accuracy comparable to state-of-the-art methods.