SkipSNN: Efficiently Classifying Spike Trains with Event-attention

TL;DR

SkipSNN introduces an event-attention mechanism to enhance spiking neural networks by dynamically filtering noise, leading to improved efficiency and accuracy in spike train classification tasks.

Contribution

It proposes SkipSNN, a novel SNN extension that learns to mask noise and skip unnecessary computations, addressing the noise issue in traditional SNNs.

Findings

Achieves higher classification accuracy than state-of-the-art SNNs.

Demonstrates significantly improved computational efficiency.

Effectively filters noise in spike train data.

Abstract

Spike train classification has recently become an important topic in the machine learning community, where each spike train is a binary event sequence with \emph{temporal-sparsity of signals of interest} and \emph{temporal-noise} properties. A promising model for it should follow the design principle of performing intensive computation only when signals of interest appear. So such tasks use mainly Spiking Neural Networks (SNNs) due to their consideration of temporal-sparsity of spike trains. However, the basic mechanism of SNNs ignore the temporal-noise issue, which makes them computationally expensive and thus high power consumption for analyzing spike trains on resource-constrained platforms. As an event-driven model, an SNN neuron makes a reaction given any input signals, making it difficult to quickly find signals of interest. In this paper, we introduce an event-attention mechanism that enables SNNs to dynamically highlight useful signals of the original spike trains. To this end, we propose SkipSNN, which extends existing SNN models by learning to mask out noise by skipping membrane potential updates and shortening the effective size of the computational graph. This process is analogous to how people choose to open and close their eyes to filter the information they see. We evaluate SkipSNN on various neuromorphic tasks and demonstrate that it achieves significantly better computational efficiency and classification accuracy than other state-of-the-art SNNs.