Multi-Sample Online Learning for Spiking Neural Networks based on Generalized Expectation Maximization

TL;DR

This paper introduces a multi-sample online learning method for Spiking Neural Networks using generalized expectation-maximization, improving training accuracy and calibration by leveraging multiple independent spiking signals.

Contribution

It proposes a novel multi-compartment sampling approach with GEM-based optimization for more accurate log-likelihood estimation in SNN training.

Findings

Significant improvements in log-likelihood and accuracy.

Enhanced calibration of SNN models.

Effective use of multiple compartments for training and inference.

Abstract

Spiking Neural Networks (SNNs) offer a novel computational paradigm that captures some of the efficiency of biological brains by processing through binary neural dynamic activations. Probabilistic SNN models are typically trained to maximize the likelihood of the desired outputs by using unbiased estimates of the log-likelihood gradients. While prior work used single-sample estimators obtained from a single run of the network, this paper proposes to leverage multiple compartments that sample independent spiking signals while sharing synaptic weights. The key idea is to use these signals to obtain more accurate statistical estimates of the log-likelihood training criterion, as well as of its gradient. The approach is based on generalized expectation-maximization (GEM), which optimizes a tighter approximation of the log-likelihood using importance sampling. The derived online learning algorithm implements a three-factor rule with global per-compartment learning signals. Experimental results on a classification task on the neuromorphic MNIST-DVS data set demonstrate significant improvements in terms of log-likelihood, accuracy, and calibration when increasing the number of compartments used for training and inference.