Stochastic synaptic dynamics under learning

TL;DR

This paper develops a probabilistic framework to analyze stochastic synaptic dynamics under learning, incorporating spike-time correlations to accurately predict memory capacity in neural networks.

Contribution

It introduces an analytical method that includes spike-time--resolving correlations, improving predictions of synaptic and memory dynamics over traditional rate-based models.

Findings

Accurately predicts memory capacity in sparse coding scenarios.

Shows spike-time correlations significantly affect synaptic plasticity.

Provides a microdynamical description linking microscopic synapse behavior to network-level memory performance.

Abstract

Learning is based on synaptic plasticity, which affects and is driven by neural activity. Because pre- and postsynaptic spiking activity is shaped by randomness, the synaptic weights follow a stochastic process, requiring a probabilistic framework to capture the noisy synaptic dynamics. We consider a paradigmatic supervised learning example: a presynaptic neural population impinging in a sequence of episodes on a recurrent network of integrate-and-fire neurons through synapses undergoing spike-timing-dependent plasticity (STDP) with additive potentiation and multiplicative depression. We first analytically compute the drift- and diffusion coefficients for a single synapse within a single episode (microscopic dynamics), mapping the true jump process to a Langevin and the associated Fokker-Planck equations. Leveraging new analytical tools, we include spike-time--resolving cross-correlations between pre- and postsynaptic spikes, which corrects substantial deviations seen in standard theories purely based on firing rates. We then apply this microdynamical description to the network setup in which hetero-associations are trained over one-shot episodes into a feed-forward matrix of STDP synapses connecting to neurons of the recurrent network (macroscopic dynamics). By mapping statistically distinct synaptic populations to instances of the single-synapse process above, we self-consistently determine the joint neural and synaptic dynamics and, ultimately, the time course of memory degradation and the memory capacity. We demonstrate that specifically in the relevant case of sparse coding, our theory can quantitatively capture memory capacities which are strongly overestimated if spike-time--resolving cross-correlations are ignored. [...]