Dynamic Mean Field Theories for Nonlinear Noise in Recurrent Neuronal Networks
Shoshana Chipman, Brent Doiron

TL;DR
This paper develops a new mean-field theory for recurrent neural networks that accurately models nonlinear noise effects, capturing complex dynamics like transients and bifurcations, especially under strong fluctuations.
Contribution
It introduces a Gaussian-equivalent process and a lognormal moment closure to derive a closed-form mean-field theory for nonlinear noise in neural circuits, improving analysis of complex phenomena.
Findings
Accurately models order-one transients and fixed points.
Captures noise-induced shifts in bifurcation structure.
Outperforms standard linearization in strong-fluctuation regimes.
Abstract
Strong, correlated noise in recurrent neural circuits often passes through nonlinear transfer functions, complicating dynamical mean-field analyses of complex phenomena such as transients and bifurcations. We introduce a method that replaces nonlinear functions of Ornstein-Uhlenbeck (OU) noise with a Gaussian-equivalent process matched in mean and covariance, and combine this with a lognormal moment closure for expansive nonlinearities to derive a closed dynamical mean-field theory for recurrent neuronal networks. The resulting theory captures order-one transients, fixed points, and noise-induced shifts of bifurcation structure, and outperforms standard linearization-based approximations in the strong-fluctuation regime. More broadly, the approach applies whenever dynamics depend smoothly on OU processes via nonlinear transformations, offering a tractable route to noise-dependent phase…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural dynamics and brain function · stochastic dynamics and bifurcation · Neural Networks and Reservoir Computing
