A balanced memory network
Yasser Roudi, Peter E. Latham

TL;DR
This paper investigates how balanced excitation and inhibition in attractor neural networks can explain irregular firing patterns during working memory and determine the capacity for storing multiple memories, using mean field analysis and simulations.
Contribution
It provides a mean field framework for realistic attractor networks, explaining irregular firing and memory capacity scaling with excitatory connections.
Findings
Irregular firing requires large neuron involvement in a memory
Memory capacity scales with the number of excitatory connections
Theoretical predictions are validated with large spiking neuron simulations
Abstract
A fundamental problem in neuroscience is understanding how working memory -- the ability to store information at intermediate timescales, like 10s of seconds -- is implemented in realistic neuronal networks. The most likely candidate mechanism is the attractor network, and a great deal of effort has gone toward investigating it theoretically. Yet, despite almost a quarter century of intense work, attractor networks are not fully understood. In particular, there are still two unanswered questions. First, how is it that attractor networks exhibit irregular firing, as is observed experimentally during working memory tasks? And second, how many memories can be stored under biologically realistic conditions? Here we answer both questions by studying an attractor neural network in which inhibition and excitation balance each other. Using mean field analysis, we derive a three-variable…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Miyashita Y, Chang HS (1988) Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature 331:68–70.
- 2[2] Sakai K, Miyashita Y (1991) Neural organization for the long-term memory of paired associates. Nature 354:152–155.
- 3[3] Miyashita Y (1988) Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature 335:817–820.
- 4[4] Fuster JM, Alexander GE (1971) Neuron activity related to short-term memory. Science 173:652–654.
- 5[5] Kubota K, Niki H (1971) Prefrontal cortical unit activity and delayed alternation performance in monkeys. J Neurophysiol 34:337–347.
- 6[6] Funahashi S, Bruce CJ, Goldman-Rakic P (1989) Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. J Neurophysiol 61:331–349.
- 7[7] Miller EK, Erickson CA, Desimone R (1996) Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J Neurosci 16:5154–5167.
- 8[8] Rainer G, Asaad WF, Miller EK (1998) Memory fields of neurons in the primate prefrontal cortex. Proc Nat Acad Sci USA 95:15008–15013.
