Slow and Fast Neurons Cooperate in Contextual Working Memory through Timescale Diversity
Tomoki Kurikawa

TL;DR
This paper demonstrates how neurons with diverse intrinsic timescales in the frontal cortex work together to enhance working memory performance, with slow neurons maintaining information and fast neurons encoding inputs.
Contribution
It introduces a recurrent neural network model with units of different timescales, revealing their distinct roles in contextual working memory tasks.
Findings
Slow neurons support memory retention despite weak input encoding.
Fast neurons provide transient, strong input encoding.
Balanced timescale diversity optimizes task performance.
Abstract
Neural systems process information across a broad range of intrinsic timescales, both within and across cortical areas. While such diversity is a hallmark of biological networks, its computational role in nonlinear information processing remains elusive. In this study, we examine how heterogeneity in intrinsic neural timescales within the frontal cortex - a region central to cognitive control - enhances performance in a context-dependent working memory task. We develop a recurrent neural network (RNN) composed of units with distinct time constants to model a delayed match-to-sample task with contextual cues. This task demands nonlinear integration of temporally dispersed inputs and flexible behavioral adaptation. Our analysis shows that task performance is optimized when fast and slow timescales are appropriately balanced. Intriguingly, slow neurons, despite weaker encoding of…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural dynamics and brain function · Neural Networks and Reservoir Computing · Ferroelectric and Negative Capacitance Devices
