Cortical computations via metastable activity

TL;DR

This paper reviews recent findings on metastable brain activity, highlighting its role in representing internal states and task variables through dynamic neural ensembles, shifting the perspective from trial-averaged to state-based coding.

Contribution

It synthesizes recent experimental and theoretical work on metastable neural dynamics, emphasizing their mechanistic origins and functional significance in cortical processing.

Findings

Metastable states are involved in internal representations like attention and decision-making.

Neural activity unfolds as sequences of discrete metastable states in response to stimuli and internally generated processes.

Theoretical models suggest mechanisms for the emergence of metastability in neural circuits.

Abstract

Metastable brain dynamics are characterized by abrupt, jump-like modulations so that the neural activity in single trials appears to unfold as a sequence of discrete, quasi-stationary states. Evidence that cortical neural activity unfolds as a sequence of metastable states is accumulating at fast pace. Metastable activity occurs both in response to an external stimulus and during ongoing, self-generated activity. These spontaneous metastable states are increasingly found to subserve internal representations that are not locked to external triggers, including states of deliberations, attention and expectation. Moreover, decoding stimuli or decisions via metastable states can be carried out trial-by-trial. Focusing on metastability will allow us to shift our perspective on neural coding from traditional concepts based on trial-averaging to models based on dynamic ensemble representations. Recent theoretical work has started to characterize the mechanistic origin and potential roles of metastable representations. In this article we review recent findings on metastable activity, how it may arise in biologically realistic models, and its potential role for representing internal states as well as relevant task variables.

Full text

Emails: giancarlo dot lacamera at stonybrook.edu, alfredo dot fontanini at stonybrook.edu,

luca dot mazzucato at uoregon dot edu

Highlights

• •

Metastable activity is increasingly being observed in many cortical areas and in a variety of tasks.

• •

Metastable activity is correlated with sensory and cognitive processes and may subserve state-dependent computations.

• •

Metastable activity can emerge spontaneously in spiking networks with clustered architecture.

• •

Metastable activity is a candidate neural substrate for coding both external events and internal representations.

1 Introduction

Brain circuits consist of large neural networks, where populations of neurons are recurrently coupled via synaptic connections. These circuits can be interpreted as dynamical systems with many coupled degrees of freedom and therefore capable of generating a wealth of dynamical behaviors on very diverse timescales bernacchia2011reservoir . Those include transient relaxations towards a point or line attractor, oscillatory patterns, chaotic dynamics or metastable activity rabinovich2006dynamical ; miller2016dynamical . These dynamical behaviors have been implicated in important brain functions. Transient relaxation to stable neural activity (such as a point or line attractor) may subserve memory Amit1997b ; seung1996brain and perceptual decisions mante2013context ; wang2002probabilistic . Oscillatory dynamics may subserve respiration, locomotion, and other rhythmic forms of behavior wang2010neurophysiological ; buzsaki2006rhythms . Chaotic dynamics amplify random perturbations and, when successfully tamed by learning, can generate complex computations sussillo2009generating ; laje2013robust . Metastable dynamics, initially characterized in the presence of a sensory stimulus Abeles1995a ; Jones2007 , might underlie a range of internal computations during cognitive tasks engel2016selective ; PonceAlvarez2012 ; maboudi2018uncovering ; rich2016decoding . Relaxations to an attractor, oscillations and chaotic dynamics typically describe neural activity as smoothly varying over time churchland2012neural ; mazor2005transient . In contrast, metastable dynamics are characterized by abrupt, jump-like modulations so that neural activity appears to unfold as a sequence of discrete, quasi-stationary “states.” Metastable activity is being found in an increasing number of brain structures of different species engaged in a variety of tasks, and is the focus of this opinion. The intuitive appeal of metastable activity is that it resonates with our intuition that our thoughts and actions proceed along a sequence of distinct episodes, as we scan alternatives and ponder potential options during everyday tasks. It is natural to think that such episodes are being represented in transient but well-defined neural patterns in our brains. Recent models have started to clarify how metastable activity could emerge spontaneously as a collective phenomenon via attractor dynamics in spiking networks LitwinKumarDoiron2012 ; DecoHugues2012 ; mazzucato2015dynamics ; schaub2015emergence . These models have proved powerful tools to investigate the circuit origin of metastable states and their potential role in sensory and cognitive processes. In this article we review recent progress in the analysis of metastable state sequences, focusing on issues of detection, modeling and interpretation.

2 Observing metastable activity

Metastable states were first characterized in electrophysiological recordings from the prefrontal cortex of monkeys performing a delayed localization task Abeles1995a ; Seidemann1996 ; gat1993statistical . Spike counts from simultaneously recorded neurons were analyzed with a hidden Markov model (HMM), a popular latent variable model for analyzing sequential data arising e.g. in time series analysis, speech recognition Rabiner1989 , DNA sequence analysis durbin1998biological , behavioral analysis wiltschko2015mapping , and many other problems zucchini2016hidden ; dymarski2011hidden . Under the most common application of HMM to neural data, population activity from simultaneously recorded neurons unfolds through a sequence of “hidden” states, each state being a set of ensemble firing rates (Fig. 1). Stochastic transitions between states occur at random times according to an underlying Markov chain, and neurons discharge as Poisson processes with state-dependent firing rates, though the model can be extended to include refractory periods and other history-dependent factors Escola2011 . The number of hidden states may be selected using information criteria PonceAlvarez2012 ; sadacca2016behavioral ; mazzucato2019expectation , cross-validation engel2016selective , or nonparametric Bayesian methods linderman2016bayesian ; taghia2018uncovering . Several measures have been used to assess the goodness-of-fit of inferred sequences, including variance explained engel2016selective , comparison to shuffled datasets maboudi2018uncovering , and comparison of single-neuron transitions to ensemble state transition mazzucato2015dynamics . The strength of HMM is to allow a principled, unsupervised method for segmenting neural activity into a sequence of discrete metastable states, and its use has led to intriguing new observations in ensemble dynamics, as we discuss next.

2.1 Consistent features of metastable activity

HMM and related procedures for detecting hidden states have established a number of consistent features across datasets, animals and tasks. Ensemble activity unfolds as a sequence of metastable states, each lasting from a few hundred ms to a second or more, with sharp transitions among the states Abeles1995a ; Jones2007 ; PonceAlvarez2012 ; mazzucato2015dynamics (Fig. 1b). The transitions are typically one order of magnitude faster than the state durations, are close to their theoretically observable lower bound, and are not an artifact of the HMM Abeles1995a ; Jones2007 ; PonceAlvarez2012 . When the start of the sequence is aligned to an external event such as stimulus onset, specific state sequences are observed (Fig. 1b), raising the possibility that stimuli are coded by dynamic state sequences Abeles1995a ; Jones2007 . Among the most significant early results of applying HMM to the analysis of neural data were the demonstration that (i) the hidden states identified in response to a stimulus tend to recur during most of the recorded activity, not just in response to the stimulus, and (ii) pairwise correlations among simultaneously recorded neurons depend on an underlying global activity state, and not just on neural connectivity Abeles1995a ; Seidemann1996 . These two observations are very relevant for current issues in neuroscience, including the origin and role of ongoing activity stringer2019spontaneous ; orban2016neural , the importance of the connectome swanson2016cajal ; bargmann2012beyond , and the meaning of correlations ostojic2009connectivity ; doiron2016mechanics ; rosenbaum2014correlated . It’s worth remarking that the ability of HMM analysis to segment the neural activity into distinct states in an unsupervised manner – i.e., without knowledge of external triggers such as stimulus timings, – has been crucial to obtaining the results reviewed above. It is also important to point out that the HMM analysis on ensemble data allows to decode the neural activity on a trial-by-trial basis, avoiding the necessity of averaging across trials. Most findings discussed in this review would go undetected if data were averaged across trials, because ensemble transitions occur at different times in each trial. This latter feature also allows the time-warping of state sequences, explaining why, for example, the method is so useful for speech recognition and for the analysis of neural activity during birdsongs florian2011hidden . This could also explain part of the trial-to-trial variability observed in cortex after aligning spike trains across different trials to e.g.. stimulus onset Jones2007 .

2.2 Metastability of ongoing cortical activity

One central question in contemporary neuroscience is why ongoing cortical activity is so rich in structure and resembles so closely stimulus-evoked activity stringer2019spontaneous ; orban2016neural ; Arieli1996 ; Kenet2003 ; DecoJirsa2012 ; Luczak2009 ; Tsodyks1999 ; ringach2009spontaneous . The origin of ongoing activity and the nature of its interaction with evoked activity can potentially reveal much about the way cortical networks are functionally organized and how this may support flexible coding (see stringer2019spontaneous ; orban2016neural for two recent proposals). However, quantifying precisely the similarities and differences between ongoing and evoked activity has proved difficult. A recent HMM analysis of ongoing spiking activity in the gustatory cortex of behaving rats has demonstrated that ongoing activity, similarly to evoked activity, unfolds as a sequence of metastable states mazzucato2015dynamics . Transitions among states are characterized by a partial degree of coordination, so that ongoing activity is neither completely asynchronous nor completely synchronized. Ongoing and stimulus-evoked activity share most of the same states, although some of the states occur mostly during ongoing activity and others during evoked activity mazzucato2019expectation . About $50\%$ of the ensemble neurons exhibit three or more different firing rates across states, i.e., they are “multi-stable” rather than bistable; and this fraction is substantially reduced by stimulation mazzucato2015dynamics . These findings have all been captured by a spiking network model of metastability that might shed light into the link between ongoing and evoked activity (see section Spiking network models of metastable activity).

2.3 Metastable sequences as a substrate for internal computations

Do metastable states have precise and specific meanings as neural correlates of external or internally generated events? Visual Abeles1995a , gustatory Jones2007 ; mazzucato2015dynamics and vibro-tactile stimuli PonceAlvarez2012 seem represented by reliable sequences of HMM states in primate and rodent cortical areas in the context of different tasks. Even more remarkably, though, aspects of the metastable dynamics seem to subserve internal states of attention, expectation, and internal deliberations during decisions, and can be used to predict behavior. In monkeys performing a selective attention task, the probability of detecting a change in the attended stimulus was significantly greater when occurring during an “ON” state (characterized by vigorous multi-unit activity in area V4) than during an “OFF” state (characterized by faint multi-unit activity) engel2016selective (Fig. 2a). Similarly, different hidden states were preferentially associated to different task conditions in a human working memory task, with occupancy rate in each state predicting better performance in the corresponding task taghia2018uncovering . Moreover, changes in patterns of functional connectivity across many brain areas co-occurred more reliably with state transitions than with external triggers, suggesting that metastable states supported by flexible patterns of functional connectivity may reflect internal representations of task demands.

A similar relationship between state occupancy rate and decisions has been found in monkeys performing a choice task between differentially rewarded stimuli rich2016decoding . Ensemble activity in orbitofrontal cortex (OFC) mostly switched between two states representing the values of the stimuli currently being offered, with larger occupancy rate predicting the behavioral decision (Fig. 2b, left). Intriguingly, slower decisions (reflecting longer internal deliberation) occurred when the states had similar occupancy rates and were found on trials of the same kind (thus reflecting subjective preferences rather than actual task difficulty; Fig. 2b, right). These findings are reminiscent of those on dynamic changes of mind kiani2014dynamics and complement earlier intriguing results on the possible meaning of state transitions, which may underlie the sudden realization that task rules have changed Durstewitz2010 or reflect the difficulty of a vibro-tactile discrimination PonceAlvarez2012 . In the rat hippocampus, HMM states were recently found to represent the position in a linear track and in an open field during a navigation task maboudi2018uncovering (Fig. 2c), an alternative view to decoding spatial maps based on single neurons place fields moser2017spatial . The state sequences were observed in area CA1 during hippocampal sharp wave ripples when the animal was not exploring the track, and could be used to infer a spatial map of the environment without any reference to external locations maboudi2018uncovering . In rat gustatory cortex, state sequences after stimulus delivery proceed faster when the delivery is expected compared to when it is not expected mazzucato2019expectation , which may explain the faster decoding of expected stimuli found in this area samuelsen2012effects (a spiking network model explanation of this phenomenon is discussed in the next section). The examples discussed in this subsection make a convincing case that metastable sequences underlie a variety of important cognitive processes, and more examples will likely be found across different cognitive domains not yet explored with latent state models.

3 Spiking network models of metastable activity

In addition to statistical descriptions in terms of HMM and related latent state models, mechanistic accounts of metastable activity based on biologically plausible networks of spiking neurons have also been given. We shall mostly focus on efforts that have purposefully combined spiking network modeling with HMM mazzucato2015dynamics ; mazzucato2019expectation ; mazzucato2016stimuli ; MillerKatz2010 , as we believe that such an approach is the most promising to understand the potential origin and function of metastable activity in neural circuits. Metastable activity naturally occurs when multiple hidden states are attractive fixed points of the neural dynamics which are either inherently unstable, or can be destabilized by internal noise or external perturbations miller2011stochastic ; miller2016itinerancy ; phillips2017cortical . Such fixed points would attract the dynamic trajectories of the neural activity and force them to linger in their neighborhood for a finite amount of time. It is natural, therefore, to look for models wherein metastability is caused by the coexistence of multiple attractor states.

3.1 Metastable activity in clustered networks of spiking neurons

Among the class of attractor neural networks with multiple attractor states, spiking network models allow to build biologically plausible models capable of generating metastable state sequences. Recurrent networks with strong synaptic connections can produce highly temporally fluctuating activity sompolinsky1988chaos ; rajan2010stimulus ; ostojic2014two ; huang2017once ; harish2015asynchronous ; mastrogiuseppe2017intrinsically ; kadmon2015transition ; wieland2015slow , often the signature of chaotic activity. However, to endow a network of spiking neurons with endogenously generated metastable states, a specific partition of the network in subpopulations of neurons seems required

LitwinKumarDoiron2012 ; DecoHugues2012 ; mazzucato2015dynamics ; schaub2015emergence . The clustered architecture has emerged as an effective way to generate metastability. The models studied so far comprise excitatory and inhibitory spiking neurons with (typically) the excitatory neurons organized in clusters, as seems the case in cortical circuits song2005highly ; perin2011synaptic ; kiani2015natural . The common feature of these models is that the average synaptic strength (and/or connectivity) inside clusters is larger than between clusters (Fig. 3a, right). A mean field analysis of these models Amit1997b ; mazzucato2015dynamics ; mazzucato2016stimuli shows that multiple attractor states are possible depending on the average intra-cluster synaptic weight (ICW; Fig. 3b). Above a critical ICW value (dashed green line in Fig. 3b), multiple configurations of the network emerge wherein neurons in clusters tend to occupy several states with different values of mean firing rates (grey and red lines in Fig. 3b), where the firing rates depend on the number of active clusters. In an infinite network, those configurations would be stable attractors; but in a finite network, or in the presence of sufficient external noise, those configurations become metastable. Note that if the ICW is large enough (e.g., full green line in Fig. 3b), the configuration with no active clusters is unstable even in the infinite network, and at least one cluster must be active at any given time. It is unclear whether suitable connectivity patterns exist such that metastable itinerant dynamics is possible also in a deterministic network of infinite size doiron2014balanced . In the following, we assume that fluctuations originate in finite size effects in a deterministic network LitwinKumarDoiron2012 ; mazzucato2015dynamics , and later consider alternative models (see subsection Variations on the clustered architecture). In finite clustered networks above the critical ICW value, a combination of erratic spiking activity and recurrent inhibition can ignite an itinerant exploration of multiple configurations (as in Fig. 3a, right), whose number and features depend on network parameters such as the ICW. When an HMM analysis is run on these networks, segmentation of the spontaneous ongoing activity in discrete states is found (Fig. 3c). Such metastable activity is modified, but not removed, by an external stimulus. Since the firing rates depend on the number of active clusters, the neurons exhibit multiple firing rates across different HMM states, as found experimentally in rat gustatory cortex mazzucato2015dynamics . Note that the neurons themselves can have graded activity, hence their multistability is an emergent property of the collective network’s dynamics and not an intrinsic property of the units.

3.2 Predictions of the clustered spiking network

Clustered spiking networks capture many statistical and dynamical features of the data, including a stimulus-induced reduction of: (i) trial-to-trial variability LitwinKumarDoiron2012 ; DecoHugues2012 ; Churchland2010 , (ii) multistability of the firing rates across states mazzucato2015dynamics , and (iii) neural dimensionality mazzucato2016stimuli , i.e., the minimal number of effective dimensions (between 1 and the number of neurons) necessary to describe the ensemble dynamics rajan2010stimulus ; williamson2016scaling ; gao2017theory . It is worth noticing that while the stimulus-driven reduction of trial-to-trial variability has been a catalyst for the development of the clustered network model LitwinKumarDoiron2012 ; DecoHugues2012 , the reduction of multistability and dimensionality were found to be natural emergent properties of the model which led to finding the corresponding properties in the data. These predictions capture aspects of the data and thus help to corroborate the validity of the model. However, two other recent predictions link metastability directly with sensory and cognitive functions. The first is that visiting metastable states during ongoing activity will help to maintain learned stimulus responses and improve performance, suggesting yet another role for ongoing activity. This prediction emerged from an attempt to understand how neural clusters and metastable states can emerge during learning, and revealed the need to complement synaptic plasticity with homeostatic mechanisms ocker2015self ; LitwinKumarDoiron2014 ; zenke2015diverse . The second prediction has led to the proposal that a state of expectation could be understood as an acceleration of metastable dynamics mazzucato2019expectation . When rats are trained to respond to taste stimuli, the identity of the stimuli can be decoded faster from the neural activity if stimulus delivery is expected compared to when stimuli are randomly, and passively, administered samuelsen2012effects . In the model, the onset of a predictive cue modifies the network’s landscape of metastable configurations so as to make state transitions more frequent. Faster state transitions, in turn, induce faster onset of stimulus-coding states after stimulus delivery, an effect uncovered by an HMM analysis of the model and confirmed in the data.

3.3 Variations on the clustered architecture

Variations of the clustered network architecture and its generated dynamics can explain related kinds of metastable activity such as perceptual bistability moreno2007noise ; cao2016collective , the emergence of specific slow oscillations known as “up” and “down” states setareh2017cortical , or networks that can sustain bidirectional sequence propagation at slow and tunable speed setareh2018excitable . These types of metastable dynamics are different from those reviewed earlier in subtle, but significant, ways. Clustered spiking networks have also been used to uncover subtle differences between mechanisms for decision making. Specifically, spiking networks with multiple attractors built for decision making wang2002probabilistic ; wang2008decision can work in two different modes, the “ramping” mode, characterized by gradual stimulus-driven firing rate increases, and the “jumping” mode miller2011stochastic ; miller2016itinerancy , wherein the stimulus ignites a sequence of metastable states. By leveraging a mechanism reminiscent of stochastic resonance, the jumping mode can outperform the ramping mode (underlying the so-called “integration-to-bound” models bogacz2006physics ) during perceptual decision-making in the face of sensory noise. Finally, we briefly mention that models with endogenously generated activity are not necessary to produce metastable activity. External fluctuations or the presence of firing rate adaptation both can create instability and lead to metastability in a finite network with multiple attractors Giugliano2008 ; russo2012cortical (including “up” and “down” states at low firing rate, jercog2017up ), and sometimes both ingredients are required to reproduce the statistics of the empirical data shpiro2009balance ; jercog2017up . Also, it is possible to obtain stimulus-evoked quenching of variability in non-metastable networks, such as networks with chaotic attractors sompolinsky1988chaos ; rajan2010stimulus ; crisanti2018path or the supralinear stabilized network (SSN) rubin2015stabilized ; ahmadian2013analysis . These models capture the reduction in variability via different mechanisms and make different predictions; for example, the SSN can capture the tuning-dependent modulation of variability observed in primary visual cortex hennequin2018dynamical .

4 Conclusions

We have reviewed recent progress made in elucidating the nature and the role of metastable states in brain function. Thanks to the availability of ensemble data from behaving animals, the study of metastable activity is changing the way we think about neural coding for both external events and internal representations. We have also reviewed a class of spiking network models that promise to provide a mechanistic understanding of the origin and function of metastability. These models have demonstrated the importance of a clustered architecture for the spontaneous generation of metastability, the coexistence of ongoing and evoked metastability, the benefits of metastable sequences to decision making, and the explanation of faster coding of expected events via the acceleration of metastable dynamics. Because of their biological plausibility, not only can these models shed light on the mechanisms, but they can also be powerful tools for analyzing metastable states, predict causal relationships to behavior, and help to design new experimental studies. In the future, it will be important to establish a causal relationship between metastable states and behavior, by manipulating neural activity during behavioral tasks while recording large ensembles across multiple sites. It will also be important to establish the emergence of neural clusters and metastable dynamics though development or learning. Recurrent spiking network models, in conjunction with latent-state models such as HMM, are likely to play an important role in his endeavor.

Conflict of interest statement

The authors declare no conflict of interest.

Acknowledgments

The authors acknowledge support from the NSF (grant IIS-1161852 to GLC), the NIH (NIH/NIDCD R01DC015234 to AF and NIH/NIDCD K25DC013557 to LM) and the Swartz Foundation (Award 66438 to LM) during the development of some of the ideas and concepts discussed in this article.

References and recommended reading

Papers of particular interest, published within the period of review, have been highlighted as:

$\bullet$ of special interest

$\bullet\bullet$ of outstanding interest

$\bullet\bullet$ LitwinKumarDoiron2012 (Litwin-Kumar and Doiron, 2012) This theoretical work demonstrated that a balanced spiking network with clustered architecture can generate slow metastable activity via internally generated fluctuations.

$\bullet\bullet$ mazzucato2015dynamics (Mazzucato et al, 2015) This study demonstrates that ongoing activity in rat gustatory cortex unfolds as a sequence of metastable states that is compatible with the dynamics of a clustered spiking network model. The model predicts key features of both ongoing and evoked activity, including a stimulus-induced reduction of multistability in single neurons.

$\bullet\bullet$ schaub2015emergence (Schaub et al, 2015) This paper presents the link between metatable activity and the eigenvalue spectrum of the synaptic matrix in a clustered spiking network. When the model is augmented with a hierarchical architecture, transitions among metatable states at higher level in the hierarchy occur on slower timescales than transitions among the states at lower level of the hierarchy.

$\bullet\bullet$ rich2016decoding (Rich and Wallis, 2016) In the OFC of monkeys, periods of deliberation during a choice task were associated with sequences of states representing the values (rewards) associated to the options being offered in the current choice. The longer the presence of one state compared to the others, the quicker the behavioral decision, regardless of the presumed difficulty of the choice according to the similarity in values. It is also shown that ensembles of OFC neurons, unlike single neurons, can represent the value of unchosen options.

$\bullet\bullet$ engel2016selective (Engel et al, 2016) In area V4 of behaving monkeys, ON and OFF metastable states are related to global changes in cortical state (associated with arousal) as well as local selective attention demands, with better performance when a stimulus change occurred during ON states compared to OFF states.

$\bullet\bullet$ maboudi2018uncovering (Maboudi et al, 2018) Spontaneous metastable states observed in CA1 during population burst events (when the animal is idling) reconstruct a map of place fields evoked during locomotion.

$\bullet\bullet$ taghia2018uncovering (Taghia et al, 2018) An HMM analysis of fMRI data in 122 human subjects performing a working memory task with multiple task conditions reveals the existence of metastable states preferentially associated to different task conditions. The hidden states are, in turn, associated to different patterns of functional connectivity across many brain areas.

$\bullet\bullet$ mazzucato2019expectation (Mazzucato et al, 2019) This paper shows that expectation induces faster coding of taste stimuli in rat gustatory cortex by modulating the timescale of ensemble metastable dynamics. A spiking network model explains the phenomenon in terms of decreased energy barriers between metastable configurations of the network?s activity. Shallower barriers cause faster transitions to stimulus-coding states identified with an HMM analysis, accelerating stimulus coding.