Functional importance of noise in neuronal information processing

TL;DR

This paper reviews how noise influences neuronal information processing, highlighting stochastic resonance as a beneficial mechanism and discussing recent biophysical model research and future directions.

Contribution

It provides a comprehensive review of neuronal stochastic resonance, emphasizing its functional role and recent advances in biophysical modeling and regulation mechanisms.

Findings

Noise can enhance weak signal detection via stochastic resonance

Recent models elucidate mechanisms of neuronal stochastic resonance

Open questions highlight future research directions

Abstract

Noise is an inherent part of neuronal dynamics, and thus of the brain. It can be observed in neuronal activity at different spatiotemporal scales, including in neuronal membrane potentials, local field potentials, electroencephalography, and magnetoencephalography. A central research topic in contemporary neuroscience is to elucidate the functional role of noise in neuronal information processing. Experimental studies have shown that a suitable level of noise may enhance the detection of weak neuronal signals by means of stochastic resonance. In response, theoretical research, based on the theory of stochastic processes, nonlinear dynamics, and statistical physics, has made great strides in elucidating the mechanism and the many benefits of stochastic resonance in neuronal systems. In this perspective, we review recent research dedicated to neuronal stochastic resonance in biophysical mathematical models. We also explore the regulation of neuronal stochastic resonance, and we outline important open questions and directions for future research. A deeper understanding of neuronal stochastic resonance may afford us new insights into the highly impressive information processing in the brain.

Figures

Equations

$$\begin{array}{r}C\frac{dV}{dt}=-I_{\text{Na}}-I_{\text{K}}-I_{\text{L}}+I_{\text{driving}}+I_{\text{noise}},\end{array}$$

$$\begin{array}{r}\frac{dx}{dt}={\alpha }_x(V)(1-x)-{\beta }_x(V)x,\end{array}$$

$$\begin{array}{r}\frac{dx}{dt}={\alpha }_x(V)(1-x)-{\beta }_x(V)x+{\xi }_x(t),\end{array}$$

$$\begin{array}{r}\text{SNR}=\frac{S(f_s)-N(f_s)}{N(f_s)},\end{array}$$

$$\begin{array}{r}Q=\sqrt{Q_{\text{sin}}^2+Q_{\text{cos}}^2},\end{array}$$

Full text

Nonlinear dynamics and chaos Neuroscience Cell processes

1 Introduction

The human brain is composed of nearly 100 billion neurons that conduct signals via synapses [1]. The massive number of neurons is believed to be the fundament behind the computational power of the brain, which integrates and generates neuronal information in the form of action potentials, or so-called spikes [1, 2]. Deeply understanding the mechanisms of signal processing amongst neurons promises to unlock the secrets behind the computational principles of the real brain.

Neuronal activity recorded in electrophysiological studies typically exhibits a certain level of stochastic fluctuations [3, 4]. This stochastic feature can be observed even when our brain is at rest, suggesting that biological neurons might operate in noisy environments. To date, many types of noise sources have been identified in the brain, such as thermal noise [5], ion channel noise [6, 8, 7, 9, 10], synaptic release noise [11, 12, 13, 14, 15, 16], and synaptic bombardment noise [18, 19, 17, 20]. Among them, the stochastic opening and closing of ion channels and massive amounts of synaptic bombardment are thought to be two main noise sources in neural systems. Because the firing dynamics of neurons can be largely impacted and disrupted by a stochastic drive, a natural question arises regarding whether neuronal noise always acts as a destructor in the brain. However, accumulating evidence has indicated that neuronal noise might promote signal processing of neurons under proper conditions [4, 21, 22, 23, 24].

Perhaps the most prominent noise-induced counterintuitive behavior discovered in the past 40 years is stochastic resonance (SR) [25, 26, 27, 28, 29]. By definition, SR initially refers to a nonlinear system driven by a periodic signal showing the maximal information transmission at an intermediate noise level [25, 26, 27, 28, 29]. Neurons in the brain are not only driven by stochastic fluctuations from various noise sources but also receive rhythmic signals due to neuronal oscillations [1, 2]. Furthermore, biological neurons exhibit different types of firing excitability and show highly nonlinear responses to external stimuli [30]. These features enable the SR to serve as an underlying dynamical mechanism that real neurons utilize to improve information processing, an idea supported by increasing experimental data. For instance, Douglass et al. showed that appreciable level of external noise can enhance the information transfer in mechanoreceptive sensory neurons of crayfish, indicating the occurrence of SR in neural systems [31]. Similar neuronal SR phenomena have been widely observed in sensory systems of other species, such as crickets [32], rats [33] and paddlefish [34]. Later investigations have also demonstrated SR in neurons from the mammalian brain [35, 36].

Recent studies using computational modeling have provided more evidence of the benefits of SR occurring in neural systems [23, 24]. Specifically, it has been demonstrated that different types of SR may arise in neural systems and can be regulated by several intrinsic and external properties. In this mini review, we briefly summarize and discuss computational results on the functional roles of noise in enhancing neuronal information processing via SR-related mechanisms and propose several urgent questions in this research field.

2 Models and measurements for neuronal SR studies

Classical neuronal SR studies focus on a neuron driven by both a subthreshold periodic signal and stochastic noise (Fig. 1(a)) [37, 38, 39]. As a paradigmatic model, the Hodgkin-Huxley (HH) neuron has served as the preferred model for simulating neuronal dynamics [2, 40]. In classical neuronal SR studies, the current balance equation of the HH neuron can be written as:

[TABLE]

where $V$ represents the membrane potential and $C$ is the membrane capacitance per unit area. The sodium, potassium, and leakage currents through the membrane are modeled as $I_{\text{Na}}=G_{\text{Na}}m^{3}h(V-E_{\text{Na}})$, $I_{\text{K}}=G_{\text{K}}n^{4}(V-E_{\text{K}})$ and $I_{\text{L}}=G_{\text{L}}(V-E_{\text{L}})$, respectively. The model parameters $G_{\text{Na}}$, $G_{\text{K}}$ and $G_{\text{L}}$ are the maximal sodium, potassium, and leakage conductances per unit area, and $E_{\text{Na}}$, $E_{\text{K}}$ and $E_{\text{L}}$ denote the corresponding reversal potentials. Three gating variables obey the following Langevin equation [2, 40]:

[TABLE]

where $x=m,h,n$, and $\alpha_{x}(V)$ and $\beta_{x}(V)$ are six voltage-dependent rate functions given in [2, 40]. The subthreshold periodic driving can be mimicked by a sinusoidal signal, $I_{\text{driving}}=A\sin(2\pi f_{s}t)$, with $A$ and $f_{s}$ representing signal amplitude and forcing frequency, respectively. The noise current is typically modeled as $I_{\text{noise}}=I_{0}+\sqrt{D}\xi(t)$, where $I_{0}$ denotes the bias current, $\xi(t)$ is the Gaussian white noise with zero mean and unit variance, and $D$ is a parameter controlling the noise intensity. To a certain extent, this type of noise current can be used to simulate membrane fluctuations due to massive synaptic bombardment [18, 19, 20]. Note that, as another important type of neuronal noise, the ion channel noise can be modeled by adding stochastic terms in the Langevin equations for gating variables [8, 9, 10]:

[TABLE]

where $\xi_{x}(t)$ ($x=m,h,n$ ) are independent Gaussian white noises with zero mean. For different gating variables, the noise autocorrelation functions depend on the stochastic membrane potential and the total number of ion channels controlled by both the densities of ion channels and the area of the membrane patch, which has been described in previous modeling studies in detail [8, 9, 10].

The information transfer capability for neurons driven by external periodic inputs can be quantified by several measurements. Similar to SR in other dynamical systems, the most frequently used measure is the signal-to-noise ratio (SNR) at the input frequency $f_{s}$ [24]. To compute the SNR, the power spectral density of the spike train is estimated using a fast Fourier transform. Mathematically, the SNR is defined as [38, 20]:

[TABLE]

where $S(f_{s})$ is the power at the input frequency $f_{s}$, and $N(f_{s})$ is the mean background power at nearby frequencies. As a signature of neuronal SR, it can be seen that the SNR curve exhibits a bell-shaped profile with increasing noise intensity (Fig. 1(b)). On the other hand, the second measure widely employed in neuronal SR studies is the Fourier coefficient [41, 42]. This measurement has been confirmed to be proportional to the square of the spectral power amplification and can be calculated as [43]:

[TABLE]

where $Q_{\text{sin}}=\frac{1}{nT}\int_{0}^{nT}2V(t)\sin(2\pi t/T)dt$ and $Q_{\text{cos}}=\frac{1}{nT}\int_{0}^{nT}2V(t)\cos(2\pi t/T)dt$. Here, $T=1/f_{s}$ is the period of the external driving signal, and $n$ is a positive integer related to the simulation time. Similar to SNR, a larger $Q$ value implies a better information transfer capability. When SR behavior occurs in neural systems, a peak value can be seen in the $Q$ curve as a function of noise intensity. Note that several other measurements, such as power norms [44, 45, 46] and information-based measures [47, 48, 49], can also be used to characterize the performance of SR.

3 Stochastic resonance in neural systems

Computational models offer an efficient approach to investigate neuronal SR. Following experimental observations, recent theoretical explorations have suggested that distinct types of SR may be evoked in neural systems under different circumstances. In this section, we briefly summarize several typical neuronal SR behaviors observed in modeling studies.

As described above, the classical neuronal SR framework mainly considers a neuron or a population of neurons driven by both stochastic noise and the subthreshold periodic force with a single frequency component [37, 38, 39]. By computational modeling, the classical SR has been demonstrated to appear in spiking model neurons with either threshold-spiking or resonance-spiking mechanisms [38, 20, 26, 50]. These two generation mechanisms of spikes involve firing dynamics for most biological neurons and correspond to class I and II neuronal excitability [30], respectively. As shown in Fig. 1(b), the performance of classical neuronal SR is impacted by the amplitude of the external periodic signal. A relatively stronger subthreshold periodic driving signal tends to evoke a higher peak SNR. Furthermore, this amplitude-based neuronal SR is also modulated by the input frequency of the external driving signal (Fig. 1(c)). It has been found that neurons show optimal responses to the external periodic signal at a special frequency range, implying the existence of frequency sensitivity. Similar neuronal frequency sensitivity has been widely reported in past experimental and computational studies [20, 51, 52, 53], which can be attributed to the cooperation of the intrinsic neuronal oscillations and the periodic input signals. This observation is of particular interest because oscillatory signals in the brain cover multiple frequency bands [1], and neurons with different intrinsic spiking dynamics might preferentially process weak neural information with distinct frequency bands via SR mechanism (see Fig. 1(c)).

On the other hand, biological neurons may simultaneously receive more complicated oscillatory signals from different brain regions with mixed-frequency features. Thus, a naturally arising question is whether similar SR phenomena can also be discovered in neural systems with multiple periodic input components. As pioneers in this field, Chialvo et al. confirmed that a single neuron driven by mixed periodic signals with harmonic frequencies of a fundamental frequency showed the maximal response to the fundamental frequency at an intermediate noise level [54, 55, 56]. They labeled this seemingly SR-like effect as the “ghost SR” (GSR), implying that it appears at the fundamental frequency missing in the input signals [54, 55, 56]. Recently, we extended the theory of ghost SR by investigating the response of neural systems to two subthreshold periodic signals with an arbitrary difference in frequency (Fig. 2(a)) [57]. Through computational modeling, we demonstrated that SR might occur at the beat frequency in neural systems at both the single-neuron and population levels (Fig. 2(b)). Similarly to the classical SR in neural systems [51, 52, 53], the performance of this frequency-difference-dependent SR exhibits a frequency sensitivity feature, and a smaller beat frequency corresponds to a stronger SNR at the optimal noise level (Figs. 2(c) and 2(d)). Furthermore, our simulations indicated that the population response of neural ensembles is more efficient than that of a single neuron to detect neural information carried by the superposition of multiple periodic signals at the beat frequency. These results highlight the functional roles of stochastic noise in enhancing the signal transduction for beat-frequency-related neural information and may have important biological applications.

Although neuronal SR studies have commonly assumed weak periodic external forces, it should be noted that the SR-type behaviors in neural systems are not limited to signals with periodic components and signals below the threshold level (Fig. 3(a)). Using a variety of spiking model neurons, Collins et al. developed a theory that the SR effect can be detected with the correlation-based power norm when a neuron is subjected to weak aperiodic signals and white noise (Fig. 3(b)) [44, 45, 46]. Inspired by the aperiodic property of the external driving signal, this phenomenon was designated as aperiodic SR [44, 45, 46]. Compared with a single neuron, the detection capability of a weak signal via aperiodic SR can be further improved in a summing network consisting of a population of neurons. This theoretical prediction has been demonstrated by well-designed biological experiments, showing that aperiodic SR indeed exists in mammalian sensory neurons [46]. Using information-based measurements, numerical simulations have shown that SR-type behavior can also be observed in a summing neuronal network even when the external driving signal is sufficiently strong and above the threshold of neurons (Fig. 3(c)) [47, 48, 49]. However, the bell-shaped measurement curve disappears for a single neuron (see $N=1$ in Fig. 3(c)), indicating that the suprathreshold neuronal SR may be only observed at the population level. Further experiments need to be designed and performed to verify whether suprathreshold SR indeed exists in the real brain.

We emphasize that many other types of SR-related behaviors may also occur in neural systems, and several of them are described as follows. First, although previous modeling studies have shown that neurons operating as coincidence detectors (class III excitability) may not show classical SR behaviors, this type of neuron has been identified as sensitive to changes in the stimulus [58]. In the presence of noise, this dynamic feature causes class III neurons to exhibit slope-based SR behavior, a phenomenon supported by both experimental and computational evidence [58, 59]. Second, even without an external driving signal, neurons perturbed solely by noise may also display so-called internal or autonomous SR behavior [60]. This phenomenon is highly associated with coherence resonance in excitable systems [61], and a noise-induced peak can be seen clearly in the power spectrum. As the noise intensity is increased, the SNR value first drops and then rises, and the internal SR appears at an intermediate level of neuronal noise. This phenomenon has not only been observed in theoretical studies but has also been confirmed in recent biological experiments [62]. Third, a similar enhancement effect of stochastic noise can also be induced by a high-frequency signal via vibrational resonance (VR) [63]. As an important variant of SR, the phenomenon of VR has been observed in many neural systems, in which the neuronal response to a low-frequency external driving signal is improved at the optimal amplitude of the high-frequency signal [64, 65]. This finding is of biological importance because high-frequency neural oscillations have been widely observed in the brain and have been linked to many higher brain functions [66]. Finally, many nonlinear systems stimulated by subthreshold periodic signals have been found to be enhanced at more than one noise level [67, 68]. Note that this specific type of SR is referred to as stochastic multi-resonance or multiple SR, which has also been widely reported in recent neural modeling studies [69, 70, 71].

Overall, these observations provide both the computational evidence and theoretical basis for the occurrence of SR in neural systems. After long-term evolution, our brain might have the ability to exploit SR by optimizing stochastic noise from different sources to facilitate neuronal information processing.

4 Regulation of SR in neural systems

What are the regulatory mechanisms of neuronal SR in the brain? Theoretically, there are several underlying intrinsic and external biological factors that can achieve this function, and we discuss this issue from different levels in the following section.

At the single-neuron level, both the weak signal detection capability and the frequency sensitivity range of neurons highly depend on the single neuron firing properties (Fig. 4(a)). Experimental studies have established that intrinsic differences in neuronal morphology, the distribution of ion channels, ionic concentrations, specific membrane properties and threshold diversity might result in the distinctive firing properties of neurons [72, 73, 74, 75, 76]. In addition, several other external factors, such as body temperature [77], autaptic and shunting inhibition [78, 79], short-term plasticity [71] and neuron-glia interactions [80], may also dramatically change neuronal firing properties. We predict that these intrinsic and external factors may play functional roles in regulating neuronal SR. On the other hand, real neurons are driven by different types of stochastic noise in the brain. In theory, neuronal noise stemming from different sources should be modulated by distinct biological mechanisms [3]. As mentioned above, synaptic bombardment noise and ion channel noise are two main types of noise in neural systems, and their joint effect may dominate the stochastic dynamics of neuronal firing (Fig. 4(a)). Using the mean-field theory, previous studies have shown that synaptic bombardment noise is determined largely by the strengths of excitatory and inhibitory inputs, the balance between excitation and inhibition, the correlation among input spike trains and the effective mean arrival rate of spikes [20, 49, 81]; furthermore, unreliable synaptic transmission might be an important mechanism regulating this type of neuronal noise [20]. Ion channel noise has been found to be modulated by the membrane potential of neurons, the densities of ion channels and the area of the membrane patch [8, 9, 10]. In the real brain, we postulate that these two types of neuronal noise may work together and be jointly responsible for evoking SR at the single-neuron level.

Compared with a single neuron, a population of neurons may cooperate with each other and collectively respond to a weak external driving signal. At an optimal noise intensity, many studies have shown that the maximal response of neuronal ensembles to a weak driving signal is relatively stronger than that at the single-neuron level [44, 45, 46, 47, 48, 49, 57]. These observations provide evidence that collective neuronal firing might be more efficient in detecting neuronal information carried by weak driving signals. However, the performance of population neuronal SR is not only impacted by the abovementioned intrinsic and external regulatory factors occurring at the signal-neuron level but can also be significantly modulated by both the network structure and network parameters (Fig. 4(b)), which are systematically summarized as follows.

First, intensive statistical analysis of the neuronal connectome at the micro-scale level has revealed that the wiring diagram of neurons exhibits typical small-world and scale-free features depending on different conditions [82]. Indeed, there is accumulating computational evidence that the performance of neuronal SR can be amplified via fine-tuning of the small-world or scale-free network structures [41, 83, 84, 85]. More importantly, using a spatially embedded network model, an optimal topology between the heterogeneous scale-free network and the strong random geometric network has also been determined to optimize the performance of neuronal SR, revealing that a suitable number of hubs and with that an optimal ratio between short- and long-range connections is critical for enhancing SR in neural systems [86].

Second, neurons communicate with each other through synapses, and different types of synaptic couplings may contribute distinct effects to neuronal SR (Fig. 4(b)). The most common type of synapse in the brain is the chemical synapse, which can be further divided into excitatory and inhibitory synapses [1]. By establishing neuronal networks coupled by chemical synapses, several studies have demonstrated that a network with strong excitation or inhibition dramatically deteriorates the weak signal detection capability, and a suitable excitation-inhibition balance in the network can improve the performance of neuronal SR-related behaviors [57, 87]. Furthermore, electrical synapses have also been demonstrated to strongly impact the dynamics of neural systems. Using a small-world network composed of Rulkov map-based neurons, Perc reported that the performance of neuronal SR induced by a pacemaker highly depends on the electrical coupling strength, and the small-world network property is able to enhance the SR only for intermediate levels of coupling strength [83]. Note that a similar effect of electrical synapses has also been found in FitzHugh-Nagumo (FHN) neurons connected in an array [88], but such enhancement seems not to be reproduced in a small-world neuronal network consisting of HH neurons [41]. In that study, increasing the electrical coupling strength tends to decrease the maximal neuronal response to weak periodic driving signals [41]. Interestingly, several studies have also compared the effects of chemical and electrical synapses on the enhancement of signal propagation via SR-related mechanisms in neuronal networks with different structures [65, 89, 84]. Most relevant studies have indicated that excitatory synaptic coupling might be more efficient than electrical synapses in weak signal detection [65, 89]. In addition to normal “feedforward” synapses, neurons might also be self-innervated via feedback connections referred to as autapses [79]. It was recently demonstrated that the performance of pacemaker-induced SR can be improved in a scale-free network composed of HH neurons at an optimal autaptic coupling strength [90].

Lastly, spike transmission delay due to both the finite propagation speed and the time lapse occurring by dendritic and synaptic integrations is unavoidable in neural systems [1, 2]. As an intrinsic property of neuronal information processing, the transmission delay of spikes may play a vital role in regulating neuronal SR (Fig. 4(b)). In particular, several modeling studies have shown that the spike transmission delay is critical for triggering multiple SR, and such behavior appears at every integer multiple of the period of the external driving signal [91, 92]. By introducing a pacemaker with an autapse, it has also been reported that multiple SR can be evoked by matched autaptic transmission delay in neuronal networks [90]. These results, however, do not suggest that the transmission delay is a necessary condition for multiple SR in neural systems. For a sufficiently long period of subthreshold driving signals, neural systems may exhibit typical multiple SR even in the absence of spike transmission delay [69]. Additionally, the transmission delay may also modulate the performance of neuronal SR. Such modulation of neuronal SR shows high sensitivity to stochastic noise [93]. At an optimal noise level, introducing the spike transmission delay into the network may reduce the capability of weak signal detection, thus deteriorating the performance of neuronal SR. When stochastic noise is not at the optimal level, a suitable tuning of transmission delay is able to assist the ability of noise to detect subthreshold driving signals.

5 Conclusions and open questions

Random fluctuations in brain activity are attributed to diverse sources of neuronal noise and have been widely observed in experimental recordings at different spatiotemporal scales [3, 4]. At the micro-scale level, neuronal membrane potentials also display the feature of voltage fluctuations in millisecond temporal resolution, strongly implying that neurons may operate in noisy environments. Recent studies have shown that a suitable level of neuronal noise may not destroy but can guarantee efficient signal processing in the brain [4, 21, 22, 23, 24]. In this context, SR is a leading candidate mechanism for enhancing the capability of weak signal detection in neural systems. Over the last several decades, remarkable progress has been made in this field using computational approaches[23, 24]. In this mini review, we systematically summarized different types of SR-related behaviors observed in modeling studies and also discussed several possible regulation mechanisms of neuronal SR in the brain.

Although neuronal SR has been widely investigated in recent years, there are still several open questions that deserve further exploration. First, an increasing number of modeling studies have documented different types of SR in neural systems, but it is not established whether some of them can coexist in the same system. In addition, it remains unknown whether all types of neuronal SR discovered in modeling studies can be observed in experiments. Further studies combining both computational and experimental approaches are needed to examine these two issues. On the other hand, chemical and electrical synapses coexist within the mammalian brain [1, 2]. However, previous modeling studies on neuronal SR have seldom included them together in the same network with an appropriate ratio matching experimentally reported data. Accordingly, it is still unclear whether these two types of synapses may perform combination and complementary roles in evoking and regulating neuronal SR, a question that can be further tested in future studies.

Looking forward, we must be cognizant that SR is only one possible mechanism by which neurons may exploit noise to facilitate signal processing in the brain. Other noise-induced behaviors, such as stochastic synchronization [94], inverse stochastic resonance [95, 96, 97, 98], phase resetting of collective rhythm [99, 100] and neural avalanches [101], may also play critical roles in high-efficiency neuronal information processing. A comprehensive theoretical framework that incorporates all these noise-enhanced phenomena will surely be rewarding in future modeling studies.

6 Acknowledgments

We sincerely thank Dr. Dong-ping Yang for his kind help in proofreading our manuscript. This research was supported by the National Natural Science Foundation of China (Grant Nos. 31771149, 61527815, 81571770, 81771925 and 81371636), the Project of Science and Technology Department of Sichuan Province (Grant Nos. 2017HH0001 and 2018HH0003), and the Slovenian Research Agency (Grant Nos. J1-7009, J4-9302, J1-9112 and P1-0403).