Most probable dynamics of a genetic regulatory network under stable L\'evy noise
Xiaoli Chen, Fengyan Wu, Jinqiao Duan, J\"urgen Kurths, Xiaofan Li

TL;DR
This paper investigates how non-Gaussian stable Le9vy noise influences the most probable trajectories of a genetic regulatory network, revealing parameter effects on state transitions and metastability in B. subtilis.
Contribution
It introduces a novel analysis of the MeKS network under Le9vy noise, highlighting how non-Gaussian noise parameters affect state transitions and metastable behaviors.
Findings
Optimal noise parameters shorten tipping time.
Different initial states evolve to metastable states.
Non-Gaussian noise influences transition pathways.
Abstract
Numerous studies have demonstrated the important role of noise in the dynamical behaviour of a complex system. The most probable trajectories of nonlinear systems under the influence of Gaussian noise have recently been studied already. However, there has been only a few works that examine how most probable trajectories in the two-dimensional system (MeKS network) are influenced under non-Gaussian stable L\'evy noise. Therefore, we discuss the most probable trajectories of a two-dimensional model depicting the competence behaviour in B. subtilis under the influence of stable L\'evy noise. On the basis of the Fokker-Planck equation, we describe the noise-induced most probable trajectories of the MeKS network from the low ComK protein concentration (vegetative state) to the high ComK protein concentration (competence state) under stable L\'evy noise. We demonstrate choices of the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGene Regulatory Network Analysis · Evolution and Genetic Dynamics · stochastic dynamics and bifurcation
Most probable dynamics of a genetic regulatory network under stable Lévy noise
Xiaoli Chen11footnotemark: 1
Fengyan Wu22footnotemark: 2
Jinqiao Duan33footnotemark: 3
Jürgen Kurths44footnotemark: 455footnotemark: 5
Xiaofan Li66footnotemark: 6
Center for Mathematical Sciences & School of Mathematics and Statistics, Huazhong University of Science and Technology, Wuhan 430074, China
College of Mathematics and Statistics, Chongqing University, Chongqing 401331, China
Department of Applied Mathematics, Illinois Institute of Technology, Chicago, IL 60616, USA
Research Domain on Transdisciplinary Concepts and Methods, Potsdam Institute for Climate Impact Research, PO Box 60 12 03, 14412 Potsdam, Germany
Department of Physics, Humboldt University of Berlin, Newtonstrate 15, 12489 Berlin, Germany
Abstract
Numerous studies have demonstrated the important role of noise in the dynamical behaviour of a complex system. The most probable trajectories of nonlinear systems under the influence of Gaussian noise have recently been studied already. However, there has been only a few works that examine how most probable trajectories in the two-dimensional system (MeKS network) are influenced under non-Gaussian stable Lévy noise. Therefore, we discuss the most probable trajectories of a two-dimensional model depicting the competence behaviour in B. subtilis under the influence of stable Lévy noise. On the basis of the Fokker-Planck equation, we describe the noise-induced most probable trajectories of the MeKS network from the low ComK protein concentration (vegetative state) to the high ComK protein concentration (competence state) under stable Lévy noise. We demonstrate choices of the non-Gaussianity index and the noise intensity which generate the ComK protein escape from the low concentration to the high concentration. We also reveal the optimal combination of both parameters and making the tipping time shortest. Moreover, we find that different initial concentrations around the low ComK protein concentration evolve to a metastable state, and provide the optimal and such that the distance between the deterministic competence state and the metastable state is smallest.
keywords:
Nonlocal Fokker-Planck equation, most probable trajectories, gene regulation, non-Gaussian stochastic dynamics, Lévy noise.
label1label1footnotetext: This work is supported by NSFC (Grant Nos. 11531006, 11371367, 11271290, 11771062) and the Fundamental Research Funds for the Central Universities’, HUST: 0118011076.
1 Introduction
1.1 Background
A number of studies in different fields were concerned about the role of noise playing in dynamical systems, since noise may induce various delicate effects [1, 2, 3, 4, 5, 6]. Noise-induced transition phenomena were regarded in various dynamical systems including gene regulatory networks [7, 8], oscillators and electronic transport in physics [9, 10, 11, 12, 13], chemical reacting systems [14, 15], cancer cell proliferation and epidemiological models in pathology [16, 17].
These applications have been considered for Guassian noise. But when fluctuations are present in certain events, such as burst-like events, Gaussian noise is not appropriate. In this case, it is more appropriate to model the random fluctuations by a non-Gaussian Lévy motion with heavy tails and bursting sample paths. Non-Gaussion Lévy noise has found a lot of applications in different areas. Perc applied the non-Gaussian Lévy noise in economy and studied the impact of an important class of external perturbations on the evolution of cooperation in a spatially extended prisoner’s dilemma game [18, 19]. Lévy noise was also associated with saving energy in animals, e.g. albatross flight patterns, as reviewed in [20]. Zheng et. al considered how Lévy noise may affect gene regulatory networks in [21]. For further applications about non-Gaussion Lévy noise cf. [22, 23, 24, 25].
Gene expression is a noisy process [12, 26]. There are various studies about Gaussian noise in gene regulation [27, 28, 29, 30, 31]. However, the transcription of a gene can be a discontinuous or burst-like event, and mRNA is synthesized in intermittent but intense pulses or bursts [21, 22, 32, 33, 34]. Under this circumstance, Gaussian noise is not proper to model this phenomenon, but a stochastic process with discontinuous and heavy tail distribution, i.e., non-Gaussian Lévy noise [35, 36, 37, 38, 39, 40] appears more appropriate in describing the fluctuations in gene regulation.
In this study, we devote to studying the transitions in a two-dimensional genetic regulatory model driven by non-Gaussian -stable Lévy noises, which describe fluctuations with features such as heavy tails and jumps. The corresponding genetic regulatory model was established by Süel et al. [7]. Comparing with the experimental data, they demonstrated the reasonability and validity of the genetic regulatory model and considered a set of excursion trajectories in an excitable case under Gaussian noise. Instead of using the mean first exit time and first escape probability to study the bistable case of this model driven by -stable Lévy noise [41], we examine the most probable trajectories rather than stochastic trajectory sample paths to characterize the dynamical behaviors of the model. The nonlocal Fokker-Planck equation of stochastic systems with Lévy noise can be numerically simulated [42, 43, 44, 45, 46, 47, 48]. The noise induced most probable trajectories, which describe the MeKS network from the low ComK protein concentration (vegetative state) to the high ComK protein concentration (competence state), are obtained by examining the solution of the nonlocal Fokker-Planck equation. We use here numerical methods to solve the nonlocal Fokker-Plank equation, (for more details see Appendixes). We present choices of the non-Gaussianity index and the noise intensity which induce the ComK protein transfer from the low concentration to the high concentration. Then we will analyse how different initial concentrations around the low ComK protein concentration affect the metastable state. Furthermore, we determine the optimal and such that the distance between the deterministic competence state and the metastable state is smallest.
1.2 A stochastic model for the MeKS network
To investigate the dynamics of competence induction, Süel et al. [7] constructed a MeKS network:
[TABLE]
The symbols and represent the concentration of the ComK and ComS proteins, respectively. The parameters and stand for the basal and fully activated rates of ComK protein production, respectively. The parameter denote the concentration of the ComK protein needed for a activation. The Hill coefficients and are the cooperativities of the ComK protein auto-activation and ComS protein repression, respectively. The maximal expression rate of the ComS protein is , and when the ComS protein attains its half-maximal rate. We choose suitable parameters [7]: . In this case, the MeKS network has three equilibria: two stable equilibria (0.015262, 2.1574) (nodal sink corresponding to the low vegetative state), (0.15732,1.5781) (spiral sink corresponding to the high competence state) and one unstable equilibrium (0.08568,2.2469)(saddle point).
The core competence genetic circuit of the MeKS network is shown in FIG. 1. In B. subtilis population, mostly, the ComK protein is expressed by the comK gene at a relative low level. Thus, the ComK protein concentration is low, which corresponds to the vegetative state. Under circumstance of nutrient limitation, a small part of B. subtilis differentiate into the competence state, in which the ComK protein concentration is high. In this case, the cell can take in extracellular DNA from the environment [7, 49, 50, 51, 52]. It was found that the key transcription factor, the ComK protein, can activate the transcription of several genes which is necessary for the competence development. When the ComK protein concentration is high, then the competence develops [53, 54], from which we deduce that the ComK protein occupies a core position in the competence-signal-transduction network.
As discussed in the preceding subsection, gene expression in cells is subject to random fluctuations [12, 26], and such fluctuations are under real conditions typically non-Gaussian noise. Hence we consider the MeKS network under the influence of -stable Lévy motion, which can be written as the following stochastic differential equations:
[TABLE]
where Here denote the diffusion coefficients, and is the two-dimensional Lévy motion with independent scalar symmetric -stable Lévy motions which have the same generating triplet . Here the jump measure is a Borel measure in and defined by
[TABLE]
where , is the non-Gaussianity index. For more information about -stable Lévy motions, see [2, 3].
In the following discussions, we use the scale transformation . For the noise intensity, we set . After this transformation, the two stable equilibria become (the low concentration state) and (the high concentration state), and the unstable equilibrium becomes . We define as the low concentration region. If the most probable trajectories reach the high concentration region, where the ComK protein concentration is high, the competence develops.
This paper is organized as follows. In Section 2, we present the method how to compute the most probable trajectories. In Section 3, we discuss the most probable dynamics of the MeKS network with geometric tools (most probable trajectories) under stable Lévy noise. We finish this paper with conclusions and discussions in Section 4.
2 Method
When it comes to trajectories for a stochastic dynamical system, there is an apparent option of consideration: the almost sure trajectories [3, 55]. However, as we know, the almost sure trajectories, i.e. the sample trajectories (FIG. 2), which look like “noodles” in the phase plane, could hardly provide helpful information for understanding the system’s dynamics. Furthermore, to acquire comprehension of a stochastic dynamical phenomenon, stationary probability density functions for solution trajectories have been widely utilised [56, 57].
Notice that each sample trajectory is an “outcome” of a trajectory of a stochastic dynamical system, from a given initial state. Now, the question arises, which trajectory does the system most probably to evolve in phase plane? Our geometric tool, the most probable trajectories [3, 55], will tackle this problem. As is known, the solution of a stochastic system (1.2) is a stochastic process, and the probability density function of the stochastic process is governed by the corresponding Fokker-Planck equation [42, 57]. On the basis of it, we can get the most probable trajectory by computing the maximizer of the probability density function at every time . This offers geometric representations of most probable trajectories of a stochastic dynamic system [55].
First we derive the generator and the Fokker-Planck equation of system (1.2) (for more details see Section Symmetric -stable Lévy motions). Then we use the finite difference method to solve the Fokker-Planck equation (more details are given in Section Fokker-Planck equation). Plots of the so calculated probability density functions are shown in FIG. 3. We set the low concentration state as the initial point of probability density function. FIG. 3 shows that the peaks transfer from one stable point to another with increasing time. When time is small , there is one peak around the low concentration. As time goes on, there are two peaks for the probability density, one peak is transferred to the competence region, where the ComK protein concentration is high, the other peak still stays around the vegetative region. For , the probability density function has attained its stationary solution, finally it stays at the competence state (the high ComK concentration). For a fixed time , we compute the maximum of to get the position . We connect this series of , to get the most probable trajectory (from a given initial state). The time instants ’s need to be taken close enough, in order to get a reasonable approximation of the most probable trajectory.
Through computing the most probable trajectories, we analyze how the ComK protein transfers from the low concentration regime to the high one, with different noise parameters. Then we want to know when the most probable trajectories go over the saddle point. We define this time as the tipping time. Moreover, we will determine the choices of and to benefit the development to competence.
3 Results
In this section, we analyse how the noise intensity and non-Gaussianity index affect the most probable trajectories. As seen from FIG. 3, the probability density function attains its stationary state as time goes on. In the following, we choose as the computational terminal time.
Most probable trajectories and corresponding time series of the ComK protein for various noise intensity and non-Gaussianity index . The left plots of FIG. 4 show the impacts of and on the most probable trajectories. Note that the red star is the low concentration state, the green star denotes the saddle point and the blue star is the high concentration state. The right plots of FIG. 4 show the impacts of and on the corresponding time series of ComK and the red star is the high concentration state of ComK protein.
When is small, the most probable trajectories stay around the low concentration state (FIGs. 4 (a1) and (a2) ). Hence, a small noise intensity is not in favor of the expression of comK gene. When (see FIGs. 4 (b1) and (b2) ), the most probable trajectories first get near the unstable point, and then jump to the high concentration region. As time goes on, the most probable trajectories transit back to the low concentration region which means that the high concentration region is less stable or robust than the low concentration region in this case (). With the increase of , trajectories with escape to the high ComK protein concentration region. But trajectories with can not escape to the high concentration region by . Note that when , the Lévy noise has larger jumps but lower jump frequencies. FIGs. 4 (c1) and (d1) exhibit that when and , trajectories with lead the ComK protein evolve to the high concentration region, and in this case, the jump frequencies are higher than for Lévy noise with .
Furthermore, we see that when the most probable trajectories get close to the saddle point
, they will reach the high concentration soon. This is in accordance with the observation that the saddle point repulses the most probable trajectories, while the high concentration stable state appears to attract them. If the most probable trajectories pass the saddle point, then they arrive at the high concentration. We define the time spending from the low concentration state to the saddle point as the tipping time.
When the noise intensity is large, the tipping time becomes short (see FIGs. 4 (a2), (b2), (c2) and (d2) ). In the following, we will discuss the tipping time for different and .
Tipping time with different noise intensity and non-Gaussianity index . FIG. 5 shows the tipping time from the low concentration region to high concentration region with different and . It is worth pointing out that the most probable trajectories can not reach the high concentration region when the tipping time is up to 30.
As shown in FIG. 5 (a), when , the tipping time first decreases and then increases as increases. This means that with larger jumps is beneficial to making the expression of the comK gene. When , the tipping time decreases as increases, i.e. large (smaller jumps with higher frequency) helps the expression of the comK gene. In this case, we may infer that the transition will occur at earlier times for larger . These results coincide with results in [35].
FIG. 5 (b) presents the tipping time as a function of . The transition does not occur for due to its low jump frequency. For the tipping time decreases as the noise intensity increases. Except for , the tipping time decreases as increases at a given noise intensity, because the jump frequency increases. In summary, a larger noise intensity with a larger non-Gaussianity index will play a more positive role in the expression of the comK gene and a relative small noise intensity with non-Gaussianity index closing to will play a positive role in the expression of the comK gene.
Combination of the noise intensity and the non-Gaussianity index control the competence development. Now we discuss which combination of and can make the ComK protein efficiently transit to the high concentration, i.e. the competence develops. It is shown in FIG. 6, that the region below the red curve can not make a ComK protein transit from the low concentration to the high one, but that the region above the red curve can induce the ComK protein transit to the high concentration. This figure provides clearly how to choose and to develop the competence. Larger with high frequency jumps is propitious to the expression of the comK gene. Small is not beneficial to the expression of the comK gene.
Various initial concentrations evolve to a metastable state. Here we study the effect of different initial concentrations near the nodal sink (the low ComK vegetative state) on the most probable trajectories (FIG. 7). As in FIG. 4, the red star denotes the nodal sink, the green star represents the saddle and the blue star is the spiral sink. As shown in FIGs. 7 (a1), (a2), when and are fixed, we choose nine different initial concentrations surrounding the nodal sink, and find that the most probable trajectories show a slight tendency to the nodal sink, then ultimately gather at a metastable state, i.e. reaching the equilibrium in the sense of stochasticity. FIGs. 7 (b1), (b2) display the most probable time series of the ComK protein, from which we can see that the ComK protein tends to the metastable state as time goes on. Interestingly, as shown in FIG. 7 (b1), when is relatively small (), the most probable trajectories of the nine different initial concentrations first attain the competence region (the high ComK concentration), then they return to the vegetative region (the low ComK concentration), and finally gather at a low metastable state. However, when becomes larger (), the most probable trajectories of the nine different initial concentrations reach the competence region (the high ComK concentration), and gather at a relative high metastable state finally. The differences among the nine most probable trajectories become narrow initially, then spread relatively strong, and eventually they converge at the high metastable state.
The distance between the deterministic competence state and metastable state with different and . As shown in FIGs. 7 (a1) and (a2), the most probable trajectories of different initial concentrations gather at different metastable states under the influence of Lévy noise with different and . That is, the distance between the deterministic competence state and the metastable state varies with different and , from which we know that different Lévy noise induce various effects on the behavior of dynamical systems. Now we discuss which and can make the distance smallest, i.e. acting most efficiently. We consider the distance between the deterministic competence state and the metastable state as . It is shown in FIG. 8, that d decreases firstly and then increases with the increase of when the noise intensity is fixed. When the noise intensity becomes stronger, the minimum of d is bigger. When and , d is the smallest. Hence, Lévy noise with and have the smallest effect on the deterministic competence state.
4 Conclusion
We have studied the most probable trajectories of a two-dimensional system (MeKS network) under the influence of non-Gaussian stable Lévy noise. On the basis of the nonlocal Fokker-Planck equation, we have described the most probable trajectories of the MeKS network from the low ComK protein concentration (vegetative state) to the high ComK protein concentration (competence state) under stable Lévy noise. It has been recently demonstrated that the non-Gaussian stable Lévy noise is more appropriate to describe the burst-like phenomenon in synthesis process of biochemical systems. Therefore, we here study the most probable trajectories of the MeKS network under the influence of stable Lévy noise.
The most probable trajectories of the MeKS network influenced by Lévy noise with various noise intensity and non-Gaussianity index have been investigated. We have found that for fixed the ComK protein stays at the low concentration region for small noise intensity, and it begins to transit to the high concentration region with the increase of . Also, the tipping time from the low concentration region to the high concentration region as a function of with various has been analysed. We have discovered that for fixed , the tipping time firstly decreases and then increases as increases. Thus, we can determine an optimal combination of and to make the tipping time shortest. In addition, combinations of parameters of and which generate a ComK protein transit from the low concentration to the high concentration have also been revealed. Furthermore, we have selected different initial concentrations around the low ComK protein concentration to examine the most probable trajectories of the MeKS network, to discover that the most probable trajectories gather at a metastable state. Lévy motion with a small () which has a lower jump frequency can not make the ComK protein transit to the competence region. For small , Lévy motion with a relative small , which has larger jumps, is more convenient to make the ComK protein transit to the competence region. However, for larger , Lévy motion with a larger which has more small jumps is more convenient to transit to the competence region. Additionally, when and , the distance between the deterministic competence state and metastable state is smallest.
In short, we have utilised this geometric tool, the most probable trajectories, to visualise the dynamics of the MeKS networks, which offer an optimal path for the ComK protein escapes from the low concentration (vegetative region) to the high concentration (competence region).
Appendixes
Symmetric -stable Lévy motions
A stochastic process defined on is a symmetric -stable Lévy process with if the following conditions are satisfied:
- (1)
, a.s.; 2. (2)
For any choice of and , random variables are independent (independent increments property); 3. (3)
The distribution of does not depend on (temporal homogeneity or stationary increments property); 4. (4)
has stochastically continuous sample paths, i.e., for every in probability, as .
Fokker-Planck equation
The generator of the process is defined as (see [2, 23, 41]),
[TABLE]
where is the delta measure concentrated at [math] with property .
The Fokker-Planck equation for the distribution of the conditional probability density
, i.e., the probability of the process has value at time given it had value at time [math], is given by [1, 3], where is the adjoint operator for .
The adjoint operator for can be found out, as the integral part is a symmetric operator. Thus we have the Fokker-Planck equation:
[TABLE]
with the initial condition: .
Numerical method
In the following, we present the numerical algorithms the case of with the absorbing condition. Noting that the absorbing condition dictates that vanishes outside , we can simplify Eq. (Fokker-Planck equation) as
[TABLE]
for ; and for .
Set , , , i.e., , , then we get
[TABLE]
for ; and for .
Then, we use a numerical method to discretize the nonlocal Fokker-Planck equation (4.4). For the spatial direction, the advection term and are discretized by the third-order WENO method given in [58] and the singular integral term are used a modified trapezoidal rule to approximate[42, 43]. We divide the interval in space into sub-intervals and define , for , where . Denoting the numerical solution of at by , we obtain the semi-discrete equation
[TABLE]
for and , where the constant and , is the Riemann zeta function, and the superscripts denote the global Lax-Friedrichs flux splitting defined as with , . The absorbing condition requires that the values of if the index or .
For time discretization, we use a third-order total variation diminishing Runge-Kutta method provided in [59]. In particular, for the ordinary differential equation , the method can be written as
[TABLE]
where denotes the numerical solution of at time .
Acknowledgements
We would like to thank Dongfang Li, Ke Yin, Yayun Zheng, Xiujun Cheng and Rui Cai for helpful discussions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] B. K. ∅ \varnothing ksendal, Stochastic Differential Equations: An Introduction with Applications, Springer, 2005.
- 2[2] D. Applebaum, Lévy Processes and Stochastic Calculus, second ed., Cambridge University Press, 2009
- 3[3] J. Duan, An Introduction to Stochastic Dynamics, Cambridge University Press, New York, 2015.
- 4[4] P. C. Bressloff, Stochastic Processes in Cell Biology, Springer, 2014.
- 5[5] M. Kærn, T. C. Elston, W. J. William, James J. Collins, Stochasticity in gene expression: from theories to phenotypes, Nature Rev. Genet. 6 (2005) 451-464.
- 6[6] A. Raj, A. V. Oudenaarden, Nature, nurture, or chance: stochastic gene expression and its consequences, Cell. 135 (2008) 216-226.
- 7[7] G. M. Süel, Jordi Garcia-Ojalvo, Louisa M. Liberman, Michael B. Elowitz, An excitable gene regulatory circuit induces transient cellular differentiation, Nature. 440 (2006) 545-550.
- 8[8] M. Acar, J. Mettetal, A. V. Oudenaarden, Stochastic switching as a survival strategy in fluctuating environments, Nat. Genet. 40 (2008) 471-475.
