Fractional compound Poisson processes with multiple internal states
Pengbo Xu, Weihua Deng

TL;DR
This paper develops mathematical models for particles exhibiting anomalous diffusion with multiple internal states, deriving equations to describe their positions, internal state distributions, and related functionals, with applications in first passage and occupation times.
Contribution
It introduces new fractional Fokker-Planck and Feynman-Kac equations for multi-state anomalous diffusion processes, including internal state dynamics.
Findings
Derived equations for particle positions and internal states
Analyzed stochastic process dynamics
Applied models to first passage and occupation time distributions
Abstract
For the particles undergoing the anomalous diffusion with different waiting time distributions for different internal states, we derive the Fokker-Planck and Feymann-Kac equations, respectively, describing positions of the particles and functional distributions of the trajectories of particles; in particular, the equations governing the functional distribution of internal states are also obtained. The dynamics of the stochastic processes are analyzed and the applications, calculating the distribution of the first passage time and the distribution of the fraction of the occupation time, of the equations are given.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
††thanks: This work was supported by the National Natural Science Foundation of China under Grant No. 11671182.
Fractional compound Poisson processes with multiple internal states
Pengbo Xu
Weihua Deng
School of Mathematics and Statistics, Gansu Key Laboratory of Applied Mathematics and Complex Systems, Lanzhou University, Lanzhou 730000, P.R. China
Abstract
For the particles undergoing the anomalous diffusion with different waiting time distributions for different internal states, we derive the Fokker-Planck and Feymann-Kac equations, respectively, describing positions of the particles and functional distributions of the trajectories of particles; in particular, the equations governing the functional distribution of internal states are also obtained. The dynamics of the stochastic processes are analyzed and the applications, calculating the distribution of the first passage time and the distribution of the fraction of the occupation time, of the equations are given.
pacs:
02.50.-r, 05.30.Pr, 02.50.Ng, 05.40.-a, 05.10.Gg
††preprint: APS/123-QED
Introduction.— Poisson process is the most fundamental stochastic process of renewal theory. The application of Poisson process naturally coming to our minds is in queueing theory to model the random events: the arrival of customers at a store or phone calls at an exchange Kleinrock:76 . Renewal process generalizes Poisson process for arbitrary holding times, being still independent identically distributed (i.i.d.) godreche:00 . If the probability density function (PDF) of the holding/waiting times between two subsequent events has the asymptotic behavior when time is long enough laskin:00 , it is called fractional Poisson process. The residence time statistics for fractional Poisson processes are discussed in burov:00 , which reveal sharp transitions for a critical number of degrees of freedom and give application of detecting nonergodic kinetics from the measurements of many blinking chromophores.
We further generalize the renewal processes to have multiple internal states, where the holding times for different internal states are drawn from different distributions. The case of two internal states is considered in lowen:00 ; Godec:17 with applications, including trapping in amorphous semiconductors, electronic burst noise, movement in systems with fractal boundaries, the digital generation of noise, and ionic currents in cell membranes. The fractional Poisson processes with multiple internal states have a lot of potential applications, e.g., the particles moving in multiphase viscous liquid composed of materials with different chemical properties; Niemann, Barkai, and Kantz niemann:00 detailedly investigate a stochastic signal with multiple states, in which each state has an associated joint distribution for the signal’s intensity and its holding time. This letter adopts the notations of niemann:00 . If introducing jumps to the fractional Poisson processes, then we reach the fractional compound Poisson (fcP) processes meerschaert:00 . The jumps follow the fractional Poisson processes to arrive and, most of the time, the size of the jumps is random, with specified PDF. More specifically, let be the fractional Poisson process and a sequence of i.i.d. random variables (jump lengths). Then is the fcP process. The continuous time random walk (CTRW) with i.i.d. power law waiting time cartea:00 ; metzler:00 ; Metzler:16 ; klafter:00 is a specific fcP process, being widely used to model various anomalous diffusions, e.g., mRNA molecules in living cells golding:00 , price fluctuation in financial market scalas:00 .
In this letter, we focus on the fcP processes with multiple internal states, i.e., of is a fractional Poisson process with multiple internal states. Each internal state has an associated distribution of waiting time, but the distributions of jump lengths are all simply taken as normal distribution. We derive the Fokker-Planck equations metzler:00 , governing the PDF of positions of , the Feynman-Kac equations turgeman:00 ; carmi:00 ; cairoli:00 , describing the distribution of the functional satya:00 of the paths of , and the equations, characterizing the functional distribution of the internal states. From the Fokker-Planck equations, we obtain the evolution of the mean square displacement (MSD) for the process, showing that it strongly depends on the properties of the internal transition matrix feller:00 and sometimes the distribution of the initial position of the particles. The applications of the Feynman-Kac equations and the equations governing the distribution of the functional are given to calculate the distribution of first passage time carmi:00 ; redner:00 ; Deng:17 and the distribution of the fraction of the occupation time godreche:00 . Some properties of the distributions are obtained.
Model.— We consider the fcP processes with finite internal states, denoting their number as . The internal states determine the distributions of waiting times and the transition of the internal states is described by a Markov chain with its transition matrix ; the dimension of is . The element of the matrix represents the transition probability from state to state . The bras \big{<}\cdots\big{|} and kets \big{|}\cdots\big{>} denote the row and column vectors, respectively. From Ref. feller:00 one can see that for the ergodic or periodic chain there always exists an equilibrium distribution, denoted by \big{<}\rm eq_{M}\big{|}, with the property of \big{<}{\rm eq_{M}}\big{|}M=\big{<}{\rm eq_{M}}\big{|}. For the transition matrix , as is well known, its largest eigenvalue is and the right eigenvector for this eigenvalue is the vector of 1s Walker:11 , denoted as \big{|}\Sigma\big{>}. That is M\big{|}\Sigma\big{>}=\big{|}\Sigma\big{>}. The second largest eigenvalue is strictly less than if is irreducible. It also obviously holds that M^{T}\big{|}{\rm eq_{M}}\big{>}=\big{|}{\rm eq_{M}}\big{>} and \big{<}\Sigma\big{|}M^{T}=\big{<}\Sigma\big{|}. We use the notation \big{<}{\rm init}\big{|} to represent the initial distribution of the internal states. Based on the CTRW, we define the waiting time distribution matrix and the jump length one .
The initial state of the stochastic process is drawn from the initial distribution. After confirming the initial state, e.g., state , the waiting time and jump length will be obtained from the distributions and , respectively. The new internal state is drawn from the distribution M\big{|}{\rm init}\big{>}. Then repeat the procedure. For the Markov chain, there are plenty of practically or theoretically important transition matrices feller:00 . The simple and representative one should be signifying alternating internal states. The model will be, respectively, discussed for the case that is irreducible and the case that is reducible, i.e., the digraph of is strongly connected or not.
Fokker-Planck equations.—We use the notation , to represent the PDF of finding the particle, at time , position and internal state . Let \big{|}G(x,t)\big{>} be the column vector . The initial condition for \big{|}G(x,t)\big{>} is taken as \delta(x)\delta(t)\big{|}{\rm init}\big{>}. Similarly to the derivation of fractional Fokker-Planck equation from CTRW model with i.i.d. waiting times klafter:00 ; metzler:00 , we can obtain the equation in the Fourier-Laplace space
[TABLE]
In this letter, we take the waiting time distributions as asymptotical power laws, i.e., in the Laplace space , where , . As for the jump length distributions we choose all of them as Gaussian distribution, so in the Fourier space . Thus from the above equations, taking the inverse Laplace and Fourier transformations leads to the Fokker-Planck equation with internal states
[TABLE]
where D^{{\rm diag}(1-\alpha_{1},\ldots,1-\alpha_{N})}_{t}={\rm diag}\Big{(}D_{t}^{1-\alpha_{1}},\ldots,D_{t}^{1-\alpha_{N}}\Big{)}, and are the Riemann-Liouville derivatives; the factors of the diagonal matrix represent diffusion coefficients with the dimension ; it can be noted that if the usual fractional Fokker-Planck equation metzler:00 is recovered.
Next our aim is to calculate the PDF of finding the particle at position at time , denoted as , and the mean squared displacement (MSD) of the process. Without loss of generality, we assume , and take the equilibrium and initial distributions, respectively, as \big{|}\rm eq_{M}\big{>}=(\varepsilon_{1},\ldots,\varepsilon_{N})^{T} and \big{<}{\rm init}\big{|}=(\lambda_{1},\ldots,\lambda_{N}). We denote the matrix in Eq. (1) as ; it is irreducible or not if and only if is or not. Plugging the distributions of waiting time and jump length into , for the irreducible transition matrix the asymptotic expression of the inverse matrix of can be expressed as
[TABLE]
Then we obtain
[TABLE]
The PDF in the Fourier-Laplace space given in Eq. (3) is the same as the PDF of (natural-form) distributed-order diffusion discussed in sandev:00 ; chechkin:00 with , even though their backgrounds are completely different. From Eq. (3), the MSD can be got as
[TABLE]
Therefore, when is large enough ( tends to [math]), the MSD of the process behaves as \big{<}x^{2}(t)\big{>}\sim\mathcal{L}^{-1}\Big{\{}\frac{2K_{\alpha_{1}}}{\varepsilon_{1}s^{1+\alpha_{1}}}\Big{\}}\sim\frac{2K_{\alpha_{1}}}{\varepsilon_{1}\Gamma(1+\alpha_{1})}t^{\alpha_{1}}; i.e., the MSD of the process with the irreducible transition matrix behaves asymptotically as , where is the smallest one among all exponents of the power-law waiting time distributions of the internal states. When the transition matrix of the Markov chain of the internal states is irreducible, the equilibrium distribution \big{|}{\rm eq_{M}}\big{>} does not depend on the initial distribution, and the initial distribution has no influence on the final PDF or MSD.
On the other hand, if the transition matrix is reducible, then the initial distribution of the internal states often makes an important impact on the final results. First, we consider the case that the transition matrix has the form of {\rm diag}\big{\{}M_{1}(s),\ldots M_{j}(s)\big{\}}, where the matrices are irreducible with the dimension of , and . From the form of the transition matrix, one can see that the internal states of the process actually consist of several independent Markov chains with the transition matrices . Following the structure of , since and are diagonal, we can rewrite and as the form consistng of and , . Then the matrix has the form of {\rm diag}\big{\{}A_{1}(s),\ldots,A_{j}(s)\big{\}}, where . The vectors can also be rewritten as \big{|}{\rm init}\big{>}=\big{(}\big{|}{\rm init}\big{>}_{1},\ldots,\big{|}{\rm init}\big{>}_{j}\big{)}^{T}, \big{|}{\rm eq_{M}}\big{>}=\big{(}\big{|}{\rm eq_{M}}\big{>}_{1},\ldots,\big{|}{\rm eq_{M}}\big{>}_{j}\big{)}^{T}, and \big{<}\Sigma\big{|}=\big{(}\big{<}\Sigma\big{|}_{1},\ldots,\big{<}\Sigma\big{|}_{j}\big{)}. For the convenience of statement, we redefine the subscripts, i.e., let , \big{|}{\rm init}\big{>}_{i}, and \big{|}{\rm eq_{M}}\big{>}_{i}, etc be consist of , , and etc, respectively, where . After obtaining the inverse matrix of , we have the PDF in the Fourier-Laplace space
[TABLE]
where if \big{|}{\rm init}\big{>}_{m}=0 otherwise , . In a very particular case, i.e., the transition matrix is an identity matrix and for , the PDF of the process has the form
[TABLE]
which is the same as the PDF of (modified-form) distributed-order diffusion sandev:00 ; chechkin:00 with (their physical backgrounds are completely different). From (4), there exists
[TABLE]
which behaves as \big{<}x^{2}(t)\big{>}\sim t^{\alpha^{\ast}} for large with \alpha^{\ast}=\max\limits_{\mathop{1\leqslant i\leqslant j}\limits_{i\neq i_{1},i_{2},\cdots,i_{j}}}\Big{\{}\min\limits_{1\leqslant r\leqslant n_{i}}\{\alpha_{ir}\}\Big{\}}, being confirmed by simulating the stochastic process (see Fig. 1); the influence of the distribution of the initial states is also observed.
Next, we consider the case that the transition matrix is not strictly the form of block diagonal matrix. Without loss of generality, we assume that the first rows of the transition matrix still keep the form of block diagonal matrix while the others not. If the elements of the initial distribution from -th to -th are [math] (denoting this part of the vector as \big{|}{\rm init}\big{>}_{i+1,N}), then the results illustrated by Fig. 1 still hold, just neglecting the last internal states; on the other hand, if \big{|}{\rm init}\big{>}_{i+1,N} does not equal to zero and, at the same time, the elements of \big{|}{\rm init}\big{>} from first to -th are nonzero, the results for large can still be displayed by Fig. 1, since all the particles in the states () finally go to some of the first states. A little bit complex case is that as least one of the first elements of —init¿ is zero and \big{|}{\rm init}\big{>}_{i+1,N}\neq 0; in this case, taking \big{<}{\rm init}\big{|}M^{N-1} as the new initial distribution, the results are still depicted by Fig. 1, ignoring the last internal states.
Equations governing the distribution of the functionals of the paths and internal states of the process.—Two types of functionals will be considered. One is still defined as Kac:49 , being widely discussed carmi:00 ; turgeman:00 ; cairoli:00 ; satya:00 ; Wu:16 , where is a prescribed function and is a trajectory of a particle. The other functional is first introduced here, defined as , where represents that the particle is in the state at time , naturally its values belonging to .
We use the notation to represent the joint PDF of finding the particle at position with the functional and in the internal state of at time t. Gather all to form a column vector denote by \big{|}G(x,A,t)\big{>}. Following the process of the derivation of the fractional Feynman-Kac equation carmi:00 , we have
[TABLE]
with the initial condition \big{|}G(x,A,t)\big{>}\,\big{|}_{t=0}=\delta(A)\delta(x)\delta(t)\big{|}{\rm init}\big{>}, and with being the fractional substantial derivative carmi:00 ; friedrich:00 . Next we derive the backward version of Eq. (5). We use the notation \big{|}{\rm init}\big{>}_{x_{0}}=\big{(}\lambda^{(1)}_{x_{0}},\lambda^{(2)}_{x_{0}},\ldots,\lambda^{(N)}_{x_{0}}\big{)} to represent the initial distribution of the internal states of the process starting at , and the PDF of the functional of the process at , starting at with the internal state . After some calculations, one can get
[TABLE]
If one is only interested in the PDF of at of the process starting at , just calculate . Next, we give a specific application of (6) for calculating the distribution of the first passage time , being the time that the particle starting at () first reaches . Define , where if otherwise it equals to . According to carmi:00 ; Wu:16 , there exists the relation Pr\{t_{f}>t\}=Pr\Big{\{}\max_{0\leq\tau<t}x(\tau)<B\Big{\}}=\lim_{\rho\rightarrow\infty}g_{x_{0}}(\rho,t). For the process of two internal states with the alternating transition matrix, and the coefficients , we have
[TABLE]
where and ; here is taken as [math] but not essential. Thus one can obtain the PDF of the first passage time
[TABLE]
When is big and , then and . Thus, \exp\Big{(}-\sqrt{\frac{a_{0}+b_{0}}{2}}B\Big{)}\sim\exp\Big{(}-\sqrt{\frac{s^{\alpha_{2}}}{2}}B\Big{)}\sim 1-\frac{B}{\sqrt{2}}s^{\frac{s^{\alpha_{2}}}{2}}, i.e., . The result is confirmed by simulations given in Fig. 2.
We then turn to the distribution of , ignoring the position of the particle. Denote as the joint PDF of finding the particle with the functional in the state at time . Let \big{|}G(A_{s},t)\big{>}=\begin{pmatrix}G^{(1)}(A_{s},t),\ldots,G^{(N)}(A_{s},t)\end{pmatrix}^{T}. Then we get the governing equation
[TABLE]
where
[TABLE]
A direct application of (7) is to calculate the distribution of the fraction of the occupation time, i.e., the distribution of , denoted as , where represents the occupation time of state . Without loss of generality, we only consider the occupation time of the first state by letting if , otherwise . Here we just present three results (in the case that the transition matrix is irreducible reducible:17 ): 1) if , then ; 2) if is not the strictly smallest one, then ; 3) if () but smaller than other exponents, then
[TABLE]
from which the classic arcsine law can be recovered stefani:00 .
Conclusion.—We derive the Fokker-Planck equations as well as equations of the functionals of the paths and internal states of the fcP process with multiple internal states. Based on the equations, the MSD is analyzed, and the first passage time and fraction of occupation time are calculated. If the transition matrix of the internal states is reducible, the initial distribution of the internal states significantly influence the final results.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) L. Kleinrock, Queueing Systems: Theory (John Wiley & Sons, Canada, 1976).
- 2(2) C. Godrèche and J. M. Luck, J. Stat. Phys. 104 , 489 (2001).
- 3(3) N. Laskin, Commun. Nonlinear Sci. Numer. Simul. 8 , 201 (2003).
- 4(4) S. Burov and E. Barkai, Phys. Rev. Lett. 107 , 170601 (2011).
- 5(5) S. B. Lowen and M. C. Teich, Phys. Rev. E 47 , 922 (1993).
- 6(6) A. Godec and R. Metzler, J. Phys. A: Math. Theor. 50 , 084001 (2017).
- 7(7) M. Niemann, E. Barkai, and H. Kantz, Math. Model. Nat. Phenom. 11 , 191 (2016).
- 8(8) M. M. Meerschaert and A. Sikorskii, Stochastic Models for Fractional Calculus (Walter de Gruyter, Berlin, 2012).
