Beyond Wentzell-Freidlin: semi-deterministic approximations for diffusions with small noise and a repulsive critical boundary point
Florin Avram, Jacky Cresson

TL;DR
This paper extends a limit theorem for diffusion models in population theory, providing semi-deterministic approximations for small-noise diffusions with a repulsive critical boundary point.
Contribution
It introduces new semi-deterministic approximation methods for diffusions with small noise near a repulsive boundary, expanding previous theoretical results.
Findings
Extended limit theorem for population diffusion models.
Developed semi-deterministic approximation techniques.
Applicable to diffusions with repulsive boundary points.
Abstract
We extend below a limit theorem of Baker, Chigansky, Hamza and Klebaner (2018) for diffusion models used in population theory.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic processes and statistical mechanics · Mathematical and Theoretical Epidemiology and Ecology Models · Theoretical and Computational Physics
Beyond Wentzell-Freidlin: semi-deterministic approximations for diffusions
with small noise and a repulsive critical boundary point
Florin Avram and Jacky Cresson
F
Abstract
We extend below a limit theorem [3] for diffusion models used in population theory.
\KeysAndCodes
dynamical systems, small noise, linearization, semi-deterministic fluid approximationAMS 60J60
1 Introduction
A diffusion with small noise is defined as the solution of a stochastic differential equation (SDE) driven by standard Brownian motion (defined on a probability space and progressively measurable with respect to an increasing filtration)
[TABLE]
where , , and satisfy conditions ensuring that (1) has a strong unique solution (for example, is locally Lifshitz and satisfies the Yamada-Watanabe conditions [18, (2.13), Ch.5.2.C]). 444For reviews discussing the existence of strong and weak solutions, see for example [9, 17, 12].
When , (1) is a small perturbation of the dynamical system/ordinary differential equation (ODE):
[TABLE]
which will also be supposed to admit a unique continuous solution subject to any , and the flow of which will be denoted by .
A basic result in the field is the “fluid limit", which states that when (1) admits a strong unique solution, the effect of noise is negligible as , on any fixed time interval :
Theorem 1**.**
[Freidlin and Wentzell] [15, Thm 1.2, Ch. 2.1] Let satisfy (1), assume satisfy the Lifshitz condition, and that , where denotes convergence in probability. Then, for any fixed
[TABLE]
where is the solution of (2) subject to the initial condition . 555For other deterministic limit theorems for one-dimensional diffusions, see also Gikhman and Skorokhod [24], Freidlin and Wentzell [15], Keller et al. [21], and Buldygin et al. [10].
Although interesting, this result does not give any understanding of the asymptotic behavior of the diffusion process for times converging to infinity; in particular, it does not tell us how the diffusion travels between equilibrium points (which requires times converging to infinity). Following [6, 3], we go here beyond Theorem 1, by analyzing the way a diffusion process leaves an unstable equilibrium point. Precisely, we make the following assumptions:
Assumption 1**.**
Suppose from now on that , which makes zero an unstable equilibrium point of (2) and of (1).
Note that under Assumption 1, the Freidlin-Wentzell theorem 1 implies that the solution of (1) started from a small positive initial condition converges to zero on any fixed bounded interval
[TABLE]
Assumption 2**.**
Put now , and assume that , which makes [math] a singular point of the diffusion (1)– see for example [12].
Remark 2**.**
Note that rules out important population theory models like the linear Gilpin Ayala diffusion [22] with
[TABLE]
which includes by setting another favorite, the logistic-type Verlhurst-Pearl diffusion [16, 13, 1].
Recently, a new type of limit theorem [3] was discovered when under Assumptions 1, 2, when converges to the unstable equilibrium point of (2). Following [3], let
[TABLE]
denote the solution of the equation where is the flow of the linearized system of (2) in [math], and divide the evolution of the process in three time-intervals:
[TABLE]
(the restriction is used in (25)).
It turns out that this partition allows separating the life-time of diffusions with small noise, exiting an unstable point of the fluid limit, into three periods with distinct behaviors:
In the first stage, the process leaves the neighborhood of the unstable point. The linearization of the SDE implies that here a Feller branching approximation may be used, and this produces a certain exit law which will be carried over to the next stage as a (random) initial condition. 2. 2.
In the second “semi-deterministic stage" (meaning that paths cross very rarely here), the system moves towards its first stable critical point , following the trajectories of its fluid limit (2), again over a time whose length converges to . A further renormalization produces here the main result, the limit exit law (7). 3. 3.
In the third stage, after the SDE has approaches the stable critical point of the fluid limit, “randomness is regained" – see crossings of paths in figures 1 and 2); (if the process may reach and overshoot the stable critical point, convergence towards a stationary distribution may occur).
The following result was obtained first in [3], for the "Kimura-Fisher-Wright" diffusion, and extended subsequently to diffusions with bounded volatility.
Theorem 3**.**
Fluid limit with random initial conditions* [3]. Let satisfy Assumption 1, (1), and . Suppose in addition that the diffusion coefficient is continuous and bounded, as well as its first derivative, and that satisfies the following drift condition:*
[TABLE]
Let denote the solution to the scaled linearized equation
[TABLE]
known as Feller branching diffusion.
Then, it holds that :
- (A)
[TABLE]
where
- (i)
the random variable is the a.s. martingale limit
[TABLE] 2. (ii)
* denotes the limit of the deterministic flow pushed first backward in time by the linearized deterministic flow near the unstable critical point [math]*
[TABLE] 2. (B)
Also, for any ,
[TABLE]
where is the solution of (2) subject to the initial condition .
Remark 4**.**
Note that depends only on the local parameters of the diffusion at the critical point. Assume from now on, without loss of generality that (recalling however that this is the only part of the stochastic perturbation that survives in the limiting regime), and let
[TABLE]
denote the Malthusian parameter.
In the one -dimensional case, the Laplace transform of is well known [23] and easy to compute. Indeed, letting denote the cumulant transform of this branching process, and solving the Riccati-type equation
[TABLE]
yields an explicit expression:
[TABLE]
see, e.g., [23, Ch 4.2, Lem. 5, pg. 24].
One may conclude from the explicit (12) that
[TABLE]
and one may check that is a Poisson sum with parameter of independent exponential random variables
[TABLE]
Remark 5**.**
Computing the limit is a famous problem in the theory of supercritical branching processes. Recall that
*For Galton-Watson processes, satisfies the *Poincaré - Schroeder functional equation
[TABLE]
where is the probability generating function of the progeny **[2, I.10(5), Thm I.10.2]**. 2. 2.
For continuous time branching processes, letting denote the branching mechanism, and denote the functional inverse, it holds that
[TABLE]
see **[2, III.7(9-10), p.112]** and
[TABLE]
For example, for binary splitting with branching mechanism , we find
[TABLE]
with exponential with parameter , and for geometric branching with parameter we find
[TABLE]
The example of -ary fission is also explicit– see **[8, p. 218]** and **[19, p. 119]**.
Problem 1**.**
*Extend the results of [5] from birth-death to Markov discrete space with finite number of transitions upwards and downwards. Solve numerically the Schroeder equation. * 3. 3.
For the continuous state case, letting -\kappa(s)=\ln\Big{(}E[e^{-sW_{\infty}}]\Big{)} denote the logarithm of the Laplace transform and denote the branching mechanism, it holds that
[TABLE]
see **[7, Cor. 4.3]** and also the Appendix, for the multi-type case.
Also **[7, Thm 4.2]**, it holds that the functional inverse satisfies
[TABLE]
For example, for the Feller branching diffusion with branching mechanism , we find
[TABLE]
Remark 6**.**
The main part of Theorem 3 is the equation (7) which identifies the limit after the second stage
[TABLE]
* denotes the flow generated by the SDE (1).*
Note that depends only on the dynamical system . By [3, Prop. 4.1], it is a nontrivial solution of the ODE
[TABLE]
which is equivalent to the Poincaré functional equation
[TABLE]
arising in Poincaré conjugacy relations for dynamical systems. Interestingly, this is the same type of equation as (18), minus the restriction that be a Bernstein function.
The inverse when satisfies (21) is given by
[TABLE]
(21), (22) suggest possible generalizations to multidimensional diffusions (and possibly to jump-diffusions (where a CBI might replace the Feller diffusion in the limit).
Remark 7**.**
Part 2. of Theorem 3 follows immediately by a simple change of time: letting , and one obtains from (1)
[TABLE]
and the result follows from (7) by the fluid convergence Theorem 1. This part may be viewed as describing “short transitions" (invisible on a long time scale) between the second and third stages.
Remark 8**.**
The limit (7) describing the position after the second stage has been established in [3] for one dimensional distributions with bounded . This assumption seems however restrictive, since for typical diffusions whose fluid limit admits a stable critical point , the probability of leaving the neighborhood of the stable point is very small as . This intuition is confirmed by simulations –see Figure 2.
The remark 8 suggests the relation of our problem to that of studying the maximum of .
More precisely, we would like to establish and exploit the plausible fact that
[TABLE]
where is the closest critical point towards which the diffusion is attracted, and is the hitting time of ; clearly, (24) renders unnecessary the assumption that the diffusion coefficient be bounded.
A weaker statement than (24), but still sufficient for a slight extension, is provided in the elementary Lemma (9) below.
Contents. The paper is organized as follows. In Section 2 we offer, based on Lemma 9, a slight extension of Theorem 3 of [3]. A conjecture (see Problem 2) is presented here as well. We illustrate our new result with the example of the logistic Feller diffusion in Section 3. We include for convenience in Section 4 an outline of the remarkable paper [3].
2 An extension of Theorem 3 [3]
Recall now from [3] that the restrictive condition is used for proving that 333Let us recall the proof of this important piece of the puzzle. Let , denote the stochastic and deterministic flows generated respectively by the SDE (1) and ODE (2), put , for brevity, and define . Subtracting equations (1) and (2) and applying the Itô formula:
\displaystyle E\big{(}\delta^{\varepsilon}_{t}\big{)}^{2}=\, \displaystyle E\int_{0}^{t}2\delta_{s}\big{(}\mu(\Phi^{\varepsilon}_{s})-\mu(\phi_{s})\big{)}ds+\int_{0}^{t}\varepsilon E\sigma(\Phi^{\varepsilon}_{s})ds\leq\int_{0}^{t}2\gamma E(\delta_{s})^{2}ds+\varepsilon t\|\sigma\|_{\infty},t\in{\mathbb{R}}_{+}
where assumption (3) was used. By Grönwall’s inequality
\displaystyle E\Big{(}\Phi_{t_{c},t_{1}}(X^{\varepsilon}_{t_{c}})-\phi_{t_{c},t_{1}}(X^{\varepsilon}_{t_{c}})\Big{)}^{2}=\; \displaystyle E\big{(}\delta^{\varepsilon}_{t_{1}-t_{c}}\big{)}^{2}\leq C_{1}\varepsilon t_{1}e^{2\gamma(t_{1}-t_{c})}\leq C_{2}\varepsilon^{2c-1}\log\frac{1}{\varepsilon}\xrightarrow[\varepsilon\to 0]{}0
(25)
where the convergence holds since .
[TABLE]
where .
We will show now that it is possible to remove the condition in (26), if only convergence in probability is needed, by assuming rather weak and natural conditions on the scale function . Recall that the scale function is defined (up to two integration constants) as an arbitrary increasing solution of the equation , where is the generator operator of the diffusion, and that this function is continuous – see [20, Ch. 15, (3.5), (3.6)] (noting that [20] denote the scale function by ).
Lemma 9**.**
Assume that [math] is an attracting boundary and that is an unattracting boundary, i.e. that . Put
[TABLE]
where is defined in (1). Then:
[TABLE]
and
[TABLE]
Proof 2.1**.**
(28) is straightforward. Indeed, recall that the boundary [math] is attracting. Then,
[TABLE]
where are the hitting times of at [math] and – see [20, Ch. 15, (3.1), (3.10)]. Using now the continuity of the scale function [20, Ch. 15, (3.5), (3.6)] (note that [20] denote the scale function by ) yields and the result.
(29) follows by a similar argument. Indeed, denote the deterministic and stochastic flows generated by the ODE (2) and SDE (1) (i.e. the solutions of these equations at time that start at at time ) by and , respectively, and put and for brevity and define . For fixed and , it holds that
[TABLE]
Letting now to [math] makes the first term go to [math] by (26), yielding
[TABLE]
*where we have used again the continuity of the scale function. *
Theorem 10**.**
The conclusions of Theorem 3 still hold under the assumptions of Lemma 9.
Proof 2.2**.**
Theorem 3 of [3] only uses the assumption in establishing the unnecessarily strong result (26). Providing weaker conditions for the weaker but still sufficient result (29) establishes therefore our claim.
Problem 2**.**
Note that essential use of was made in (28). We conjecture however that a finer analysis will reveal that the result of Theorem 10 still holds whenever is “repelling/unattracting", more precisely when it is natural unattracting or entrance, cf. Feller’s classification of boundary points [20, Ch. XV].
3 Examples with : The logistic
Feller and Gilpin-Ayala diffusions
We recall now some famous examples for which the conditions of our Lemma 9 hold. The logistic Feller diffusion is defined by
[TABLE]
The limit point of is a regular point for the diffusion; w.l.o.g. we will take it equal to . The scale density is integrable at [math], but not at , and the speed density [20] is integrable at , but not at [math], so that the conditions of Lemma 9 hold. 444Furthermore, conform Feller’s boundary classification [20], [math] is an exit boundary since is integrable at [math], and absorbtion in [math] occurs with probability 1, and is an entrance (nonattracting) boundary, since is integrable at –see also [11, 4] and [14] for the generalization to continuous-state branching processes with competition.
Therefore, fluid convergence with random initial point before [3] still holds, with the same deterministic flow and random initial condition as for the Kimura-Fisher Wright diffusion studied in [3]
[TABLE]
(since did not change)–see Figure 2.
In fact, the paths of the logistic Feller and Kimura-Fisher-Wright diffusions are almost indistinguishable up to of each other –see Figure 3. After reaching the neighborhood of however, the paths split, reflecting the different natures (regular and exit) of for these two stochastic processes.
Some other examples of interest in population theory are the diffusion processes defined by the SDEs
[TABLE]
which are stochastic extensions with square root volatility of deterministic population models introduced by Gilpin and Ayala and Holling respectively.
It is easy to check that adding the exponents and does not affect integrability of the scale and speed densities of these diffusions, so that our extension applies. Furthermore, the rescaled flow may be computed numerically by [3, Prop. 4.1] (and even symbolically for small integer values of ).
Moving away from the square root volatility case, an interesting, still open question is to investigate whether analogues of the [3] result are available for the processes satisfying dX_{t}=\gamma X_{t}\Big{(}1-\;(\frac{X_{t}}{x_{c}})^{\theta}\Big{)}dt+\sqrt{\varepsilon}(X_{t})^{\alpha}dB_{t},\quad\alpha>0. 444The particular case is the famous Verlhurst-Pearl diffusion (VP)– see for example [22].
4 Sketch of the proof of Theorem 3 [3]
Recall that with , arbitrary, and note that . The idea of the proof is to approximate this random variableby
[TABLE]
with the random variable from (8).
The proof of [3] involves several steps
The first idea for establishing the approximation of is to **blow-up ** the process near the boundary [math]
[TABLE]
which fixes the initial condition to and changes the SDE to
[TABLE]
it is easy to check that a subsequent linearization of the SDE yields
[TABLE]
where is a Feller branching diffusion started from , defined by
[TABLE]
One may take advantage then of the well-known nonnegative martingale convergence theorem for the “scaled final position" of the branching process
[TABLE]
Remark 11**.**
Let us note that the linearization for processes satisfying and failing Assumption 2, like the linear Gilpin-Ayala (3), leads to geometric Brownian motion. In this case, (34) holds with , and a different approach seems necessary. 2. 2.
After “blowing up" the beginning of the path, the second idea is to “look from far away". We want to break the trajectory at a suitably chosen time point
[TABLE]
such that before , the original process is close to Feller’s branching diffusion (33), and convergence to the limit of the Feller diffusion occurs, i.e.
[TABLE]
The first approximation follows from the following lemma [3] showing that the solution of (1) converges, under appropriate scaling, to the Feller branching diffusion (33).
Lemma 12**.**
Let , where is the solution of (1) subject to . Then
[TABLE]
where is the solution of (33).
Putting these together yields 3. 3.
The hardest part is proving that in the second portion , the influence of the stochasticity is negligible, for example that , as proved in [3] under the restrictive assumption .
Putting it all together in one line, one must prove that
[TABLE]
To extend [3], it is sufficient to improve the third approximation step above.
Acknowledgement: We thank J.L. Perez for useful remarks and the referee for the help in improving the exposition.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Alvarez, L., and Hening, A. Optimal sustainable harvesting of populations in random environments. ar Xiv preprint ar Xiv:1807.02464 (2018).
- 2[2] Athreya, K. B., and Ney, P. E. Branching Processes . Springer, Berlin, 1972.
- 3[3] Baker, J., Chigansky, P., Hamza, K., and Klebaner, F. Persistence of small noise and random initial conditions in the wright-fisher model. ar Xiv preprint ar Xiv:1802.06231 (2018).
- 4[4] Bansaye, V., Collet, P., Martinez, S., Méléard, S., and Martin, J. S. Diffusions from infinity. ar Xiv preprint ar Xiv:1711.08603 (2017).
- 5[5] Barbour, A., Chigansky, P., and Klebaner, F. On the emergence of random initial conditions in fluid limits. J. Appl. Probab. 53(4) (2016), 1193–1205.
- 6[6] Barbour, A. D., Hamza, K., Kaspi, H., and Klebaner, F. C. Escape from the boundary in markov population processes. Advances in Applied Probability 47 , 4 (2015), 1190–1211.
- 7[7] Bingham, N. H. Continuous branching processes and spectral positivity. Stochastic Processes and their Applications 4 , 3 (1976), 217–242.
- 8[8] Bingham, N. H. On the limit of a supercritical branching process. Journal of Applied Probability 25 , A (1988), 215–228.
