Higher order asymptotics for large deviations -- Part II
Kasun Fernando, Pratima Hebbar

TL;DR
This paper develops detailed asymptotic expansions for large deviations in continuous-time stochastic processes with weak dependence, including additive functionals of SDEs satisfying Hörmander's condition on compact manifolds.
Contribution
It provides the first comprehensive asymptotic expansion of all orders for large deviations in this class of stochastic processes.
Findings
Asymptotic expansions are derived for processes with weakly dependent increments.
Additive functionals of Hörmander SDEs on compact manifolds admit these expansions.
The results extend large deviation principles to higher-order asymptotics.
Abstract
We obtain asymptotic expansions for the large deviation principle (LDP) for continuous time stochastic processes with weakly dependent increments. As a key example, we show that additive functionals of solutions of stochastic differential equations (SDEs) satisfying H\"ormander condition on a dimensional compact manifold admit these asymptotic expansions of all orders.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Higher order asymptotics for large deviations – Part II
Kasun Fernando, Pratima Hebbar
Pratima Hebbar
Department of Mathematics
University of Maryland
4176 Campus Drive
College Park, MD 20742-4015, United States.
Kasun Fernando
Department of Mathematics
University of Maryland
4176 Campus Drive
College Park, MD 20742-4015, United States.
Abstract.
We obtain asymptotic expansions for the large deviation principle (LDP) for continuous time stochastic processes with weakly dependent increments. As a key example, we show that additive functionals of solutions of stochastic differential equations (SDEs) satisfying Hörmander condition on a –dimensional compact manifold admit these asymptotic expansions of all orders.
Key words and phrases:
large deviations, asymptotic expansions, weakly dependent increments, stochastic processes, hypoellipticity
2010 Mathematics Subject Classification:
60F10, 60G51, 60H10
1. Introduction
Suppose is a sequence of centred random variables and . In the case when is a independent, identically distributed (iid) sequence of random variables with exponential moments, Cramér’s Large Deviation Principle states that the tail probabilities of decay exponentially fast. It is natural to ask if this could be made more precise by finding the exact asymptotics.
The first rigorous treatment of exact large deviation asymptotics for in the case when is an iid sequence of random variables, was done by Cramér in [1] assuming the existence of an absolutely continuous component in the distribution of . In the a non-iid setting, in [2], the pre–exponential factor is obtained under a decay condition on the Fourier–Laplace transform of the distribution of . For a detailed overview of results in this direction, we refer the reader to our earlier paper [3].
In [3], we show that under a set of natural conditions sums of weakly dependent random variables admit asymptotic expansions for the LDP. In this paper, we extend the results in [3] by obtaining asymptotic expansions for the LDP for continuous time stochastic processes.
Definition 1.1** (Strong Asymptotic Expansions for LDP).**
Let be a stochastic process with asymptotic mean zero, i.e., . Suppose that, for some , for each , the asymptotic expansion for the distribution function of is of the form:
[TABLE]
where, the denotes the rate function, and are constants. Then, we refer to (1.1) as the strong expansion for LDP of order in the range .
Definition 1.2** (Weak Asymptotic Expansions for LDP).**
Let be a stochastic process with asymptotic mean zero. Let be a normed space of functions defined on . Then admits weak asymptotic expansion of order for large deviations in the range for if there are functions depending on for such that for each ,
[TABLE]
where, the denotes the rate function.
In Section 3, by proving a key proposition (Proposition 2.1), we show that the proofs in the discrete time can be adapted to obtain the strong expansions for LDPs for stochastic processes with weakly dependent increments.
We then apply our continuous time results to study additive functionals of diffusion processes satisfying Hörmander’s condition on a –dimensional compact manifold. In Section 4, we show that the additive functionals of such diffusion processes have weakly dependent increments. That is, they satisfy the conditions detailed in Section 2 that guarantee the existence of strong expansions for LDPs. The motivation for focusing on this example comes form the work on branching diffusions in periodic media done (see [4]), and from the large deviation problems for coupled stochastic differential equations studied in [5] and [6].
Now, we make a few remarks about the relationship between the setting in [4] and the setting here. First observe that each coordinate of the location of a particle undergoing a diffusion process in periodic media, (described in [4], setting the branching term equal to zero) can be viewed as an additive functional of a diffusion process on a dimensional torus. That is, suppose is the diffusion process generated by the following partial differential operator on ,
[TABLE]
Then, viewing as taking values in , we can write as
[TABLE]
for each . Therefore, the analysis of diffusion processes in periodic media in the large deviation domain, done in [4] to obtain the exact asymptotics for LDPs, is closely related to the question we pose in this paper. In the setting detailed in Section 4 of this paper, we assume that denotes the solution of a SDE (driven by a dimensional Wiener process ) that satisfies Hörmander’s Hypoellipticity condition (as opposed to ellipticity condition, satisfied in [4]) on a arbitrary dimensional smooth compact manifold, and we assume that is an additive functional of such that
[TABLE]
where the Wiener process is independent of , is non-degenerate for each , and are Lipschitz continuous. The difference between (1.3) and (1.4) is that in (1.4) the Wiener process is independent of , while in (1.3) the process and have the same underlying dimensional Wiener process (in it is viewed as a Wiener process on the dimensional torus while in it is viewed as a Wiener process on ). However, in this paper, under this stronger requirement of independence of the Weiner processes, we obtain higher order terms of the asymptotic expansion, as opposed to just the first term that was obtained in [4].
2. Overview and main results.
Let be a stochastic process with asymptotic mean zero, i.e.,
[TABLE]
Suppose that there exists a Banach space , a family of bounded linear operators , and vectors such that
[TABLE]
for for which the conditions and and (which are detailed below) are satisfied and the family of operators forms a –semigroup on the Banach space . That is
[TABLE]
and
[TABLE]
where the above limit is with respect to the operator norm.
Condition (D1) The family of operators satisfies the condition (from [3]), uniformly in . That is,
- (1)
There exists such that the following conditions hold for all :
- (B1)
is continuous on the strip Re and holomorphic on the disc .
- (B2)
For each , the operator has an isolated and simple eigenvalue and the rest of its spectrum is contained inside the disk of radius smaller than (spectral gap). In addition, .
- (B3)
For each , for all real numbers , the spectrum of the operator , denoted by sp, satisfies: 2. (2)
For each , there exist positive numbers and such that
[TABLE]
for all , for all .
Condition (D2) Suppose is such that, for all , has an isolated simple eigenvalue . Then the projection to the top eigenspace, , satisfies for all .
We denote by . Using the above condition, along with the semigroup property, we conclude that for each , the top eigenvalue of the operator (whenever it exists) is equal to .
Due to (D1), the operators with and take the form
[TABLE]
where is the eigenprojection corresponding to the eigenvalue of the operator and . Due to (D1) we can use the perturbation theory of linear operators (see [7, Chapter 7]) to conclude that , and are analytic.
As a consequence of (2.2) and condition (D2), the family of operators defined as also forms a semigroup, and the spectral radius of the operator is less than for all .
Condition (D3) For all , and for all ,
[TABLE]
Space of functions :
In order to state our main results, we introduce the function space (that are introduced in [3]) given by
[TABLE]
where . We call a function (left) exponential of order , if . Define the function space by
[TABLE]
It is clear that if . Finally, define, .
The following proposition, which will be proved in 3, is the key idea in adapting the proofs of discrete time results from [3] to continuous time.
Proposition 2.1**.**
Suppose that the conditions and hold. Then, for a fixed , there exists such that, for each , for each , the operator has a simple top eigenvalue and
[TABLE]
where is the eigenprojection corresponding to the eigenvalue and . In addition, the family of operators satisfies for all and the spectral radius of the operator is less than .
The following theorems are the continuous time analogues of the discrete time results, Theorem 2.1, Theorem 2.2 and Theorem 2.3 from [3], respectively. We do not repeat the proofs of Theorems 2.2, 2.3 and 2.4 in our current continuous time setting, since the proofs are completely analogous to those in [3]. The crucial point, however, is that the continuous time results require the use of Proposition 2.3 which we prove in the next section.
Theorem 2.2**.**
Let . Suppose that conditions and hold. Then, for all a\in\Big{(}0,\frac{\log{\lambda(\delta)}}{\delta}\Big{)}, there exist and polynomials of degree at most , such that for and , for all
[TABLE]
where and
Theorem 2.3**.**
Let , . Suppose that conditions and hold with . Then, for each a\in\Big{(}0,\frac{\log{\lambda(\delta)}}{\delta}\Big{)}, there exist constants such that
[TABLE]
where, the rate functional is defined as
[TABLE]
The following theorem shows that, under a set conditions weaker than those required in the above two theorems (namely, without requiring the condition ), the exact asymptotics for the LDP can be obtained (that is, the first term of the asymptotic expansion, including the pre-exponential factor).
Theorem 2.4**.**
Suppose that and hold. Then, for each a\in\Big{(}0,\frac{\log{\lambda(\delta)}}{\delta}\Big{)},
[TABLE]
3. Proofs of the main results
Proof of Proposition 2.1.
Let and be fixed. Consider the two parameter perturbation of the operator of the form . From condition (D1), for a fixed , is holomorphic on the disc and for each fixed , the family of operators forms a –semigroup. In addition, the two parameter operator is uniformly bounded on the region . From here, using the Cauchy integral formula for analytic functions it is clear to see that this two parameter perturbation is continuous. Hence, by perturbation theory, for each , there exists such that, on the set ,
[TABLE]
where is the projection on the top eigenfunction of the operator corresponding to the simple top eigenvalue and
[TABLE]
In addition, the spectral radius of is less than .
Since the interval is compact, we can choose such that the set contains the interval . Put . Thus, for all and such that ,
[TABLE]
and the spectral radius of is less than .
Put . From (D2) we know that for all and . This, along with the semigroup property of the operators , implies that for all for all , . To see this, first note that we do not assume that the top eigen-value for the operator exists for . Now, if is rational, we have for some . Let be a non-zero vector be such that for all . Then we have,
[TABLE]
Therefore, for all rational . Since, the semigroup is continuous in , we have that the top eigenvalue is continuous in , and therefore, the relation holds for all .
For , define the new family of operators . It is clear to see from this definition that for all . Then, using the fact that , we have
[TABLE]
Here, the spectral radius of the operator is less than . This concludes the proof of Proposition 2.1. ∎
Remark 3.1**.**
Our equation (2.3) is the continuous time analogue of equation from [3]. This, along with assumption , allows us to obtain proofs of Theorems 2.2, 2.3 and 2.4 by replacing the discrete time steps by and replacing by
[TABLE]
in the proofs of the corresponding discrete time results from [3].
4. SDEs satisfying Hörmander Hypoellipticity condition
Let be a compact dimensional smooth manifold and be a collection of smooth vector fields of such that satisfies the Hörmander Hypoellipticity condition, i.e., the Lie algebra generated by evaluated at spans the tangent space at each .
Let be the dimensional Wiener process with components for . Let be the process on , and be the process on satisfying the coupled SDEs,
[TABLE]
[TABLE]
where the real valued function and the real valued function are smooth and is a dimensional Wiener process independent of the dimensional Wiener process , and is non-degenerate, i.e, for each .. The right hand sides of and (4.2) are interpreted in the Stratonovich sense. Observe that, in (4.2), it is equivalent to consider the Itô or the Stratonovich sense, since the coefficient of the Wiener process is independent of . Note that the distribution of for each is absolutely continuous by Hörmander’s theorem.
Theorem 4.1**.**
Under the above assumptions, for all ,
* admits the weak expansion of order in the range for with and suitable depending on and* 2.
* admits the strong expansion of order in the range .*
Proof.
The infinitesimal generator of the joint Markov process is a partial differential operator acting on functions defined on given by
[TABLE]
where is the matrix formed by the vectors as columns.
Let be the invariant density of the process on , that is, is the density of a measure defined on , satisfying
[TABLE]
We assume that
[TABLE]
The above condition guarantees that the asymptotic mean of the random process is zero, since
[TABLE]
We also observe that, from the Kolmogorov Forward Equation, the transition density for the Markov process is given by , and it satisfies the PDE
[TABLE]
Let be the Banach space of complex valued continuous functions defined on equipped with the supremum norm. Define, for each , , the bounded linear operator given by
[TABLE]
where the right hand side clearly does not depend on . That is, for the constant function , and the measure (the space of bounded linear functionals on ) we have
[TABLE]
The family of operators forms a semigroup since
[TABLE]
Now we will verify conditions , and from Section 2 for the family of operators . To verify condition , we will show that hold uniformly on and show that (2.1) holds.
Condition (B1)** We first observe that the map is infinitely differentiable in for all . Indeed, for each , , and , . We know that is a stochastic process on with bounded diffusion and drift coefficients, which implies that has all exponential moments. Hence, is a well defined bounded linear operator on for all and .**
Note that is a compact operator on since, if we define
[TABLE]
then, for any , , where is positive and continuous in . We note that is the top eigenvalue of with constant functions forming the eigenspace. All the other eigenvalues of have absolute values less than 1, by the Perron–Frobenius theorem.
**We note that if , then for all . This kernel is continuous in . That is, is a positive, compact operator for all . Thus Condition (B1) is satisfied uniformly on .
Condition (D2): We observe that the coefficients of the operator are independent of the time variable , and therefore the Markov process is time homogeneous. Thus, the top eigenspace of the operators is the same for all . Thus, for all , in particular, Condition (D2) is satisfied.
Condition (B2) Using (D2) and the semigroup property, condition (B2) is satisfied since there exists a for all , the top eigenvalue of the operator exists, and other eigenvalues of have absolute values less than .
Condition (B3) We need to show that we have sp. We first note that**
[TABLE]
[TABLE]
Thus sp. To prove that there is inclusion with strict inequality, using the fact that the top eigenvalue of the operator is , it is enough to show that sp. We suppose, on the contrary, that there exists an eigenfunction of the operator , with corresponding to the eigenvalue such that . That is, for all ,
[TABLE]
We know is the top eigenvalue of the operator . Thus, there exists an eigenfunction of , corresponding to the eigenvalue , which implies that for all ,
[TABLE]
Note that we can assume that, for all , , and that . In addition, we can assume that there exists a point such that . Now,
[TABLE]
Thus,
[TABLE]
This implies that
[TABLE]
and therefore,
[TABLE]
We have from our assumption that , and we know that is a positive operator. We conclude that,
[TABLE]
Now,
[TABLE]
From the definition of , we know that, for a fixed , , . Therefore, for all , . Thus, there exists a continuous function defined on such that for all . Substituting this in , we get
[TABLE]
[TABLE]
where the last equality follows from equation . In addition, since , there exists a constant such that . Therefore,
[TABLE]
This implies that whenever ,
[TABLE]
**This is impossible since the Brownian motion (in the definition of ) is independent of (in the definition of ). Thus, sp, which implies sp.
Condition (D2)-2 Let be fixed. Let be such that and for all . Then we also have for all , since condition (D2) holds. In addition, since is a positive operator, the eigenfunction is positive. We observe that satisfies the PDE for all , , where . Since the coefficients of the operator are differentiable in , the function is differentiable in .**
We first consider a new family of operators defined by
[TABLE]
where and
[TABLE]
Let denote the function that takes the value for all . Note that
[TABLE]
Hence, is an eigenfunction for the operator corresponding to the top eigenvalue .
Observe that the operators and satisfy, for all ,
[TABLE]
It is easy to see that the new family of operators also forms a semigroup. Thus, in order to prove (2.1), we need to show that there exist positive numbers and such that
[TABLE]
for all , for all . In fact, it will be enough to show that there exists an such that, for all and for all ,
[TABLE]
since the above relation would imply that, for all ,
[TABLE]
showing exponential decay.
We observe that for any , and ,
[TABLE]
where,
[TABLE]
ans therefore, it is enough to show that there exists an and such that for all , and for all ,
[TABLE]
Let denote the sigma algebra generated by the process . Note that the following equality holds,
[TABLE]
We know that \Big{\{}e^{\int_{0}^{t}(\theta+is)\sigma(X_{u})\,d\widetilde{W}_{u}-\frac{1}{2}\int_{0}^{t}(\theta+is)^{2}\sigma^{2}(X_{u})\,du}\Big{|}\mathcal{F}_{t}\Big{\}} forms a martingale for all . Therefore,
[TABLE]
Let . Since , are smooth on the compact manifold , and for all , for a fixed , we can choose such that for all , ,
[TABLE]
Note that the quantities and are strictly positive and finite due to condition (B2) and the fact that eigenfunction is strictly positive on . Therefore,
[TABLE]
**As a result . This implies that for all , , , which concludes the proof of condition (D1).
Condition (D3): First, observe that . Now, that the top eigenvalue of operators is . Thus, it is enough to show that is twice continuously differentiable and the second derivative is positive for all . Let .**
Let be fixed. We know that the function is such that
[TABLE]
Let be a linear functional in satisfying for all , and . Let us define a new operator , which is the derivative of the operator with respect to . Thus,
[TABLE]
We differentiate equation (4.10) on both sides with respect to to obtain
[TABLE]
Therefore, applying the linear functional on both sides, we obtain,
[TABLE]
which simplifies to
[TABLE]
Thus, we obtain the following formula for .
[TABLE]
Differentiating the equation (4.11) again with respect to and taking the action of the linear functional on both sides, we obtain,
[TABLE]
Thus, rearranging the terms, we obtain the following formula for :
[TABLE]
Using the formula for in the above expression we obtain
[TABLE]
Let be the Banach space of bounded continuous functions defined on equipped with the supremum norm. We define a new family of bounded linear operators , by
[TABLE]
for each . Note that the family forms a semigroup.
We first observe that the operators are positive, and , where denotes the constant function taking the value on .
The operator is also an operator on because, for ,
[TABLE]
[TABLE]
Now, corresponding to this family of operators, we have a new Markov process on , such that, . In addition, we observe that for all . That is, is the invariant measure for the process on the manifold for all .
Let us define the function by for all . Now, we re-write the formula (4.13) for as
[TABLE]
Therefore, we have,
[TABLE]
Denoting by , the above formula can be written as
[TABLE]
[TABLE]
Now, in order to prove that , we first show that the first term in (4.15) is the effective diffusivity of the process , which is strictly positive. Then we prove that that the second term in (4.15) goes to zero as goes to infinity, since the processes and de-correlate as as goes to infinity.
In order to analyze the process , we first study the transition kernel of the associated Markov Operator . For ,
[TABLE]
where
[TABLE]
From (4.4), we see that solves the PDE
[TABLE]
[TABLE]
where, we have a new differential operator acting on functions given by
[TABLE]
Observe that
[TABLE]
From the choice of , we know that . That is,
[TABLE]
Therefore, the above expression simplifies to
[TABLE]
Thus, the operator simplifies to
[TABLE]
From the above expression of the generator of the new process , we conclude that the process differ from the process only by the additional drift terms in and . The Effective Diffusivity of the process is given by
[TABLE]
We now show that the effective diffusivity of the process is also strictly positive. Let be given by,
[TABLE]
Choose a function such that on . The existence of such a function is guaranteed because . The process forms a martingale, and therefore,
[TABLE]
Thus,
[TABLE]
Also, note that
[TABLE]
Therefore, using the fact that is the invariant measure of the process on , we have,
[TABLE]
**Since for all , we have .∎
Thus we have shown that, the first term in (4.15) is positive. Now it remains to show that the limit of the second term in is zero as approaches infinity. In other words, the processes and de-correlate as as goes to infinity. Thus, we need to show**
[TABLE]
First, we observe that
[TABLE]
[TABLE]
Therefore,
[TABLE]
Thus, we only need to show that
[TABLE]
that is, to show that
[TABLE]
Since , there exists a constant such that
[TABLE]
Using Cauchy- Schwartz inequality, and the upper bound on , stated above, we have
[TABLE]
Therefore, we have,
[TABLE]
We have shown that the conditions (D1), (D2) and (D3) hold with arbitrarily large. As a result, for all , admits the weak and strong expansion for LDP of order in the range .
∎
Acknowledgement
The authors would like to thank Dmitry Dolgopyat and Leonid Koralov for useful discussions and suggestions during the project and carefully reading the manuscript. While working on this article, P. Hebbar was partially supported by the ARO grant W911NF1710419.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Cramér H. Sur un nouveau theorémè-limite de la thèorie des probabilités. Actualités scientifiques et industrielles , 736:2–23, 1938.
- 2[2] N. R. Chaganty and J. Sethuraman. Strong large deviation and local limit theorems. The Annals of Probability , 21(3):1671–1690, 1993.
- 3[3] K. Fernando and P. Hebbar. Higher order asymptotics for large deviations – part i. ar Xiv:1811.06793 [math.PR] , 2018.
- 4[4] Hebbar P., Koralov L., and Nolen J. Branching diffusion processes in periodic media. preprint , 2019.
- 5[5] A.Y Veretennikov. Lower bound for large deviations for an averaged sde with a small diffusion. Russian J. Math. Phys. no. 1 , 5.
- 6[6] R. Liptser. Large deviations for two scaled diffusions. Probab. Theory Relat. Fields , 106:71–104, 1996.
- 7[7] T. Kato. Perturbation theory for linear operators - Classics in Mathematics . Springer-Verlag, Berlin, reprint of the 1980 edition, 1995.
