High minima of non-smooth Gaussian processes
Zhixin Wu, Arijit Chakrabarty, Gennady Samorodnitsky

TL;DR
This paper investigates the asymptotic behavior of the minimum values of non-smooth Gaussian processes over compact intervals, linking large deviation estimates with the small-ball problem and analyzing the distribution of the minimum's location.
Contribution
It establishes new connections between large deviation estimates and the small-ball problem for non-smooth Gaussian processes, and studies the distribution of the minimum's location.
Findings
Asymptotic estimates for the minimum of non-smooth Gaussian processes.
Relation between large deviation behavior and the small-ball problem.
Distribution of the minimum's location conditioned on high thresholds.
Abstract
In this short note we study the asymptotic behaviour of the minima over compact intervals of Gaussian processes, whose paths are not necessarily smooth. We show that, beyond the logarithmic large deviation Gaussian estimates, this problem is closely related to the classical small-ball problem. Under certain conditions we estimate the term describing the correction to the large deviation behaviour. In addition, the asymptotic distribution of the location of the minimum, conditionally on the minimum exceeding a high threshold, is also studied.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFinancial Risk and Volatility Modeling · Stochastic processes and financial applications · Stochastic processes and statistical mechanics
High minima of non-smooth Gaussian processes
Zhixin Wu
Shanghai Jiatong University
800 Dongchuan RD
Minhang District
Shanghai, China
,
Arijit Chakrabarty
Theoretical Statistics and Mathematics Unit
Indian Statistical Institute
203 B.T. Road
Kolkata 700108, India
and
Gennady Samorodnitsky
School of Operations Research and Information Engineering
and Department of Statistical Science
Cornell University
Ithaca, NY 14853
Abstract.
In this short note we study the asymptotic behaviour of the minima over compact intervals of Gaussian processes, whose paths are not necessarily smooth. We show that, beyond the logarithmic large deviation Gaussian estimates, this problem is closely related to the classical small-ball problem. Under certain conditions we estimate the term describing the correction to the large deviation behaviour. In addition, the asymptotic distribution of the location of the minimum, conditionally on the minimum exceeding a high threshold, is also studied.
Key words and phrases:
Gaussian process, high excursions, minima
1991 Mathematics Subject Classification:
Primary 60G15, 60F10. Secondary 60G70.
Chakrabarty’s research was partially supported by the MATRICS grant of the the Science and Engineering Research Board, Government of India. Samorodnitsky’s research was partially supported by the ARO grant W911NF-18 -10318 at Cornell University.
1. Introduction
Let {\bf X}=\bigl{(}X(t),\,t\in{\mathbb{R}}\bigr{)} be a centered Gaussian process with continuous sample paths. For a compact subinterval of the real line we are interested in the right tail of the random variable . This is a complicated object; see e.g. Guliashvili and Tankov (2016) and Adler et al. (2014). On the logarithmic scale, however, this tail can be described as follows:
[TABLE]
where
[TABLE]
with the covariance function of the process and the set of all Borel probability measures on ; see Theorem 5.1 in Adler et al. (2014). The quantity in (1.2) is strictly positive whenever the tail probability in (1.1) is strictly positive for . In order to obtain more precise results on the right tail of the minimum than (1.1), additional assumptions on the process , in addition to its continuity, are needed. In Chakrabarty and Samorodnitsky (2018) such additional assumptions guarantee that the process is very smooth. Under these assumptions the optimization problem (1.2) has a unique optimal solution, a probability measure whose support is a finite set. If is the cardinality of that set, then (under a non-degeneracy assumption),
[TABLE]
for some .
Our goal in this paper is to obtain results on the asymptotics of the right tail of the Gaussian minimum, more precise than the logarithmic asymptotics (1.1), when the process is not so smooth as to satisfy the assumptions of Chakrabarty and Samorodnitsky (2018) (and, hence, also (1.3)). Such more precise asymptotics are, clearly, related to the support of the optimal measure in (1.2), so the next Section 2 describes certain situations where information on the optimal measure or, at least, on its support, is available. The more precise asymptotic results on the tail of the minima are in Section 3; the results are the most precise in the Markovian case. In Section 4 we show that, in many cases, the law of the location of the minimum of a non-smooth Gaussian process, given that the minimum is high, converges, as the height of the minimum increases, to the minimizer in the optimization problem (1.2). We conclude with examples in Section 5.
2. The optimal measure and its support
When a Gaussian process is very smooth, optimal measures in the optimization problem (1.2) are supported by finite sets; see Chakrabarty and Samorodnitsky (2018). On the other hand, processes whose sample paths are sufficiently “rough” may lead to optimal measures with large supports, For example, if is the stationary Ornstein-Uhlenbeck process, with covariance function , then the optimal measure in (1.2) is
[TABLE]
where is a point mass at , and is the uniform probability distribution on the interval ; see Example 6.2 in Adler et al. (2014). In this case the optimal measure has a full support in the interval . We now demonstrate other situations where this phenomenon holds.
We start with considering certain stationary Gaussian processes, in which case we will use the standard single variable notation for the covariance function , . By stationarity it is enough to take and consider intervals of the type , .
Theorem 2.1**.**
Let {\bf X}=\bigl{(}X(t),\,t\in{\mathbb{R}}\bigr{)} be a centered stationary Gaussian process with continuous sample paths and covariance function . Suppose that is strictly convex on . Then the optimization problem (1.2) has a unique optimal probability measure, which has a full support in the interval .
Proof.
By Polya’s theorem, the spectral measure of the process has an absolutely continuous component which is of full support on ; see e.g. Lukacs (1970). Then there is a unique optimal probability measure in the optimization problem (1.2); see Adler et al. (2014). Furthermore, the strict convexity of the covariance function implies that it is strictly decreasing on .
Note that the support of the optimal probability measure cannot consist of a single point, for in that case the value of the double integral in (1.2) is , while any two-point probability measure would give a strictly smaller integral. We show now that endpoints [math] and of the interval belong to the support. By symmetry it is enough to prove that is in the support of .
Suppose that, to the contrary, for some we have \nu_{*}\bigl{(}[b-\varepsilon,b]\bigr{)}=0, and let be the right-most point of the support of . Then . Choosing, if necessary, a smaller we can assure that and that \nu_{*}\bigl{(}[0,c-\varepsilon)\bigr{)}>0. Construct now a new probability measure, by translating the positive mass of in the interval to the interval . By the strict monotonicity of the covariance function,
[TABLE]
contradicting the optimality of the measure .
Hence, the endpoints of the interval are in the support of , and we proceed to prove that the support of is the entire interval . Suppose that, to the contrary, there are points , both in the support of , such that \nu_{*}\bigl{(}(c_{1},c_{2})\bigr{)}=0. Denote
[TABLE]
The optimality of the measure implies that (the optimal value of the double integral in (1.2)) for all , with equality on the support of ; see Theorem 4.3 in Adler et al. (2014). Note that on the interval this function,
[TABLE]
is strictly convex by the assumptions. Since , this rules out the possibility that for . The resulting contradiction completes the proof of the theorem. ∎
For certain nonstationary Gaussian processes the optimization problem (1.2) can be explicitly solved. Here is one such situation. Let \bigl{(}B(t),\,t\geq 0\bigr{)} be the standard Brownian motion, and . Consider a centered Gaussian process of the form
[TABLE]
where is a continuous function.
Theorem 2.2**.**
(a) Suppose that is a nondecreasing concave and twice continuously differentiable function on . Define
[TABLE]
[TABLE]
[TABLE]
Then the finite measure on defined by
[TABLE]
is equal, up to a multiplicative constant, to an optimal solution to the optimization problem (1.2).
(b) Suppose that is concave on , and nondecreasing and twice continuously differentiable on , for some such that . If is as in part (a), and
[TABLE]
then the finite measure on defined by
[TABLE]
is equal, up to a multiplicative constant, to an optimal solution to the optimization problem (1.2).
Proof.
Observe that the covariance function of the process is given by
[TABLE]
With the measure defined by (2.2),
[TABLE]
for each . By Theorem 4.3 in Adler et al. (2014) this implies the claim of part (a).
For part (b) note that by the above argument we already know that
[TABLE]
for all . Appealing, once again, to Theorem 4.3 in Adler et al. (2014) we see that the claim of part (b) will follow once we check that the value of the integral in (2.4) is at least 1 for . For such ,
[TABLE]
Since by concavity of ,
[TABLE]
we conclude that
[TABLE]
which gives the required lower bound on the integral of the covariance function. ∎
Remark 1**.**
It is clear that the assumption of continuous second derivative of the function in Theorem 2.2 can be replaced by the assumption of absolutely continuous first derivative, in which case the function in the statement of the theorem is simply a nonpositive derivative of in the sense of absolute continuity. **
3. Tails of the minima
In this section we describe certain situations in which we can give more precise asymptotics of the tail of the minimum of a Gaussian process beyond the logarithmic asymptotics in (1.1). In these situations the smoothness assumptions of Chakrabarty and Samorodnitsky (2018) are not satisfied, and asymptotics of the type (1.3) are no longer applicable. Our most precise results apply to Gaussian Markov processes, of which the processes of the type defined in (2.1) are a special case.
Theorem 3.1**.**
Let be a centered Gaussian Markov process with continuous sample paths, such that an optimal measure in the optimization problem (1.2) has an absolutely continuous component , whose density with respect to the Lebesgue measure has a version with
[TABLE]
Then
[TABLE]
Proof of Theorem 3.1.
We will use the following easily checkable fact (which also follows from Theorem 4.12.11 (iii) of Bingham et al. (1987)): if is a bounded measurable function such that
[TABLE]
for some , then there exists such that
[TABLE]
Denote
[TABLE]
Since has full support, it follows that
[TABLE]
see e.g. p.8 in Chakrabarty and Samorodnitsky (2018). With
[TABLE]
wee see that and \bigl{(}Z(t),\,t\in[a,b]\bigr{)} are independent. Since
[TABLE]
it follows that
[TABLE]
Therefore, for ,
[TABLE]
We will prove that
[TABLE]
By (3.3) with this will prove the lower bound in the statement of the theorem. However, if and are the smallest and the largest values, respectively, of on , then, as ,
[TABLE]
for some . The asymptotic equivalence in the last line has been shown in Li (2001). Thus, (3.5) follows.
In order to prove the upper bound in the statement of the theorem, we use a change of measure. Let be the closed in linear span of the process . For every , the function f_{Z}(t)=E\bigl{(}ZX(t),\,a\leq t\leq b\bigr{)} belongs to the reproducing kernel Hilbert space of and, hence, the probability measures \bigl{(}X(t),\,a\leq t\leq b\bigr{)} and \bigl{(}X(t)+f_{Z}(t),\,a\leq t\leq b\bigr{)} generate on are equivalent. Furthermore, in the obvious notation,
[TABLE]
see van der Vaart and van Zanten (2008). In particular, for every such ,
[TABLE]
With as in (3.4) we choose . Since has a full support, we have for all . By (3.6),
[TABLE]
Next,
[TABLE]
Appealing, once again, to Li (2001), we have, by (3.1) ,
[TABLE]
for some . In conjunction with (3.7) this establishes the upper bound in the theorem. ∎
It is clear from the proof of Theorem 3.1 that there is a close connection between the improvements on the logarithmic asymptotics (1.1) of the minima of Gaussian processes and small ball problems for these processes. Availability of bounds on small ball probabilities is often helpful in obtaining bounds on the tail of the Gaussian minimum. The following theorem is another example of this.
Theorem 3.2**.**
Let be a centered Gaussian process with continuous sample paths, such that an optimal measure in the optimization problem (1.2) has a full support in . Suppose that there exists a function satisfying
[TABLE]
for some , such that such that
[TABLE]
Then,
[TABLE]
where is as in (1.2), and should not be confused with the of (3.8).
Proof.
An argument identical to the proof of the lower bound in Theorem 3.1 gives us
[TABLE]
Since by the assumption (3.8) we have, for some ,
[TABLE]
by Theorem 4.1 in Li and Shao (2001), the claim of the theorem follows from (3.3). ∎
4. The location of the minimum
For a continuous centered Gaussian process {\bf X}=\bigl{(}X(t),\,t\in{\mathbb{R}}\bigr{)} consider the location of the minimum of the process on an interval :
[TABLE]
where we choose the leftmost location of the minimum in case there are ties. For very smooth Gaussian processes considered in Chakrabarty and Samorodnitsky (2018) it was proved that, as ,
[TABLE]
with the unique minimizer in the optimization problem (1.2). In that case the latter optimal measure is always supported by a finite set. Our goal in this section is to show that (4.1) continues to hold for Gaussian processes whose sample paths are not smooth, and for which the optimal measure may have full support.
Theorem 4.1**.**
Let {\bf X}=\bigl{(}X(t),\,t\in{\mathbb{R}}\bigr{)} be a centered stationary Gaussian process with continuous sample paths and covariance function . Suppose that is strictly convex on . Then (4.1) holds with and any , where is the unique optimal probability measure for the the optimization problem (1.2).
Proof.
The fact that the optimization problem (1.2) has a unique optimal solution was established in Theorem 2.1. We use (3.7) (with ). Let be a Borel set that is a continuity set for . Recalling the notation (3.4) we obtain
[TABLE]
By Fubini’s theorem this can be rewritten in the form
[TABLE]
and so it is enough to prove that
[TABLE]
If we denote by the probability measure described by the right hand side of this statement, then we need to prove that
[TABLE]
To this end, we use a discrete approximation. Let {\mathcal{P}}_{k}=\bigl{\{}bi2^{-k},\,i=0,1,\ldots,2^{k}\bigr{\}} be the th binary partition of the interval , . For each we consider the following restricted version of the optimization problem (1.2):
[TABLE]
where the probability measures are required to be supported by the finite set . As in the case of the full optimization problem (1.2), the fact that the spectral measure of the process is of full support guarantees that the problem (4.3) has a unique optimal solution, which we will denote by . We also denote by the corresponding value of the double integral. The same argument as in the case of the restricted optimization problem shows that, because of strict convexity of , assigns a positive mass to each point in .
Clearly, . On the other hand, the obvious discretizations of the measure produce a sequence of probability measures , such that as . By continuity,
[TABLE]
as , so by the optimality of the measures we conclude that . We claim that . Since the space is weakly compact, it is enough to prove that every subsequential limit of the sequence is equal to . However, for every subsequence of of the sequence the value of the double integral in the optimization problem (1.2) converges to and, by weak continuity of the double integral, it also converges to the double integral with respect to the subsequential limit. Since under the assumptions of the theorem the optimization problem (1.2) has a unique optimal solution, we conclude that every subsequential limit of the sequence is equal to .
Define, analogously to (3.4),
[TABLE]
and let
[TABLE]
once again choosing the leftmost location in the case of a tie. For each we define a probability measure on by
[TABLE]
It is clear that and a.s. Furthermore, in . Furthermore, the distribution of is atomless (see Lemma 1 in Ylvisaker (1965)). We conclude that, for each fixed , as . It follows that the claim (4.2) will follow if we prove that
[TABLE]
Consider the zero mean Gaussian random vector {\bf X}^{(k)}=\bigl{(}X(bi2^{-k}),\,i=0,1,\ldots,2^{k}\bigr{)}. Let denote its covariance matrix. The uniqueness of the minimizing measure implies that the vector has full support, so is invertible. For any we can write
[TABLE]
where
[TABLE]
. It is straightforward to compute that
[TABLE]
Therefore, if we prove that
[TABLE]
uniformly on , then we obtain uniform convergence in (4.4) (even in total variation).
To this end, let , so that
[TABLE]
Let . The vector is equal, up to a multiplicative scale, to the probability vector of the measure ; see Chakrabarty and Samorodnitsky (2018). Therefore,
[TABLE]
so that
[TABLE]
In particular,
[TABLE]
on . We conclude that
[TABLE]
Since , for all large enough we have , and we have obtained the desired uniform convergence, thus completing the proof. ∎
5. Examples
In this section, the results in Sections 2 - 4 are applied to two examples. The first example illustrates applications of Theorems 2.2 and 3.1.
Example 0
Let be a standard Brownian motion, and fix . Define
[TABLE]
Fix , and set
[TABLE]
Theorem 2.2 implies that the finite measure on defined by
[TABLE]
is a constant multiple of the optimal measure, that is, the solution to the optimization problem (1.2). Let
[TABLE]
As the Radon-Nykodym derivative of the absolutely continuous component of with respect to the Lebesgue measure is bounded away from [math] on , the hypotheses of Theorem 3.1 are clearly satisfied, which implies that
[TABLE]
and
[TABLE]
In other words, as ,
[TABLE]
When , is a time-changed Ornstein-Uhlenbeck process. That is,
[TABLE]
the process on the right hand side being an Ornstein-Uhlenbeck process. Therefore, a special case of (5.1) is that for any compact interval ,
[TABLE]
as .
The second example illustrates applications of Theorems 2.1, 3.2 and 4.1.
Example 0
Let be a stationary Gaussian process with mean zero and covariance function
[TABLE]
for a fixed . The assumptions of Theorem 2.1 are satisfied for any and, hence, the optimal measure, say , in the optimization problem (1.2) is of full support. If , this follows from the explicit solution of the optimization problem in Adler et al. (2014).
The hypotheses of Theorem 3.2 are therefore satisfied with and , which implies the existence of satisfying
[TABLE]
for large . When this reduces to the upper bound in (5.2).
Finally, an appeal to Theorem 4.1 shows that the conditional law of the location of the minimum (the leftmost one to be chosen in case of ties) on given that the minimum if above , converges weakly to as .
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Adler et al. (2014) R. J. Adler, E. Moldavskaya and G. Samorodnitsky (2014): On the existence of paths between points in high level excursion sets of Gaussian random fields. Annals of Probability 42:1020–1053.
- 2Bingham et al. (1987) N. Bingham, C. Goldie and J. Teugels (1987): Regular Variation . Cambridge University Press, Cambridge.
- 3Chakrabarty and Samorodnitsky (2018) A. Chakrabarty and G. Samorodnitsky (2018): Asymptotic behaviour of high Gaussian minima. Stochastic Processes and their Applications 128:2297–2324.
- 4Guliashvili and Tankov (2016) A. Guliashvili and P. Tankov (2016): Tail behavior of sums and differences of log-normal random variables. Econometric reviews 22:444–493.
- 5Li (2001) W. Li (2001): Small ball probabilities for Gaussian Markov processes under the L p subscript 𝐿 𝑝 L_{p} norm. Stochastic Processes and their Applications 92:533–598.
- 6Li and Shao (2001) W. Li and Q. Shao (2001): Gaussian processes: inequalities, small ball probabilities and applications. Stochastic Processes: Theory and Methods 19:533–598.
- 7Lukacs (1970) E. Lukacs (1970): Characteristic functions . Charles Griffin & Co., London.
- 8van der Vaart and van Zanten (2008) A. van der Vaart and J. van Zanten (2008): Reproducing kernel Hilbert spaces of Gaussian priors. In Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh , volume 3 of IMS Collections . Institute of Mathematical Statistics, pp. 200–222.
