$L_2$-Small Deviations for Weighted Stationary Processes
Mikhail Lifshits, Alexander Nazarov

TL;DR
This paper derives the logarithmic asymptotics of small deviation probabilities in the L2 norm for weighted stationary Gaussian processes, utilizing spectral theory of pseudo-differential operators.
Contribution
It extends existing results by providing asymptotic estimates for a broad class of weighted stationary Gaussian processes using advanced spectral analysis techniques.
Findings
Logarithmic asymptotics for small deviation probabilities derived
Applicable to both real and complex-valued processes with power-type spectra
Utilizes spectral theory of pseudo-differential operators
Abstract
We find logarithmic asymptotics of -small deviation probabilities for weighted stationary Gaussian processes (both for real and complex-valued) having power-type discrete or continuous spectrum. As in the recent work by Hong, Lifshits and Nazarov, our results are based on the spectral theory of pseudo-differential operators developed by Birman and Solomyak.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
-Small Deviations for Weighted Stationary Processes
Mikhail Lifshits 111St.Petersburg State University, Russia, St. Petersburg, Universitetskii pr. 28, email [email protected]. 222MAI, Linköping University.
Alexander Nazarov 333St.Petersburg Department of Steklov Institute of Mathematics, email [email protected]. 444St.Petersburg State University, Russia, St. Petersburg, Universitetskii pr. 28.
Abstract
We find logarithmic asymptotics of -small deviation probabilities for weighted stationary Gaussian processes (both for real and complex-valued) having power-type discrete or continuous spectrum. Our results are based on the spectral theory of pseudo-differential operators developed by Birman and Solomyak.
Keywords: small deviations; spectral asymptotics; stationary processes.
AMS Classification: 60G15, 60G10, 60G22, 47G30.
1 Introduction
Let be a random process defined on some parametric measure space . Many studies have been devoted to the asymptotic behavior of its -small deviation probabilities
[TABLE]
see e.g. [7, 8, 9, 18, 19, 20, 21, 24], to mention just a small sample. The importance of small deviation probabilities in a broader context and a large number of their applications are described in the surveys [14, 15]; for an extensive up-to-date bibliography see [16].
In this work, we explore -small deviation probabilities for weighted stationary Gaussian processes having power-type spectrum. Our goal is to relate the asymptotics of small deviation probabilities with that of the spectrum. From the historical point of view our results are closely related to those on fractional Brownian motion and its relatives, see e.g. [6, 10, 11, 17]. In terms of such processes with stationary increments our message is that the spectral asymptotics is relevant to the small deviation behavior but the self-similarity is not.
In Section 2 we consider periodic processes that correspond to discrete spectrum, while Section 4 handles continuous time processes with spectral density. The final results of two sections are quite similar, although intermediate technical details differ.
Our results are based on the spectral theory of pseudo-differential operators developed by Birman and Solomyak [3, 4]. This approach was initiated in [12], where a similar problem was considered in the discrete time setting. In passing, in Section 3 we prove a slightly stronger version of one result from [12].
The spectral results that we use are not sensible to the symmetry of the spectral measure. Therefore, it is very natural to apply them to the complex-valued processes. In this context proper Gaussian processes are particularly convenient because their distributions are determined by the spectra of the corresponding covariance operators. Our main results are logarithmic asymptotics of -small deviation probabilities for weighted stationary Gaussian processes having power-type spectrum in Theorem 2.2 (real-valued periodic process), in Theorem 2.4 (complex-valued proper periodic process), in Theorem 4.2 (real-valued process with continuous spectrum), and in Theorem 4.3 (complex-valued proper process with continuous spectrum).
For the reader’s convenience, in Appendix we formulate some particular cases of deep results of [2]–[4] used in our proofs.
We denote by the Fourier transform
[TABLE]
For any two sequences the standard notation means that .
2 Periodic stationary processes
2.1 Spectral representations
We first recall the necessary information on the spectral representations of stationary periodic processes.
Let be a complex-valued -periodic centered second order mean-square continuous stationary process. Then its covariance function admits a spectral representation
[TABLE]
where is a finite non-negative measure on called the spectral measure of .
The spectral representation of itself writes as
[TABLE]
where are centered uncorrelated complex random variables with .
Just for completeness, recall a straightforward reformulation for real-valued processes. Let denote . The process is real-valued iff
- •
is real;
- •
for all ;
- •
for all ;
- •
for all ;
- •
the real random variables are uncorrelated.
In this case (2.1) writes as
[TABLE]
where the random variables have unit variance.
2.2 Covariance operators and their factorization
Let be the normalized Lebesgue measure on . In the following, we will consider as a random element of . From this point of view, equations (2.1) and (2.2) represent the orthogonal expansions of with respect to the orthonormal bases and , respectively. The elements of these bases are eigenvectors of the corresponding covariance operator in and the corresponding eigenvalues are .
The orthogonal expansions generate natural decompositions of . Let . Then the operator square root of is defined by the formula , . Operator is bounded, self-adjoint, satisfies , and can be interpreted as a convolution operator with the kernel
[TABLE]
Indeed, for every and we have
[TABLE]
In the following we are interested in the small ball behavior of the weighted -norm
[TABLE]
with some weight .
We have a decomposition for covariance operator
[TABLE]
where stands for the self-adjoint multiplication operator related to the function . We claim that is the Hilbert–Schmidt operator although need not be even bounded. Indeed, since , it admits a Fourier series expansion
[TABLE]
with . Then we have
[TABLE]
and therefore
[TABLE]
For the study of logarithmic asymptotics of small deviation probabilities, we need to know the main term of the eigenvalue asymptotics for , see [18]. Since is non-negative, its eigenvalues coincide with its singular values . We always label the eigenvalues and singular values in non-increasing order counting multiplicity.
We study the distribution function of singular values
[TABLE]
and its asymptotics as . For a compact operator we introduce the notation
[TABLE]
The following relation is important in what follows:
[TABLE]
2.3 Spectral asymptotics
From now on we assume that the spectral measure has a power-like decay
[TABLE]
with some and , . Assumption (2.6) is typical of the literature on small deviations of Gaussian processes; see for example [7].
Lemma 2.1
Let the spectral measure of satisfy , and let . Then
[TABLE]
Proof.
We proceed similar to [12] where we used quite general results of Birman and Solomyak [3, 4].
We can consider as an operator in
[TABLE]
where . Notice that since we are working on the interval of length , it is sufficient to consider only the restriction of our periodic function to .
Let be a smooth cut-off function such that if and if . Then it follows that the function equals one on and vanishes outside of the interval . We decompose the kernel as follows:
[TABLE]
and claim that the function satisfies
[TABLE]
where . Indeed, we have
[TABLE]
and then by splitting the series into two sums, we obtain
[TABLE]
Since rapidly decays at infinity, we have as . Furthermore, (2.6) implies that
[TABLE]
by the Poisson summation formula (see, e.g., [27, Ch. II, Sect. 13]), so that (2.9) follows.
Now we introduce a model operator
[TABLE]
with
[TABLE]
where is a smooth cut-off function vanishing in a neighborhood of the origin. Since , Proposition A.1 can be applied to the operator . This gives
[TABLE]
Furthermore, the decomposition (2.8) generates the corresponding operator decomposition
[TABLE]
Since the relation (2.9) implies as , part 1 of Proposition A.2 gives . Moreover, since is -periodic, the singular values of coincide with the singular values of the operator
[TABLE]
For this operator, the support of the “left” weight is , and the support of the “right” weight is . Part 2 in Proposition A.2 gives . Similarly, . By Proposition A.4 we obtain
[TABLE]
and the equivalence in (2.5) gives (2.7). ∎
2.4 Gaussian small deviations
Now we transform the information about the eigenvalues into that on small deviation asymptotic behavior. This can be done for real processes and also for an important class of complex processes. We handle two cases separately because the constants appearing in the results are slightly different.
2.4.1 Real processes
Recall that if we have a centered Gaussian random vector , in a real Hilbert space, and stands for its covariance operator, then, by the Karhunen–Loève expansion (see [1, Section 1.4]),
[TABLE]
where is a sequence of independent standard normal random variables and are the eigenvalues of . Therefore, the sequence determines the distribution of . In particular, if
[TABLE]
then it is well known from [7, p.67] or [26], that
[TABLE]
with from (2.10) and . If our process is real, we can apply the formula (2.11) to considered as an element of and using eigenvalue asymptotics (2.7) as (2.10). Notice that for real processes the spectral measure is symmetric, i.e. we have . Taking into account (2.3) we immediately obtain the following result.
Theorem 2.2
Let be a -periodic real centered mean-square continuous stationary Gaussian process. Assume that its spectral measure satisfies the asymptotic condition
[TABLE]
with some . Let be a summable weight.
Then we have, as ,
[TABLE]
2.4.2 Examples
Consider the Bogoliubov process [24, 25] – a -periodic centered stationary Gaussian process (with parameter ) defined by
[TABLE]
with independent standard normal random variables and . Define a -periodic process , . In our notation, for the spectrum of we have , . By applying Theorem 2.2 we obtain for
[TABLE]
In the simplest case we have
[TABLE]
cf. [24, Theorem 1].
For , our result gives
[TABLE]
as proved in [24, Theorem 2].
Our next example is the so-called -times integrated-centered Brownian bridge. Let be standard Brownian bridge on . We define the sequence of Gaussian processes
[TABLE]
It was shown in [19, Sec. 3] that
[TABLE]
with independent standard normal random variables . This formula obviously defines a -periodic centered stationary Gaussian process on . Define a -periodic process . Then for the spectrum of we have , . By applying Theorem 2.2 we obtain for
[TABLE]
For this result agrees with [19, Theorem 3.2].
Remark 2.3
In fact, the sharp small ball asymptotics for these processes were obtained in [19] and [24], see also [21] for more general weights. However, this is strongly connected with the fact that and are the Green Gaussian processes i.e. their covariances are the Green functions for ordinary differential operators. In general case this seems to be a much harder problem.
2.4.3 Proper complex processes
If we have a centered Gaussian random vector in a complex Hilbert space, and stands for its covariance operator, then Karhunen–Loève expansion yields
[TABLE]
where are uncorrelated complex jointly Gaussian random variables satisfying and are the eigenpairs of . We still have
[TABLE]
but, unfortunately, unlike the real case, the variables need not be independent, although they are uncorrelated. Indeed, the independence of two centered complex Gaussian random variables and is equivalent to the pair of relations
[TABLE]
Therefore, the sequence does not determine the distribution of in general case. For this reason, we need to restrict the consideration to an important subclass of the variables and processes where uncorrelated variables are independent, cf. [22, 23].
A complex-valued random process is called centered proper (or circularly) Gaussian if
- •
For any the coordinate vector is a centered Gaussian vector in ;
- •
for all .
We clearly have . Moreover, the property yields that the distribution of in the complex plane is spherically symmetric.
These properties extend to the span of . Let us denote . For every we have , , hence its distribution in is spherically symmetric Gaussian. Moreover, for any we have and are independent iff they are uncorrelated, i.e. . This can be easily verified by checking that their coordinates are uncorrelated.
By applying these facts to the expansion (2.12) of a proper Gaussian process , we see that the variables are independent and spherically symmetric. Therefore, (2.13) becomes
[TABLE]
where are independent real standard Gaussian random variables. This formula can be rewritten as
[TABLE]
where
[TABLE]
for all .
A straightforward calculation shows that yields , as . By applying (2.11) with instead of we obtain the following result.
Theorem 2.4
Let be a -periodic complex centered mean-square continuous stationary proper Gaussian process. Assume that its spectral measure satisfies the asymptotic condition (2.6) with some . Let be a summable weight.
Then we have, as ,
[TABLE]
3 Stationary sequences
Let a real stationary centered Gaussian sequence admit a representation
[TABLE]
where , and are independent standard Gaussian random variables (this representation exists iff has a spectral density).
The following result was essentially obtained in [12].
Theorem 3.1
Let a real stationary centered Gaussian sequence admit a representation (3.1) and let the coefficients have the asymptotics
[TABLE]
where at least one of the numbers is strictly positive. Then, as ,
[TABLE]
where .
However, in [12], for an additional assumption was imposed. Now we show that it was not necessary, answering the question raised in [12, Remark ].
Sketch of the proof: We have to study the norm of the random vector defined by its coordinates , . It was proved in [12] that the corresponding covariance operator admits a representation
[TABLE]
where is the convolution operator with the kernel while is the multiplication operator related to the function .
We see that the elements of decomposition in (3.2) are the same as in but the order of use of operators is different. However, a well-known theorem in operator theory, see, e.g., [5, Sec. 2.10, Theorem 5], implies the coincidence of non-zero eigenvalues for operators and for any bounded linear operator . Thus, Lemma 2.1 implies that spectral asymptotics of (2.7) type holds for the operator (with the natural replacement , , ). Using formula (2.11) we obtain the claimed small deviation asymptotics.
4 Stationary processes with continuous spectra
4.1 Spectral representations
Now we consider general aperiodic stationary processes. Let , be a centered second order complex stationary process on .
The analogue of spectral representation (2.1) is more involved and writes as follows:
[TABLE]
where is an uncorrelated white noise with a control measure called spectral measure of .
The only information about white noise integrals, that we need here is that the random variable is well defined and centered iff , while for the covariances we have the expression
[TABLE]
In particular,
[TABLE]
We are interested in the small ball behavior of the weighted -norm
[TABLE]
where is a non-negative weight.
Assume that the spectral measure has a density . Then it is easy to see that
[TABLE]
(we recall that stands for the Fourier transform).
4.2 Spectral asymptotics
From now on we assume that the spectral density has a power-like decay analogous to (2.6),
[TABLE]
with some and , .
Lemma 4.1
Let the spectral density of satisfy . Assume that , and
[TABLE]
Then
[TABLE]
Proof.
We cannot apply Proposition A.1 directly since it requires boundedness of the weights supports. Therefore, we use subtle estimates of [2, Sec. 5], see Proposition A.3. We introduce a decomposition similar to (2.4):
[TABLE]
where and stand for the multiplication by and , respectively.
Following [2], for we define the numerical sequence
[TABLE]
Using the notation in Appendix we can write the assumption (4.1) as follows:
[TABLE]
Further, the assumption (4.2) is equivalent to , and the (quasi)-norm coincides with .
Now we consider the sequence of operators , , where is multiplication by compactly supported weight
[TABLE]
Obviously, in .
Since , we can apply Proposition A.3 to the operator . This gives
[TABLE]
By (2.5) and Proposition A.4 we infer
[TABLE]
Since , this implies
[TABLE]
where
[TABLE]
The weights satisfy the assumptions of Proposition A.1. Using Proposition A.1, part 1 in Proposition A.2 and the last statement in Proposition A.4, we obtain
[TABLE]
(recall that ). We pass to the limit as , and the equivalence in (2.5) yields (4.3). ∎
4.3 Gaussian small deviations
4.3.1 Real processes
By combining spectral asymptotics (4.3) with small deviation asymptotics (2.11) we immediately obtain the following result.
Theorem 4.2
Let be a real centered mean-square continuous stationary Gaussian process. Assume that it has a spectral density satisfying asymptotical condition
[TABLE]
with some . Let be a summable weight satisfying condition .
Then we have, as ,
[TABLE]
Apart from the weight integration domain, the constant in the limit is exactly the same as in Theorem 2.2.
This result has an intersection with that of S. Gengembre [10] who considered the non-weighted -norm, , on a bounded interval and the range that enables comparison with fractional Ornstein–Uhlenbeck processes and thus a reduction to the small deviation results on fractional Brownian motion, cf. [17]. We illustrate this connection in the next sub-section.
4.3.2 Basic example
Let be the fractionality parameter. Let be a fractional Brownian motion and let , be a fractional Ornstein-Uhlenbeck (OU) process. (There are several other ways to extend the classical OU-process to the fractional case. We refer to [13] for alternative definitions and further references.) In other words, it is a real centered Gaussian stationary process with covariance
[TABLE]
The asymptotic behavior of the corresponding spectral density is well known, see e.g. [10, Proposition 1],
[TABLE]
This is essentially due to the behavior of the covariance at the origin,
[TABLE]
It will be also useful for us to consider integrated versions of fractional Brownian motion and their stationary versions. Let us denote for , and define processes for all non-integer positive inductively, by
[TABLE]
It is easy to see that the process is -self-similar. Therefore, is a stationary process with the covariance function
[TABLE]
for all positive non-integer values of the parameter . We can also easily find the inductive formula for the spectral measures of . Indeed, for any , we have
[TABLE]
Rewrite this identity as
[TABLE]
and translate it in the language of spectral measures. Let denote the spectral measure of . Recall that has a spectral representation
[TABLE]
where is a centered random measure with orthogonal values on such that . Since
[TABLE]
we get
[TABLE]
By the uniqueness of the spectral representation, it follows that and we finally obtain
[TABLE]
It follows from (4.5) that has a spectral density satisfying
[TABLE]
(Here and elsewhere is the fractional part of ).
Assuming condition on the weight to hold and applying Theorem 4.2 with , we obtain as ,
[TABLE]
In view of the identity
[TABLE]
with the weight
[TABLE]
formula (4.6) immediately yields an equivalent result for the weighted -norm of . The small ball asymptotics for the weighted -norm of and was obtained in [20, Theorems 3.1, 3.3 and 4.2] but only for the weights with bounded support.
One should also mention [11, 17] where small deviations of more general weighted -norms, were studied for fractional Brownian motions and for Riemann–Liouville processes.
4.3.3 Proper complex processes
In all the previous examples the spectral density satisfied (4.1) with . For complex-valued processes this condition may be violated. By repeating the proof of Theorem 2.4 and using asymptotics (4.3) we obtain the following analogue of Theorem 2.4 for complex-valued processes with continuous spectra.
Theorem 4.3
Let be a complex centered mean-square continuous stationary proper Gaussian process. Assume that it has a spectral density satisfying the asymptotic condition (4.1) with some . Let be a summable weight on satisfying (4.2).
Then we have, as ,
[TABLE]
Apart from the weight integration domain, the constant in the limit is exactly the same as in Theorem 2.4.
Appendix A ppendix
Here we collect some statements from [2]–[5]. Recall that is standard Fourier transform. For a compact operator in we denote by its singular values and by
[TABLE]
the distribution function of . Define
[TABLE]
Denote by and the spaces of sequences (with or ) such that, respectively,
[TABLE]
Proposition A.1
(a particular case of [3, Theorem 1 (b) and Theorem 2]). Let
[TABLE]
where functions have compact supports while has the form
[TABLE]
here , and is a smooth cut-off function vanishing in a neighborhood of the origin. Then
[TABLE]
Proposition A.2
(a particular case of [4, Corollary 4 and Lemma 3]). Let operator have the form (A.1).
1*. Suppose that weight functions and satisfy the assumptions of Proposition A.1 while , where is a smooth cut-off function vanishing in a neighborhood of the origin and , as , . Then .*
2*. Suppose that functions , and satisfy the assumptions of Proposition A.1. Let , , where and are closed bounded segments with non-overlapping interiors. Then .*
Proposition A.3
(a particular case of [2, Subsection 5.7]). Let
[TABLE]
where . Define sequences and according to (4.4).
Let , for some . Then \big{(}s_{j}(\widetilde{\mathcal{A}})\big{)}\in\ell_{\delta,\infty}, and
[TABLE]
where constant depends on .
Proposition A.4
(Corollary 5 in [5, Sec. 11.6]). If , are finite then
[TABLE]
In particular, if then
[TABLE]
Acknowledgments
We are grateful to V. A. Sloushch who provided us with reference [2]. We are also grateful to the anonymous referee and to the Editor for their careful reading and for the help with our work on the manuscript.
The work was supported by SPbSU-DFG grant 6.65.37.2017 and by RFBR grant 16-01-00258.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] R.B. Ash, M.F. Gardner, Topics in Stochastic Processes. Academic Press , New York, 1975.
- 2[2] M.Sh. Birman, G.E. Karadzhov, M.Z. Solomyak, Boundedness conditions and spectrum estimates for the operators b ( X ) a ( D ) 𝑏 𝑋 𝑎 𝐷 b(X)a(D) and their analogs . In: Estimates and asymptotics for discrete spectra of integral and differential equations (Leningrad, 1989-90), Adv. Soviet Math., 7 , AMS, Providence, R.I., 1991, 85–106.
- 3[3] M.Š. Birman, M.Z. Solomjak, Asymptotics of the spectrum of pseudodifferential operators with anisotropic-homogeneous symbols , Vestnik LGU (1977), no 13, 13–21 (Russian); English transl.: Vestnik Leningrad Univ. Math. 10 (1982), 237–247.
- 4[4] M.Š. Birman, M.Z. Solomjak, Asymptotics of the spectrum of pseudodifferential operators with anisotropic-homogeneous symbols. II , Vestnik LGU (1979), no 3, 5–10 (Russian). English transl.: Vestnik Leningrad Univ. Math. 12 (1980), 155–161.
- 5[5] M.S. Birman, M.Z. Solomjak, Spectral Theory of Self-Adjoint Operators in Hilbert Space , 2nd edition, revised and extended. Lan’, St.Petersburg, 2010 (Russian). English transl. of the 1st ed.: Mathematics and Its Applications. Soviet Series. 5 , Kluwer, Dordrecht etc. 1987.
- 6[6] J.C. Bronski, Small ball constants and tight eigenvalue asymptotics for fractional Brownian motions , J. Theoret. Probab. 16 (2003), no. 1, 87–100.
- 7[7] T. Dunker, M.A. Lifshits, W. Linde, Small deviations of sums of independent variables. In: Proc. Conf. High Dimensional Probability; Ser. Progress in Probability, 43 , Birkhäuser, 1998, 59–74.
- 8[8] Gao, F., Hannig, J., Lee, T.-Y., and Torcaso, F.: Laplace transforms via Hadamard factorization with applications to small ball probabilities. Electronic J. Probab. 8 , (2003), paper 13.
