$L_2$-small ball asymptotics for a family of finite-dimensional perturbations of Gaussian functions
Yulia Petrova

TL;DR
This paper investigates the small ball probabilities in L2-norm for finite-dimensional perturbations of Gaussian functions, classifying perturbations and deriving asymptotics, with applications to empirical processes and Green processes.
Contribution
It introduces a classification of perturbations (non-critical, partially critical, critical) and derives small ball asymptotics for these, extending understanding of Gaussian process perturbations.
Findings
Derived small ball asymptotics for perturbed Gaussian processes.
Identified Durbin's processes as critical perturbations of Brownian bridge.
Provided exact asymptotics for critical perturbations of Green processes.
Abstract
In this article we study the small ball probabilities in -norm for a family of finite-dimensional perturbations of Gaussian functions. We define three types of perturbations: non-critical, partially critical and critical; and derive small ball asymptotics for the perturbated process in terms of the small ball asymptotics for the original process. The natural examples of such perturbations appear in statistics in the study of empirical processes with estimated parameters (the so-called Durbin's processes). We show that the Durbin's processes are critical perturbations of the Brownian bridge. Under some additional assumptions, general results can be simplified. As an example we find the exact -small ball asymptotics for critical perturbations of the Green processes (the processes which covariance function is the Green function of the ordinary differential operator).
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic processes and financial applications · Stochastic processes and statistical mechanics · Mathematical Dynamics and Fractals
-small ball asymptotics for a family of finite-dimensional perturbations of Gaussian functions
Petrova Yu.P.111Research is supported by «Native towns», a social investment program of PJSC «Gazprom Neft» and in part by the Moebius Contest Foundation for Young Scientists
Abstract: In this article we study the small ball probabilities in -norm for a family of finite-dimensional perturbations of Gaussian functions. We define three types of perturbations: non-critical, partially critical and critical; and derive small ball asymptotics for the perturbated process in terms of the small ball asymptotics for the original process. The natural examples of such perturbations appear in statistics in the study of empirical processes with estimated parameters (the so-called Durbin’s processes). We show that the Durbin’s processes are critical perturbations of the Brownian bridge. Under some additional assumptions, general results can be simplified. As an example we find the exact -small ball asymptotics for critical perturbations of the Green processes (the processes which covariance function is the Green function of the ordinary differential operator).
Key words: small ball asymptotics, Gaussian processes, spectral asymptotics
1 Introduction
The theory of small ball probabilities (also called small deviation probabilities) for various norms is extensively studied in recent decades (see the surveys [1, 2, 3]; for the extensive up-to-date bibliography see [4]). Given a random process , the asymptotic behavior of the probability is called an exact asymptotics of small deviations. Let us note that in the literature on small balls, it is rare, and only known for a limited number of random processes, that the exact asymptotics is found. Therefore, often a * logarithmic asymptotics* is studied, that is the asymptotics of . But even on the logarithmic level the behavior of small balls cannot be uniformly described for the whole class of Gaussian measures.
In [5] a solution of the small ball behavior problem was obtained in implicit terms. Starting from [6, 7, 8], many authors attempted simplifying the asymptotic expression for the small ball probability under varios conditions.
Let be a bounded domain in , ; is the closure of . Let , , be a zero mean-value Gaussian random function with covariance function . Denote by the corresponding covariance operator in :
[TABLE]
Due to the Karhunen–Loève expansion (see, e.g. [9, Section, 12]) the small deviation problem can be rewritten as follows
[TABLE]
Here , , are the i.i.d. standard normal rv’s, are the eigenvalues of the corresponding covariance operator . Moreover, due to the Karhunen–Loève expansion we have . This condition means that is finite.
Therefore, knowing the eigenvalues , one can obtain some information on the distribution of . In paper [10] Dunker, Lifshits and Linde found an exact asymptotics under some mild assumptions. In particular, the exact asymptotics was found in the cases and . The main difficulty is that we rarely know the explicit formulas for the eigenvalues. If one knows sufficiently precise asymptotics for then it is possible to obtain the small ball asymptotics up to a constant using well-known comparison principle of Wenbo Li:
Proposition 1**.**
([11, 12])* Let be a i.i.d. standard normal rv’s; and be two positive non-increasing summable sequences such that . Then*
[TABLE]
In papers [13, 14] there was selected the concept of the Green Gaussian process. For such process the covariance function is the Green function for an ordinary differential operator. This allows to study asymptotics for using the methods of spectral theory of ODEs, originated from the classical works of Birkhoff [15, 16] and Tamarkin [17, 18] (further development of this theory can be found in [19, 20]). Many processes such as Wiener process, Brownian bridge, Ornstein-Uhlenbeck process and their integrated counterparts are Green processes. Let us mention also an important series of works [21, 22, 23], where the exact asymptotics were obtained for non Green processes.
In this paper we consider a case of finite-dimensional perturbations of the Gaussian processes. It is known that the logarithmic asymptotics is not changing under finite-dimensional perturbation (in more general terms is proved in [24] and [25]). So we are interested in exact asymptotics.
First the problem for one-dimensional perturbation was considered in [26]. In paper [27] the notions of non-critical and critical perturbations were considered and exact small ball asymptotics were found for a wide class of one-dimensional perturbations.
In this article we generalize these results for the case of finite-dimensional perturbation defined by the formula (4). The motivating examples to consider such types of perturbations are the so-called Durbin’s processes. These processes naturally appear in statistics as limiting ones when building goodness-of-fit tests of -type for testing that a sample is belonging to the family of distributions with estimated parameters. For example, if one considers test for normality (with estimated mean and/or variance) then Kac-Kiefer-Wolfowitz processes (KKW processes) appear (see [28]). The exact -small ball asymptotics for KKW processes is found in [29] and for some other important Durbin’s processes in [30].
The paper is organized as follows. In Section 2 we describe the family of finite-dimensional perturbations of Gaussian random functions and define the notions of non-critical, partially critical and critical perturbations. In Section 3 we prove genera1l theorems about -small ball asymptotics in non-critical and critical cases (see Theorems 1 and 2). In Section 4 we apply these results in the case of the Green processes (Theorem 3). In Section 5 we consider the Durbin’s processes and prove that they are the critical perturbations of the Brownian bridge (see Theorem 4). In Section 6 (Appendix) we prove lemma about differentiability of the asymptotics of small ball probabilities. Besides the fact that we use this Lemma to prove Theorem 3, the Lemma is interesting by itself.
We use letter to denote various constants which exact values are not important. Denote by — identical matrix of rank .
2 A set of finite-dimensional perturbations
Let , where are locally summable functions in , . Suppose that the vector-function
[TABLE]
is well-defined for a.e. , , , and
[TABLE]
This is equivalent to .
Remark 1**.**
Without loss of generality we assume that the functions , , are linearly independent.
Remark 2**.**
Formula (3) defines the scalar product on the space dual to . Hence is the Gram matrix, therefore, symmetric and nondegenerate.
We define a set of Gaussian functions
[TABLE]
Here, is the matrix of perturbation parameters (, ). Clearly, .
Lemma 1**.**
The covariance of is
[TABLE]
where Note that is symmetric.
**Proof. **Formula (5) can be checked by direct computation due to (3).
Corollary 1**.**
For the processes (4) the following equality holds
[TABLE]
Corollary 2**.**
Let . Then the following assertions hold:
we have the identity a.s. ()
[TABLE] 2. 2.
the function and the random variables , , are independent. 3. 3.
if , then the integral operator with the kernel function has a zero eigenvalue of multiplicity corresponding to the eigenfunctions , .
**Proof. **All statements follow from the relations:
[TABLE]
which can be easily checked.
Definition 1**.**
A function is called a non-critical perturbation of the function , if the following equivalent conditions hold:
; 2. 2.
, , are linearly independent a.s.
Definition 2**.**
A function is called a partially critical perturbation of rank of the function , , if the following equivalent conditions hold:
; 2. 2.
, , form a vector space of dimension a.s.
Definition 3**.**
A function is called a critical perturbation of the function , if the following equivalent conditions hold:
; 2. 2.
, a.s.
Remark 3**.**
For one-dimensional case the notions of critical and non-critical perturbations were introduced in [27].
3 Main theorems (non-critical and critical case)
Let и be the eigenvalues and the corresponding (normalized in ) eigenfunctions of the covariance operator , that is
[TABLE]
As a.s., the operator belongs to the trace class, that is . Let and be the eigenvalues and the corresponding eigenfunctions of the integral operator with kernel . Note that due to the minimax principle (see, e.g., [31, Section 10.2]), the sequences and interlace. In particular this implies the convergence of the series and a.s. By definition, put , .
Theorem 1**.**
Let be a non-critical perturbation of function . As we have
[TABLE]
**Proof. **By the comparison theorem (see Prop. 2) as we obtain
[TABLE]
Consider the Fredholm determinants for the kernels and , respectively:
[TABLE]
Since the series and converge, these canonical Hadamard products converge for all . Jensen’s theorem (see [32, §3.6]) provides
[TABLE]
Using the transformation formula for Fredholm determinant under finite-dimensional perturbation (see [33], [34, Theorem 2.2], or more general formula [35, Chapter 2, §4.6]) we obtain
[TABLE]
where matrix is defined from the formula
[TABLE]
Here, are the Fourier coefficients of vector-function with respect to the orthogonal basis .
To justify the passage to the limit in (6) we argue similarly to [27, Lemma 5.1]. As the entries of matrix converge uniformly with respect to , to the entries of matrix . In the neighborhood of positive real line the integrand has a summable majorant, hence by Lebesgue dominated convergence theorem the limit (6) is equal
[TABLE]
Note that
[TABLE]
Then by the orthonormality of
[TABLE]
Hence the formula (9) has the following form:
[TABLE]
The last equality holds due to similarity of matrices and . It’s clear that in non-critical case . This completes the proof.
To work with critical perturbations we need the following condition.
Condition A:
Theorem 2**.**
Let be a critical perturbation of function (see Definition 3) and the condition A be fulfilled. Then as
[TABLE]
**Proof. **We introduce three distribution functions:
[TABLE]
Let us show that as
[TABLE]
The Jensen’s theorem provides
[TABLE]
Note that in critical case . Thus using (10) the matrix (8) can be rewritten as follows:
[TABLE]
Hence, due to (7) and (14), the expression under the log sign in formula (13) can be rewritten as follows:
[TABLE]
By [27, Lemma 5.1] the limit in right hand side of formula (13) equals:
[TABLE]
Consider the well-defined matrix
[TABLE]
Then
[TABLE]
Combining formulas (12) and (15), we finally get as
[TABLE]
Further, obviously, , where
[TABLE]
Note that the following relation holds
[TABLE]
By the Laplace transform we obtain the solution of this convolution equation:
[TABLE]
By Lemma 3 from Appendix we obtain , . Hence, as
[TABLE]
Analogously, due to relation between and , we obtain
[TABLE]
By Lemma 3 from Appendix we have , . Hence, as we obtain
[TABLE]
Thus
[TABLE]
Using this algorithm times, we get as
[TABLE]
Combining the relations (16) and (17) completes the proof.
Remark 4**.**
The results analogous to Theorems 1 and 2 for one-dimensional perturbations were obtained in [27].
Remark 5**.**
In case of partially critical perturbation (see Definition 2), if the condition A is fulfilled, then the asymptotics of small ball probabilities can be found using Theorems 1 and 2.
4 Small ball probabilities for Green processes
Now we suppose that , and the covariance function , , is the Green function of a self-adjoint operator in the space , generated by a differential expression of order :
[TABLE]
and boundary conditions. We recall that by definition, for any satisfies the equation , in the sense of distributions, and satisfies boundary conditions.
By we denote the image of an integral operator with the kernel function . Then the inverse operator is just with the domain . In particular, if , then , and . Assume for simplicity that . Then coincides with the set of functions which belong to and satisfy boundary conditions.
Theorem 3**.**
Let . If , , then as
[TABLE]
**Proof. **It is shown in [13] that the process satisfies the relation
[TABLE]
where , . Using Lemma 2 (see Appendix), we obtain
[TABLE]
This means that the asymptotics (20) is -times differentiable with respect to . Substituting (21) into (2), we obtain
[TABLE]
Consider the integral
[TABLE]
By [27, Theorem 3], we obtain
[TABLE]
Repeating this procedure times completes the proof.
5 Example: Durbin’s processes
Durbin’s processes appear as limit ones when building goodness-of-fit tests of -type for testing if a sample belongs to a family of distributions when parameters of the distribution are estimated from the sample (see [37]). For reader’s convenience we describe them here.
Let be a sample from a distribution with general distribution function , let be the distribution density, where , , is a vector of parameters. Consider an empirical distribution function for fixed parameter values :
[TABLE]
It is well known (see [36, Chapter 3]), that the process n^{1/2}\bigl{[}F_{n}^{0}(t)-t\bigr{]} weakly converges to the Brownian bridge in Skorokhod space .
Assume that some parameters of the distribution are unknown (without loss of generality we may assume that these are the first parameters). The unknown parameters are estimated using the sample (e.g., by applying the maximum likelihood method), and the new parameter vector is denoted by . Then the empirical distribution function becomes
[TABLE]
It was shown in [37] that the process n^{1/2}\bigl{[}\hat{F}_{n}(t)-t\bigr{]} converges weakly in to a finite-dimensional perturbation of the Brownian bridge, namely, to a Gaussian process with zero mean and the covariance function
[TABLE]
Here, is the covariance function of the Brownian bridge , is the Fisher information matrix with entries , :
[TABLE]
And the vector function \vec{\psi}=\bigl{(}\psi_{1}(t),\ldots,\psi_{m}(t)\bigr{)} is defined as
[TABLE]
where and are related by . Formula (22) shows that Durbin’s processes are the -dimensional perturbations of the Brownian bridge (of type (4)).
Remark 6**.**
The following equality holds:
[TABLE]
Formula (23) can be checked by direct computation. Thus from (23) we obtain
[TABLE]
Theorem 4**.**
The Durbin’s processes with estimated parameters are critical.
**Proof. **Note that if is the Brownian bridge, then we have , and
[TABLE]
Hence from (3) and (22) the statement of the theorem follows.
6 Appendix
Our aim is to prove the following lemma on differentiability of asymptotics of small ball probabilities.
Lemma 2**.**
Let
[TABLE]
*where , , , and are i.i.d. standard normal random variables.
If have the following asymptotics at zero*
[TABLE]
*where is a slowly varying function at zero.
Then for any as *
[TABLE]
The proof of Lemma 2 is based on some good properties of (Lemma 3) and the lemma of Tauberian type (Lemma 4).
Lemma 3**.**
*Let satisfy the conditions of Lemma 2.
Then And *
Proof. Step 1: Assume that the following relations hold in a neighborhood of , ,
[TABLE]
We claim that , . Indeed, integrating by parts we get
[TABLE]
If we take so small that for all , then the integral is positive. That means , and . This results in , .
Step 2: Let us prove Lemma 3 for the distribution function of the finite sum . Namely, consider
[TABLE]
We claim that for all natural the following relations hold
[TABLE]
Changing variables in to spherical coordinates, we obtain:
[TABLE]
where is a polynomial, is a -dimensional sphere in , is the Jacobian:
[TABLE]
Hence, the density is equal to
[TABLE]
It follows from (26) that while the derivative is defined in the neighborhood of , and . Moreover, as for some constant , hence, (25) holds. Note that while we also have in some neighborhood of .
Step 3: Let be a random variable (independent of ) on the positive half-line , such that for all . We claim that for all natural the following equalities hold
[TABLE]
This means that (25) is still true after adding . According to step 1 it is sufficient to prove (24) for while . Note, that (24) holds for . Consider
[TABLE]
It is clear that . Due to mean value theorem there exists such that
[TABLE]
Step 4: Let us prove that Lemma 3 is true for infinite sum, that is for the function . Fix . Choose such that . Write as the following sum
[TABLE]
It is clear that has a positive mass in any neighborhood of zero. Thus, using step 3 for , we finish the proof.
Let us prove the following lemma of Tauberian type (on differentiability of asymptotics).
Lemma 4**.**
Let , is non-decreasing and
[TABLE]
*where is a slowly varying function at zero. Then *
[TABLE]
**Proof. **It is sufficient to prove the following inequalities
[TABLE]
Let us first prove (31). By the mean value theorem there exists a point such that for . Fix . Then if is sufficiently small and , we have
[TABLE]
Since , we have
[TABLE]
Without loss of generality we may assume that
[TABLE]
where is a measurable function on and as . This means that
[TABLE]
Further,
[TABLE]
for some . Next,
[TABLE]
Using inequalities and for small enough , we get
[TABLE]
In a similar way we obtain
[TABLE]
Let . Then
[TABLE]
Let us note that as is a slowly varying function we obtain
[TABLE]
Indeed,
[TABLE]
for some . The last equality holds due to (33) and the fact that as for any .
From these estimates it follows that
[TABLE]
This completes the proof of (31). To obtain (32) we proceed in a similar way using the inequality .
**Proof **of Lemma 2. Combining Lemmata 3 and 4 we immediately get Lemma 2.
Petrova Yulia: [email protected]
Chebyshev Laboratory
St. Petersburg State University, 14th Line V.O., 29B, Saint Petersburg 199178 Russia.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] M. A. Lifshits, ‘‘Asymptotic behavior of small ball probabilities,’’ Probab. Theory and Math. Statist. Proc. VII International Vilnius Conference , pp. 453–468, 1999.
- 2[2] V. Li, W. and M. Shao, Q., ‘‘Gaussian processes: inequalities, small ball probabilities and applications,’’ Stochastic processes: theory and methods , vol. 19, pp. 533–597, 2001.
- 3[3] V. R. Fatalov, ‘‘Constants in the asymptotics of small deviation probabilities for Gaussian processes and fields ,’’ Russ. Math. Surv. , vol. 58, no. 4, pp. 725–772, 2003.
- 4[4] M. A. Lifshits, Bibliography of small deviation probabilities . 2018. https://airtable.com/shr MG 0n Nxl 9Si Gx II/tbl 7Xj 1m ZW 2Vu Yurm.
- 5[5] G. N. Sytaya, ‘‘On some asymptotic representations of the Gaussian measure in a Hilbert space,’’ Theory of Stoch. Proc. , vol. 2, no. 94, pp. 93–104, 1974. (in Russian).
- 6[6] I. A. Ibragimov, ‘‘On a hitting probability of Gaussian random vector into a small ball in a Hilbert space,’’ Zap. Nauchn. Sem. LOMI , vol. 85, pp. 75–93, 1979. (in Russian). English transl.: J. Soviet Math., vol. 20, no. 3, pp. 2164–2175, 1982.
- 7[7] V. M. Zolotarev, ‘‘Gaussian measure asymptotic in L 2 subscript 𝐿 2 L_{2} on a set of centered spheres with radii tending to zero,’’ in 12th Europ. Meeting of Statisticians, Varna , p. 254, 1979.
- 8[8] J. Hoffmann-Jorgensen, L. A. Shepp, and R. M. Dudley, ‘‘On the lower tail of Gaussian seminorms,’’ Ann. Probab. , vol. 7, pp. 319–342, 1979.
