Weak invariance principle in Besov spaces for stationary martingale differences
Davide Giraudo, Alfredas Rackauskas

TL;DR
This paper extends the classical Donsker weak invariance principle to Besov spaces, analyzing polygonal line processes from stationary martingale differences and i.i.d. variables, demonstrating the optimality of the results.
Contribution
It introduces a new invariance principle in Besov spaces for stationary martingale differences, expanding the theoretical framework beyond classical settings.
Findings
Extension of Donsker's principle to Besov spaces
Optimality of the derived results
Applicability to stationary martingale differences and i.i.d. variables
Abstract
The classical Donsker weak invariance principle is extended to a Besov spaces framework. Polygonal line processes build from partial sums of stationary martingale differences as well independent and identically distributed random variables are considered. The results obtained are shown to be optimal.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic processes and financial applications · Advanced Harmonic Analysis Research · Navier-Stokes equation solutions
Weak invariance principle in Besov spaces for stationary martingale differences
Davide Giraudo and Alfredas Račkauskas
Normandie Univ, UNIROUEN, CNRS, LMRS, 76000 Rouen, France, Department of Mathematics and Informatics, Vilnius University, Naugarduko 24, LT-03225 Vilnius, Lithuania,
[email protected], [email protected].
Abstract.
The classical Donsker weak invariance principle is extended to a Besov spaces framework. Polygonal line processes build from partial sums of stationary martingale differences as well independent and identically distributed random variables are considered. The results obtained are shown to be optimal.
Keywords: invariance principle, martingale differences, stationary sequences, Besov spaces.
AMS MSC 2010: 60F17; 60G10; 60G42.
1. Introduction and main results
By weak invariance principle in a topological function space, say, we understand the weak convergence of a sequence of probability measures induced on by normalized polygonal line processes build from partial sums of random variables. The choice of the space is important due to possible statistical applications via continuous mappings. Since stronger topology generates more continuous functionals, it is beneficial to have the weak invariance principle proved in as strong as possible topological framework.
Classical Donsker’s weak invariance principle considers the space and polygonal line processes build from partial sums of i.i.d. centred random variables with finite second moment. An intensive research has been done in order to extend Donsker’s result to a stronger topological framework as well to a larger class of random variables (see, e.g., [9], [12], [4] and references therein).
In this paper we consider weak invariance principle in Besov spaces for a class of strictly stationary sequence of martingale differences. To be more precise, let us first introduce some notation and definitions used throughout the paper.
Let be a probability space and be a bijective bi-measurable transformation preserving the probability . The quadruple is referred to as dynamical system (see, e.g., [10] for some background material). We assume that there is a sub--algebra such that and by we denote the -algebra of the sets such that .
Next we consider a strictly stationary sequence constructed as , where is -measurable. We define also a non-decreasing filtration , . Note that is then a martingale differences sequence provided .
Set
[TABLE]
Our main object of investigation is the sequence of polygonal line processes , defined by
[TABLE]
where for a real number , . To define the paths space under consideration let be the space of Lebesgue integrable functions with exponent () and the norm
[TABLE]
If its -modulus of smoothness is defined as
[TABLE]
where . Let . The Besov space is defined by
[TABLE]
Endowed with the norm
[TABLE]
the space is a separable Banach space and the following embeddings are continuous:
[TABLE]
Each where supports a standard Wiener process (see, e.g., [14]). We note also, that any polygonal line process belongs to each of , , .
As usually denotes convergence in distribution.
Theorem 1.1**.**
Let , and
[TABLE]
Let be a martingale differences sequence. Assume that the following two conditions hold :
**
\mathsf{E}\left(\big{[}\mathsf{E}\left(f^{2}\mid\mathsf{T}\mathcal{F}_{0}\right)\big{]}^{q(p,\alpha)/2}\right)<\infty.**
Then the convergence holds in the space where is independent of .
Let us note that condition (i) is stronger for the function than its square integrability since (i) yields for any and when . However as shows our next result, condition (i) is necessary and sufficient for independent identically distributed (i.i.d.) random variables. To formulate the result let be mean zero i.i.d. random variables with finite variance . Let , be defined by
[TABLE]
Theorem 1.2**.**
Let and let be defined by (1.0.1). Then
[TABLE]
if and only if
[TABLE]
Since matches Hölder spaces we see, that Theorems 1.2 and 1.1 complement the weak invariance principle obtained in a Hölderian framework by [12] and [4]. Concerning condition (ii) of Theorem 1.1 we prove a need of certain extra assumption by a counterexample which for any dynamical system with positive entropy constructs a function that satisfies the condition (i) but the convergence of polygonal line processes fails. Precise result reads as follows.
Theorem 1.3**.**
Let , and be given by (1.0.1). For each dynamical system with positive entropy, there exists a function and a -algebra for which such that:
*the sequence is a martingale difference sequence; *
the convergence \lim_{t\to+\infty}t^{q(p,\alpha)}\mathsf{P}\Big{(}\left|m\right|\geqslant t\Big{)}=0 takes place;
the sequence is not tight in .
As it is seen from our next results the case where is indeed quite different from the previously considered case where .
Theorem 1.4**.**
Let and . Let be a martingale differences sequence. If then in the space , where is independent of .
Theorem 1.5**.**
*Let and be as in Theorem 1.4. Then *
[TABLE]
Let us note that the finiteness of the second moment is necessary for the convergence (1.0.4).
The rest of the paper is organized as follows. In Section 2 we shortly present needed information on structure of Besov spaces and tightness of measures on these spaces. Section 3 contains proofs of Theorems 1.1, 1.2 and 1.3 whereas Section 4 is devoted to the proofs of Theorems 1.4 and 1.5. Finally, in Section 6 we discuss possible applications of invariance principle in the Besov framework.
2. Some functional analysis and probabilistic tools
We denote by the set of dyadic numbers in of level , i.e.
[TABLE]
Set
[TABLE]
and write for ,
[TABLE]
The triangular Faber-Schauder functions for , , are
[TABLE]
When , we just take the restriction to in the above formula, so
[TABLE]
Theorem 2.1** ([3]).**
Let and The Faber-Schauder system is the Schauder basis for : each has the unique representation,
[TABLE]
where
[TABLE]
and in the special case ,
[TABLE]
Moreover the norm is equivalent to the sequential norm:
[TABLE]
The Schmidt orthogonalization procedure (with respect to inner product in ) applied to Faber-Schauder system leads to the Franklin system :
[TABLE]
with for , where the matrix is uniquely determined.
Theorem 2.2** ([3]).**
The Franklin system is the basis for , : each has the unique representation,
[TABLE]
where , .
The following proposition is proved in [2] for but similar arguments works as well for any .
Proposition 2.3**.**
Let and . The set is relatively compact if and only if
**
**
Proof.
One easily checks that (i) and (ii) yields relative compactness of in . Therefore for any sequence of there exists a subsequence, which we denote also , converging in to some . To finish the proof it suffices to prove that
;
is a Cauchy sequence in .
Taking a.s. convergence subsequence and applying Fatou lemma we easily obtain for any ,
[TABLE]
This yields (a). To prove (b) observe that for each there exists such that , hence, for
[TABLE]
and we complete the proof since . ∎
Consider stochastic processes with paths space which is endowed with Borel -algebra . Let be the corresponding distributions. As generally accepted the sequence converges in distribution to in (denoted in ) provided converges weakly to : for each bounded continuous . The sequence is tight in if for each there is a relatively compact set such that . Due to the well known Prohorov’s theorem convergence in distribution in a separable metric space is coherent with tightness. Indeed, to prove convergence in distribution one has to establish tightness and to ensure uniqueness of the limiting distributions.
The following tightness criterion is obtained from Proposition 2.3.
Theorem 2.4**.**
The sequence of random processes with paths in is tight if and only if the following two conditions are satisfied:
- (i)
\lim_{b\to\infty}\sup_{n\geqslant 1}\mathsf{P}\Big{(}||Z_{n}||_{p}>b\Big{)}=0;
- (ii)
for each
[TABLE]
Proof.
See, e.g., the proof of Theorem 8.2. in [1]. ∎
Theorem 2.5**.**
Let . The sequence of random elements in the Besov space is tight if and only if the following two conditions are satisfied:
- (i)
\displaystyle\lim_{b\to\infty}\sup_{n}\mathsf{P}\bigl{\{}||Z_{n}||_{p}>b\bigr{\}}=0;
- (ii)
for each , \displaystyle\lim_{J\to\infty}\limsup_{n\to\infty}\mathsf{P}\Big{(}\sup_{j\geqslant J}2^{j\alpha-j/p}\Big{(}\sum_{r\in D_{j}}\left|\lambda_{r}(\zeta_{n})\right|^{p}\Big{)}^{1/p}>\varepsilon\Big{)}=0.
Proof.
It is just a corollary of tightness criterion established in [15] for Schauder decomposable Banach spaces as Besov spaces with are such. ∎
3. Proofs: the case
We start this section with some auxiliary results which could be helpful when dealing with weak invariance principle for stationary sequences. Throughout we denote
[TABLE]
3.1. Auxiliary results
Lemma 3.1**.**
Let and . Assume that is a random element in boths spaces and . Then for any stationary sequence if
* in , and*
* is tight in ,*
then in .
Proof.
From (ii) we have that each subsequence of has further subsequence that converges in distribution. If and then we have that and for any dyadic number . But (i) gives that both and have the same distribution as . Since Schauder coefficients determines the distribution of we can conclude that and are equally distributed with . This ends the proof. ∎
For polygonal line processes build from any stationary sequence the tightness conditions given in Theorem 2.5 can be simplified.
Theorem 3.2**.**
Let and . The sequence is tight in provided that
[TABLE]
Proof.
Assume that satisfies (3.1.1). We have to show that satisfies the conditions of Theorem 2.5. First we check its condition (i). Since
[TABLE]
the proof of (i) reduces to
[TABLE]
Notice that (3.1.1) implies (by considering the term of index in the sum) that
[TABLE]
and consequently
[TABLE]
For a fixed , we choose such that
[TABLE]
There exists an integer such that for ,
[TABLE]
Since as goes to infinity, we can choose such that . Taking , we have for ,
[TABLE]
which proves (3.1.2) and the same time (i) of Theorem 2.5.
Now, let us prove condition (ii) of Theorem 2.5. Since
[TABLE]
we infer that condition (3.1.1) implies
[TABLE]
We first prove that for each positive ,
[TABLE]
We shall actually prove that
[TABLE]
since the differences can be treated similarly. To this aim, define for a fixed the sets
[TABLE]
and
[TABLE]
Assume that belongs to . Then . We thus have
[TABLE]
Now, assume that belongs to . Then
[TABLE]
and using the fact that and , we get
[TABLE]
Since and for ,
[TABLE]
we have in view of (3.1.5) and (3.1.6),
[TABLE]
We now have to bound and . Let . If belongs to , then we should have hence and it follows that cannot have more than elements. If belongs to , then we should have and we deduce that the cardinal of does not exceed . Therefore, we have
[TABLE]
and
[TABLE]
We thus have to prove that the latter term goes to zero in probability as goes to infinity.
Lemma 3.3**.**
Let be a function such that (3.1.3) holds. Then
[TABLE]
Proof.
For fixed and , define f^{\prime}:=f\mathbf{1}\big{(}\left|f\right|\leqslant\delta n^{1/q(p,\alpha)}\big{)} and . By Markov’s inequality, we have with
[TABLE]
Now, note that
[TABLE]
hence by (3.1), we have
[TABLE]
Notice also that
[TABLE]
The combination of (3.1.8) and (3.1.9) gives
[TABLE]
and since is arbitrary and , this concludes the proof of Lemma 3.3. ∎
An application of the Lemma 3.3 gives (3.1.4). Now, we have to prove that
[TABLE]
It suffices to prove that
[TABLE]
Indeed, we have
[TABLE]
and for , , so that the set consists of distinct elements. Therefore,
[TABLE]
and this quantity goes to zero in probability by Lemma 3.3. The proof of (3.1.10) reduces to establish that for each positive ,
[TABLE]
where
[TABLE]
We now bound by splitting the probability over the set
[TABLE]
One bounds by , which can in turn be bounded by
[TABLE]
and thanks to stationarity and the fact that
[TABLE]
we obtain
[TABLE]
Now, in order to bound , we start by the pointwise inequalities
[TABLE]
Integrating and using the fact that for a non-negative random variable and a positive ,
[TABLE]
we derive by stationarity and (3.1.12) that
[TABLE]
Let us denote by a constant depending only on and which may change from line to line. By (3.1.13) and (3.1.14), we derive that
[TABLE]
If , then we have
[TABLE]
hence
[TABLE]
Splitting the integral into two parts, we infer that
[TABLE]
and the limit of the latter quantity as goes to infinity is zero by (3.1.1). This concludes the proof of Theorem 3.2. ∎
Remark 3.4*.*
Using deviation inequalities, similar results as those found for the Hölderian weak invariance principle for stationary mixing and -dependent sequences in [4] can be found for Besov spaces.
Lemma 3.5** (Proposition 3.5 in [5] ).**
For any , there exists a constant such that if is a martingale differences sequence with respect to the filtration then for each integer ,
[TABLE]
3.2. Proof of Theorem 1.1
Acording to Lemma 3.1 we need only to prove that the sequence is tight in . To this aim, we have to check the condition (3.1.1) of Theorem 3.2. For fixed and such that , j\in\Big{(}J,\dots,N\Big{)} and , we have by (3.1.16) of Lemma 3.5,
[TABLE]
from which we infer that
[TABLE]
Using the fact that
[TABLE]
we derive the bound
[TABLE]
Since , we have and accounting the inequality , we obtain
[TABLE]
Since and , the integral is convergent and we infer by the monotone convergence theorem that
[TABLE]
Now, in order to control , we use the following elementary inequality: if is a non-negative random variable, then for each ,
[TABLE]
Applying this to , we obtain that
[TABLE]
Here again, we conclude by monotone convergence that
[TABLE]
since the integrals and \int_{0}^{+\infty}\min\Big{(}v,v^{q-1}\Big{)}v^{-q(p,\alpha)}\mathrm{d}x are finite (as ).
Tightness of the sequence now follows from Theorem 3.2 and the combination of (3.2.2), (3.2.3) and (3.2.4). Acounting Lemma 3.1 this concludes the proof of Theorem 1.1.
3.3. Proof of Theorem 1.2
Sufficiency of the condition is contained in Theorem 1.1. Indeed, we represent the sequence by , that is, is an i.i.d. sequence and has the same distribution as . To this aim we define and , where is the distribution of . Let for and let be the shift operator: . Next let . Then and , since is independent of and centered. Moreover, , again by independence. Therefore, condition (ii) of (1.1) is satisfied. Since is trivial, , which gives the convergence (1.0.2).
Let us prove the necessity of (1.0.3) for the invariance principle in . Since the space is a separable Banach space, the sequence is tight in . Using Theorem 1 in [13], we can find for any positive a number such that
[TABLE]
Therefore, if is large enough, we have
[TABLE]
Since
[TABLE]
we have the convergence in probability of the sequence to [math]. By [7], this implies that 2^{n\alpha-j/p}2^{-np/2}\mathsf{P}\Big{(}\left|X_{1}\right|>2^{n}\Big{)}\to 0, hence (1.0.3) holds. This ends the proof of Theorem 1.2.
3.4. Proof of Theorem 1.3
We first start by a lemma which guarantees the lake of tightness of the partial sum process.
Lemma 3.6**.**
Let and let be a function such that there exist increasing sequences of real numbers and satisfying the following properties: as goes to infinity and
[TABLE]
where is given by (1.0.1). Then the sequence is not tight in .
Proof.
If the sequence was tight in , then we would be able to extract a weakly convergence subsequence of . Therefore, we can assume without loss of generality that converges in distribution in . Consequently, the sequence should convergence to [math] in probability as goes to infinity. But
[TABLE]
for some constant depending only on (this can be seen by restricting the supremum over the of the form where ).
∎
Let us recall the statement of Lemma 3.8 in [8].
Lemma 3.7**.**
Let be an ergodic probability measure preserving system of positive entropy. There exists two -invariant sub--algebras and of and a function such that:
- •
the -algebras and are independent;
- •
the function is -measurable, takes the values , [math] and , has zero mean and the process is independent;
- •
the dynamical system is aperiodic.
In the sequel, we shall assume for simplicity that \mathsf{P}\Big{(}g=1\Big{)}=\mathsf{P}\Big{(}g=-1\Big{)}=1/2.
The construction follows the lines of that of Theorem 2.1 in [6]. We define three increasing sequences of positive integers , , and a sequence of real numbers such that
[TABLE]
is a continuity point of the cumulative distribution function of the random variable , which is defined in (5.0.1). Now, we define a sequence of real numbers in such a way that for each ,
[TABLE]
Now, by Proposition 5.1, we can choose for each an integer such that
[TABLE]
Let . We define the sequence in such a way that for each ,
[TABLE]
[TABLE]
Using Rokhlin’s lemma, we can find for any integer a measurable set such that the sets , are pairwise disjoint and . We define for
[TABLE]
[TABLE]
Note that , hence by (3.4.4) and the Borel-Cantelli lemma, the function is well defined almost everywhere. Define
[TABLE]
Proposition 3.8**.**
The -algebra satisfies . The function defined by (3.4.5) and (3.4.6) is -measurable and satisfies and .
A proof can be found in [6]
It remains to prove that the sequence is not tight in .
To this aim, we shall check the conditions of Lemma 3.6. We first show the following intermediate step.
Lemma 3.9**.**
For each integer ,
[TABLE]
Let be fixed. Assume that belongs to for some . Let be such that for some . We have
[TABLE]
Consequently, for any such that and each such that , we have
[TABLE]
It thus follows that
[TABLE]
and using disjointness of the sets , , we infer that
[TABLE]
where
[TABLE]
Since is measure-preserving, the events have the same probability, which is equal to . The events and belong respectively to and , hence they are independent. In view of (3.4.7), we obtain
[TABLE]
Now, in order to control the latter term, we shall use the following lemma:
Lemma 3.10**.**
Let be an increasing sequence of integers. Assume that for each , the family of events is independent and that . Then for each ,
[TABLE]
Proof of Lemma 3.10.
By Bonferroni’s inequality, we have for any ,
[TABLE]
Using independence of , we derive that
[TABLE]
∎
We now use Lemma 3.10 with the choices and
[TABLE]
We indeed have, with the notations of (5.0.1) and by (3.4.2),
[TABLE]
hence by (3.4.1),
[TABLE]
We get, in view of (3.4.8) the lower bound
[TABLE]
This concludes the proof of Lemma 3.9.
Now, we prove that for any ,
[TABLE]
We first prove that
[TABLE]
where . First note that for and ,
[TABLE]
hence
[TABLE]
Now, by definition of , for each , the following inequality holds: .
Consequently,
[TABLE]
and this term does not exceed by (3.4.3). This proves (3.4.10)
Now, defining , we have
[TABLE]
By constructing of , we have \mathsf{P}\left(\Big{(}f_{u}\neq 0\Big{)}\right)\leqslant K_{u}/N_{u}, hence
[TABLE]
by (3.4.4).
Thus (3.4.9) follows from the combination of Lemma 3.9, (3.4.10) and (3.4.11). This ends the proof of Theorem 1.3.
4. Proofs: the case
We start with the following lemma which reduces the proof of convergence to that of tightness.
Lemma 4.1**.**
Let and . Assume that is a random element in . Then for any stationary sequence if
* in , and*
* is tight in ,*
then in .
Proof.
From (ii) we have that each subsequence of has further subsequence that converges in distribution. If and then we have that for Franklin basis it holds that and for any . But (i) gives that both and have the same distribution as . Since coefficients determines the distribution of we can conclude that and are equally distributed with . This ends the proof. ∎
4.1. Proof of Theorem 1.4
Due to continuity of the embedding if and . it is enough to prove the case where either and or and .
Recall . We shall prove for each
[TABLE]
where
[TABLE]
Since the function is affine in each interval , it holds for
[TABLE]
This observation leads to
[TABLE]
where is a constant depending on only,
[TABLE]
As a consequence in order to establish (4.1.1) we have to prove
[TABLE]
Consider first (4.1.3) and start with and . By Chebyshev inequality
[TABLE]
and (4.1.3) follows in this case. Now let and . For this case we shall use truncation. Set for ,
[TABLE]
Then and, since
[TABLE]
we reduce the proof of (4.1.3) to
[TABLE]
We have by Chebyshev inequality,
[TABLE]
Hence
[TABLE]
Since is arbitrary, the limit is indeed zero, and the proof of (4.1.5) is completed.
To prove (4.1.4) we start again with the case and . In this case Chebyshev inequality along with stationarity and Doob-Kolmogorov inequality yields
[TABLE]
and (4.1.4) follows. This ends the proof of (4.1.4) in the case .
Assume that and . Let us fix . Define for any and any integer the events
[TABLE]
[TABLE]
where is an arbitrary but fixed positive number. We have the bound
[TABLE]
Since the sequence is tight in the space (see [1]), we have
[TABLE]
Now, note that on , we have for any ,
[TABLE]
Therefore, we have
[TABLE]
and we infer that
[TABLE]
By Markov’s inequality, stationarity and Doob’s inequality, we have
[TABLE]
Since , we get
[TABLE]
and since is arbitrary, we get
[TABLE]
in view of (4.1.6). This concludes the proof of (4.1.4) and that of Theorem 1.4.
4.2. Proof of Theorem 1.5
It follows from Theorem 1.4 and the same arguments as used in the proof of Theorem 1.2.
5. Some applications
As already was mentioned in the introduction, a choice of functional spaces for polygonal line processes is usually inspired by possible applications in statistics via continuous mappings: if in the space , then for any continuous function . This general observation can be used, for example, to analyse so called -scan processes
[TABLE]
Proposition 5.1**.**
Let be a function such that the sequence converges to a standard Brownian motion in , where . For each such that , we define
[TABLE]
Then the following convergence holds:
[TABLE]
Proof.
Let use define a functional by
[TABLE]
Then is continuous with respect to the topology of and . We thus have . To conclude that (5.0.1) holds, it suffices to prove that
[TABLE]
First note that is non-negative. Second, we have
[TABLE]
Let be an integer such that and let be a real number such that . Then
[TABLE]
which implies that
[TABLE]
By Theorem 2.4, the second term in the right hand side of (5.0.2) goes to zero in probability. Therefore, it suffices to prove that
[TABLE]
To see this, we start from the inequality
[TABLE]
Let be a fixed integer. The functional
[TABLE]
is continuous. Therefore, if is a continuity point of the cumulative distribution function of for each , we have
[TABLE]
Now, take . Using Hölder’s inequality with the exponents and , we have
[TABLE]
Since is almost surely finite, we get from (5.0.4) that (5.0.3) holds. ∎
Statistics based on -scan processes can be used to detect epidemic change in the mean of a sample of size (see, e.g., [11], and reference therein). More precisely, given a sample , consider the model
[TABLE]
where is a stationary sequence, and are unknown parameters of the model. We want to test the null hypothesis against the alternative . To this aim one can consider the statistics
[TABLE]
Under null its limit is defined by Proposition 5.1 provided satisfies the weak invariance principle in the Besov space . Under alternative then we see that
[TABLE]
as , where is the duration of the epidemic state.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. Billingsley. Convergence of probability measures . Wiley, New York, 1968.
- 2[2] B. Boufoussi, M. Dozzi, and E. Lakhel. A Kolmogorov and tightness criterion in modular Besov spaces and an application to a class of Gaussian processes. Stochastic Analysis and Applications , 23(4):665–685, 2005.
- 3[3] Z. Ciesielski, G. Kerkyacharian, and B. Roynette. Quelques espaces fonctionnels associés à des processus gaussiens. Studia Math. , 107(2):171–204, 1993.
- 4[4] Davide Giraudo. Holderian weak invariance principle for stationary mixing sequences. Journal of Theoretical Probability , pages 1–16, 2015.
- 5[5] Davide Giraudo. Deviation inequalities for Banach space valued martingales differences sequences and random field. working paper or preprint, 2016.
- 6[6] Davide Giraudo. Holderian weak invariance principle under a Hannan type condition. Stochastic Process. Appl. , 126(1):290–311, 2016.
- 7[7] A. Gut. An extension of the Kolmogorov-Feller weak law of large numbers with an application to the St. Petersburg game. J. Theoret. Probab. , 17(3):769–779, 2004.
- 8[8] Emmanuel Lesigne and Dalibor Volný. Large deviations for martingales. Stochastic Process. Appl. , 96(1):143–159, 2001.
