On joint weak convergence of partial sum and maxima processes
Danijel Krizmanic

TL;DR
This paper establishes joint weak convergence of partial sum and maxima processes for stationary sequences under regular variation and dependence conditions, revealing the limit as a combination of an alpha-stable Lévy process and an extremal process.
Contribution
It provides the first joint convergence result for partial sums and maxima under regular variation with alpha-stable limits and explores the dependence structure between the two components.
Findings
Limit process is an alpha-stable Lévy process and an extremal process.
Convergence occurs in the space of cadlag functions with the weak M1 topology.
The weak M1 topology cannot generally be replaced by the standard M1 topology.
Abstract
For a strictly stationary sequence of random variables we derive functional convergence of the joint partial sum and partial maxima process under joint regular variation with index and weak dependence conditions. The limiting process consists of an --stable L\'{e}vy process and an extremal process. We also describe the dependence between these two components of the limit. The convergence takes place in the space of --valued c\`{a}dl\`{a}g functions on , with the Skorohod weak topology. We further show that this topology in general can not be replaced by the stronger (standard) topology.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
On joint weak convergence of partial sum and maxima processes
Danijel Krizmanić
Danijel Krizmanić
Department of Mathematics
University of Rijeka
Radmile Matejčić 2, 51000 Rijeka
Croatia
Abstract.
For a strictly stationary sequence of random variables we derive functional convergence of the joint partial sum and partial maxima process under joint regular variation with index and weak dependence conditions. The limiting process consists of an –stable Lévy process and an extremal process. We also describe the dependence between these two components of the limit. The convergence takes place in the space of –valued càdlàg functions on , with the Skorohod weak topology. We further show that this topology in general can not be replaced by the stronger (standard) topology.
Key words and phrases:
functional limit theorem, regular variation, weak topology, extremal process, Lévy process
2010 Mathematics Subject Classification:
Primary 60F17; Secondary 60G52, G0G55, 60G70
1. Introduction
Consider a strictly stationary sequence of random variables and denote by and , , its accompanying sequences of partial sums and maxima, respectively. It is well known that if the are i.i.d. and regularly varying with index , then
[TABLE]
for some and and some –stable random variable , and
[TABLE]
for some and some random variable with an extreme-value distribution, see for example Gnedenko and Kolmogorov [15] and Resnick [24]. The weak convergence of partial maxima holds also for . The joint weak limiting behavior of with appropriate centering and scaling was investigated by Chow and Teugels [10]. They also obtained a functional limit theorem for a suitably normalized joint partial sum and partial maxima process. See also Anderson and Turkman [2] and Resnick [23] for related results.
In this paper, under the properties of weak dependence and joint regular variation with index for the sequence , we investigate functional convergence of the joint partial sum and partial maxima process in the space , where
[TABLE]
with being a sequence of positive real numbers such that
[TABLE]
as and
[TABLE]
Here, represents the greatest integer not larger than and is the space of –valued càdlàg functions on . The functional convergence of in the special case when is a linear process from a regularly varying distribution with index was studied recently in Krizmanić [19], [20].
The main result of our article shows that for a strictly stationary, regularly varying sequence of dependent random variables with index , for which clusters of high-treshold excesses can be broken down into asymptotically independent blocks, the stochastic process converge in the space endowed with the Skorohod weak topology under the condition that all extremes within each cluster of big values have the same sign. This topology is weaker than the more commonly used Skorohod topology, the latter being appropriate when there is no clustering of extremes (which for example occurs in the i.i.d. case).
The paper is organized as follows. In Section 2 we introduce the essential ingredients about regular variation, weak dependence and Skorohod topologies. In Section 3 we state and prove our main result using a new limit theorem derived recently by Basrak and Tafro [9] for the time-space point processes . Finally, in Section 4 we illustrate by an example that the weak convergence in our main theorem, in general, can not be replaced by the standard convergence.
2. Preliminaries
2.1. Regular variation
Let . We equip with the topology in which a set has compact closure if and only if it is bounded away from zero, that is, if there exists such that . Here denotes the max-norm on , i.e. where . Denote by the class of all nonnegative, continuous functions on with compact support.
We say that a strictly stationary process is (jointly) regularly varying with index if for any nonnegative integer the -dimensional random vector is multivariate regularly varying with index , i.e. there exists a random vector on the unit sphere such that for every and as ,
[TABLE]
the arrow ”” denoting weak convergence of finite measures. Regular variation can be expressed in terms of vague convergence of measures on as follows: for as in (1.1),
[TABLE]
where the limit is a nonzero Radon measure on given by
[TABLE]
for some , with .
Theorem 2.1 in Basrak and Segers [8] provides a convenient characterization of joint regular variation: it is necessary and sufficient that there exists a process with for such that, as ,
[TABLE]
where ”” denotes convergence of finite-dimensional distributions. The process is called the tail process of .
2.2. Point processes and dependence conditions
Let be a strictly stationary sequence of random variables and assume it is jointly regularly varying with index . Let be the tail process of . In order to obtain weak convergence of the process we will use the so-called complete convergence result for the corresponding point process of jumps obtained recently by Basrak and Tafro [9], and then by the continuous mapping theorem and some properties of Skorohod topologies we will transfer this convergence result to the joint partial sum and maxima process.
Let
[TABLE]
with as in (1.1). The point process convergence for the sequence was already established by Basrak et al. [6] on the space for any threshold , with the limit depending on that threshold. Recently Basrak and Tafro [9] obtained a new convergence result for without the restriction to various domains (i.e. their convergence result holds on the space ).
The appropriate weak dependence conditions for this convergence result are given below. With them we will be able to control the dependence in the sequence .
Condition 2.1**.**
There exists a sequence of positive integers such that and as and such that for every , denoting , as ,
[TABLE]
Condition 2.2**.**
There exists a sequence of positive integers such that and as and such that for every ,
[TABLE]
Condition 2.1 is implied by the strong mixing property (see Krizmanić [17]). For a discussion of Conditions 2.1 and 2.2 we refer to Bartkiewicz et al. [4] and Basrak et al. [6]. There are many time series satisfying these conditions, including moving averages, stochastic volatility and GARCH models (see for example Basrak et al. [6], section 4). By Proposition 4.2 in Basrak and Segers [8], under Condition 2.2 the following holds
[TABLE]
and is the extremal index of the univariate sequence . For a detailed discussion on joint regular variation and dependence Conditions 2.1 and 2.2 we refer to Basrak et al. [6], Section 3.4.
Under joint regular variation and Conditions 2.1 and 2.2, by Theorem 3.1 in Basrak and Tafro [9], as ,
[TABLE]
in , where is a Poisson process on with intensity measure where , and is an i.i.d. sequence of point processes in independent of and with common distribution equal to the distribution of , where and is distributed as
Denote by a point process with the distribution equal to the distribution of . For it holds that
[TABLE]
(see Davis and Hsing [12]), but it may fail for (see Mikosch and Wintenberger [22]). In the latter case we will have to assume (2.9).
2.3. The weak and strong topologies
The stochastic processes that we consider have discontinuities, and hence for the function space of their sample paths we take the space of all right-continuous –valued functions on with left limits.
The stochastic processes and converge (separately) in the space equipped with the standard topology, see Basrak et al. [6] and Krizmanić [16]. In this paper we use the weak topology, since as we show later the functional convergence for in general fails to hold in the standard topology on . In the sequel we give the definitions of the weak and standard (strong) topologies.
For the completed graph of is the set
[TABLE]
where is the left limit of at and is the product segment, i.e. for . We define an order on the graph by saying that if either (i) or (ii) and for all . Note that the relation induces only a partial order on the graph . A weak parametric representation of the graph is a continuous nondecreasing function mapping into , with being the time component and being the spatial component, such that and . Let denote the set of weak parametric representations of the graph . For define
[TABLE]
where . Now we say that in for a sequence in the weak Skorohod (or shortly ) topology if as .
Now we recall the definition of the standard topology. For let
[TABLE]
where for . We say is a parametric representation of if it is a continuous nondecreasing function mapping onto . Denote by the set of all parametric representations of the graph . Then for put
[TABLE]
is a metric on , and the induced topology is called the (standard or strong) Skorohod topology. The topology is weaker than the standard topology on . The topology coincides with the topology induced by the metric
[TABLE]
for and . The metric induces the product topology on . For detailed discussion of the strong and weak topologies we refer to Whitt [30], sections 12.3–12.5.
3. Functional convergence of
In this section we show the convergence of the joint partial sum and maxima process
[TABLE]
in the space equipped with Skorohod weak topology. We identify the limit as , where is a stable Lévy process and an extremal process. First we represent as the image of the time-space point process under an appropriate sum-maximum functional. Then, using certain continuity properties of this functional, by the continuous mapping theorem we transfer the weak convergence of in (2.8) to weak convergence of .
3.1. The sum-maximum functional
Fix and define the sum-maximum functional
[TABLE]
by
[TABLE]
The space of Radon point measures on is equipped with the vague topology and is equipped with the weak topology. For convenience we set . Let , where
[TABLE]
Observe that the elements of have the property that atoms in with the same time coordinate are all on the same side of the time axis. Similar to Lemma 3.1 in Basrak et al. [6] one can prove the following result.
Lemma 3.1**.**
Assume that with probability one the tail process in (2.4) has no two values of the opposite sign. Then .
Now we will show that is continuous on the set .
Lemma 3.2**.**
The sum-maximum functional is continuous on the set , when is endowed with the weak topology.
Proof.
Take an arbitrary and suppose that in . We need to show that in according to the topology. By Theorem 12.5.2 in Whitt [30], it suffices to prove that, as ,
[TABLE]
Now one can follow, with small modifications, the lines in the proof of Lemma 3.2 in Basrak et al. [6] to obtain as .
Let
[TABLE]
Since is a Radon point measure, the set is dense in . Fix and take such that . Later, when , we assume convergence to [math] is through a sequence of values such that for all (this can be arranged since is a Radon point measure). Since the set is relatively compact in , there exists a nonnegative integer such that
[TABLE]
By assumption, does not have any atoms on the border of the set . Hence, by Lemma 7.1 in Resnick [25], there exists a positive integer such that for all it holds that
[TABLE]
Let for be the atoms of in . By the same lemma, the atoms of in (for ) can be labeled in such a way that for every we have
[TABLE]
In particular, for any we can find a positive integer such that for all ,
[TABLE]
If , then (for large ) the atoms of and in are all situated in . Hence and , which imply
[TABLE]
If , take . Then we have
[TABLE]
Therefore form (3.1) and (3.2) we obtain
[TABLE]
and if we let , it follows that as . Note that and are nondecreasing functions. Since convergence for monotone functions is equivalent to pointwise convergence in a dense subset of points plus convergence at the endpoints (Whitt [30], Corollary 12.5.1), we conclude that as . Hence is continuous at . ∎
3.2. Main theorem
Let be a strictly stationary sequence of random variables, regularly varying with index . The theorem below gives conditions under which the joint partial sum and maxima process satisfies a functional limit theorem with the limit , where is an –stable Lévy process and is an extremal process.
The distribution of a Lévy process is characterized by its characteristic triple, that is, the characteristic triple of the infinitely divisible distribution of . The characteristic function of and the characteristic triple are related in the following way:
[TABLE]
for . Here , are constants, and is a measure on satisfying
[TABLE]
Remark 3.3**.**
For it is sometimes convenient to rewrite the characteristic function of an –stable random variable in the following form
[TABLE]
where , and (Sato [26], Theorem 14.15). The representations of the characteristic function of a stable distribution in the Lévy-Khintchine representation (3.3) and relation (3.4) are connected in the following way:
[TABLE]
where
[TABLE]
with (see Lemma 2 in Feller [14], p. 541, and Theorem 14.3 and Lemma 14.11 in Sato [26]).
The distribution of a nonnegative extremal process is characterized by its exponent measure in the following way:
[TABLE]
for and , where is a measure on satisfying for any (see Resnick [25], page 161).
The description of the characteristic triple of and the exponent measure of in the limiting process will be in terms of the measures and on defined by
[TABLE]
and
[TABLE]
where
[TABLE]
and
[TABLE]
with and as defined in Section 2.2. When we need an additional assumption to deal with the small jumps.
Condition 3.4**.**
For all ,
[TABLE]
Condition 3.4 is not easily checked for dependent sequences, but for instance it holds for –mixing processes with a certain rate (see Tyran-Kamińska [29]). In the case we will assume additionally
[TABLE]
with the convention if (for a discussion about condition (3.5) see Basrak et al. [7], Remark 4.8). Let
[TABLE]
with and as in (2.3).
Theorem 3.5**.**
Let be a strictly stationary sequence of random variables, jointly regularly varying with index , and of which the tail process almost surely has no two values of the opposite sign. Suppose that Conditions 2.1 and 2.2 hold. If suppose also Condition 3.4 and relation (2.9) hold, and for assume further that (3.5) holds. Then the stochastic process
[TABLE]
with and as in (1.1) and (1.2), satisfies
[TABLE]
in endowed with the weak topology, where , is an –stable Lévy process with characteristic triple and is an extremal process with exponent measure .
Proof.
Take an arbitrary , and consider
[TABLE]
From Lemma 3.1 and Lemma 3.2 we know that is continuous on the set and this set almost surely contains the limiting point process from (2.8). Hence an application of the continuous mapping theorem yields in under the weak topology, i.e.
[TABLE]
From (2.2) we have, as ,
[TABLE]
for every , and this convergence is uniform in . Hence applying Lemma 2.1 from Krizmanić [20] (adjusted for the convergence) to (3.7) and (3.8) we obtain, as ,
[TABLE]
where
[TABLE]
and
[TABLE]
Now we split the rest of the proof into two cases: and .
Assume first . Let , . Since , from (2.9) we obtain
[TABLE]
It is straightforward to check that , , are the points of a Poisson process with intensity measure for (see Proposition 5.2 and Proposition 5.3 in Resnick [25]). These points are summable, i.e.
[TABLE]
almost surely (see the proof of Theorem 3.1 in Davis and Hsing [12]), and therefore for all
[TABLE]
almost surely as . By the dominated convergence theorem
[TABLE]
almost surely as . Since uniform convergence implies Skorohod convergence, we get
[TABLE]
almost surely as . Let
[TABLE]
Recalling the definition of the metric in (2.10), from (3.10) we obtain
[TABLE]
almost surely as . Since almost sure convergence implies weak convergence, we have, as ,
[TABLE]
in endowed with the weak topology. By Proposition 5.2 and Proposition 5.3 in Resnick [25], the process
[TABLE]
is a Poisson process with intensity measure . Similarly, the process
[TABLE]
is a Poisson process with intensity measure . By the Itô representation of the Lévy process (see Resnick [25], pages 150–153) and Theorem 14.3 in Sato [26],
[TABLE]
is an –stable Lévy process with characteristic triple . Also
[TABLE]
is an extremal process with exponent measure (see Resnick [25], page 161).
If we show that
[TABLE]
for any , from (3.9) and (3.11) by a variant of Slutsky’s theorem (see Theorem 3.5 in Resnick [25]) it will follow that as , in with the weak topology. Since the metric on is bounded above by the uniform metric on (Whitt [30], Theorem 12.10.3), it suffices to show that
[TABLE]
Using stationarity, Markov’s inequality and the fact that
[TABLE]
we get the bound
[TABLE]
For the first term on the right-hand side of (3.12) we have
[TABLE]
Since is a regularly varying random variable with index , it follows immediately that
[TABLE]
as . By Karamata’s theorem
[TABLE]
Therefore, taking into account relation (1.1), we get
[TABLE]
as . Observe that
[TABLE]
almost surely as , and thus
[TABLE]
as . Therefore from (3.12) we obtain
[TABLE]
Letting , since , we finally obtain
[TABLE]
Assume now . Since (2.9) holds by assumption in this case, by Lemma 6.4 in Basrak et al. [7] there exists an –stable Lévy process such that, as (along some subsequence)
[TABLE]
uniformly almost surely. As in the case we obtain, as ,
[TABLE]
in endowed with the weak topology, where
[TABLE]
As before, we need to show that
[TABLE]
since then by the Slutsky argument it will follow as , in with the weak topology. Recalling the definitions of and , we have
[TABLE]
Therefore, from Condition 3.4 and (3.13) it follows
[TABLE]
To conclude the proof it remains to show that is the characteristic triple of the process . According to Basrak et al. [7], Remark 4.7 (see also Davis and Hsing [12], Theorem 3.2), the characteristic function of is of the form
[TABLE]
where, with the notation ,
[TABLE]
and
[TABLE]
with . Then, as noted in Remark 3.3, the characteristic triple of the process is of the form , where \sigma(\mathrm{d}x)=\big{(}c_{1}1_{(0,\infty)}(x)+c_{2}1_{(-\infty,0)}(x)\big{)}|x|^{-\alpha-1}\mathrm{d}x and , with
[TABLE]
and
[TABLE]
Hence taking into consideration relations (3.15) and (3.16), by standard computations we obtain
[TABLE]
and
[TABLE]
Therefore . For , as shown in the proof of Theorem 3.2 in Davis and Hsing [12], it holds that \theta\mathrm{E}\Big{[}\sum_{j}\eta_{j}^{\langle\alpha\rangle}\Big{]}=p-q, and this implies
[TABLE]
Note that \mathrm{E}\Big{[}\sum_{j}\eta_{j}\Big{]}=c_{+}-c_{-} for , which yields
[TABLE]
Hence , and thus the Lévy process has characteristic triple . ∎
Remark 3.6**.**
From the proof of Theorem 3.5 it follows that the components of the limiting process can be expressed as functionals of the limiting point process from relation (2.8), i.e.
[TABLE]
where the limit in the latter case holds almost surely uniformly on (along some subsequence), and
[TABLE]
Remark 3.7**.**
The weak convergence in Theorem 3.5 in general can not be replaced by the standard convergence. This is shown in Example 4.2. The problem in our proof if we consider the standard topology is Lemma 3.2, which in this case does not hold. To see this, fix and define
[TABLE]
Then , where
[TABLE]
It is easy to compute
[TABLE]
Then
[TABLE]
and similarly
[TABLE]
Hence for all , which means that does not converge to zero as . Since
[TABLE]
(Whitt [30], Theorem 12.7.1), we conclude that does not converge to zero. Therefore the functional is not continuous at with respect to the standard topology.
4. Examples
Various classes of stationary sequences are covered by our main theorem, such as squared GARCH processes, linear processes, moving maxima and ARMAX processes (see Basrak et al. [6] and Krizmanić [16]). Here we present in detail only linear processes and moving maxima processes, and for the latter we show that Theorem 3.5 fails to hold under the standard topology on .
Example 4.1**.**
(Linear processes) Let be an i.i.d. sequence of regularly varying random variables with index . Consider the linear process of the form
[TABLE]
where the sequence of real numbers is such that
[TABLE]
(under this condition the series in (4.1) is a.s. convergent, see Resnick [24], Section 4.5). We assume also . It holds that
[TABLE]
(Cline [11], Theorem 2.3). The tail process of the linear process is of the following form:
[TABLE]
where is an –valued random variable such that and , and is an integer valued random variable, independent of , with distribution given by
[TABLE]
(see Meinguet and Segers [21], Example 9.2). In [21] the extremal index from (2.7) was also computed, and it is given by
[TABLE]
Then, as noted in Basrak et al. [7], Section 3.3, it holds that
[TABLE]
Assume now all coefficients are of the same sign. This assumption ensures that the tail process has no two values of the opposite sign. Theorem 3.5 directly applies to the case of a finite order linear processes, since in this case all conditions in the mentioned theorem are satisfied (see Basrak et al. [6], Example 4.3). Hence for , according to Remark 3.6, we have
[TABLE]
and
[TABLE]
where and , , are i.i.d. copies of . The characteristic triple of the process is , where
[TABLE]
[TABLE]
with and as in (2.3), and as in (3.6) with
[TABLE]
[TABLE]
For , reduces to
[TABLE]
The exponent measure of the process is of the form
[TABLE]
where
[TABLE]
One can show that these expressions are consistent with the results obtained in Krizmanic [20] for linear processes from a regularly varying distribution with index (with some differences due to different centering and normalizing sequences that are being used).
For infinite order linear processes with all coefficients of the same sign the idea is to approximate them by a sequence of finite order linear processes for which Theorem 3.5 applies, and to show that the error of approximation is negligible in the limit (for an example of this procedure see Krizmanić [20], Section 4).
Example 4.2**.**
(Moving maxima). Let be a sequence of i.i.d. Fréchet random variables with shape parameter , i.e. for . Hence is regularly varying with index . For simplicity we consider only the case . Consider the finite order moving maxima
[TABLE]
where and are nonnegative constants such that at least and are not equal to zero. Take a sequence of positive real numbers such that as . Then
[TABLE]
(Cline [11], Theorem 2.3). The random process is jointly regularly varying with index (Tafro [28], Example 2.1.12). Since the sequence is –dependent, it follows immediately that Conditions 2.1 and 2.2 hold (see for instance Example 5.1 in Krizmanić [16]). Therefore satisfies all conditions of Theorem 3.5, and the corresponding stochastic process converges in distribution in under the weak topology.
Next we show that does not converge in distribution under the standard topology on . This shows that the weak topology in Theorem 3.5 in general can not be replaced by the standard topology. In showing this we use, with appropriate modifications, a combination of arguments used by Basrak and Krizmanić [5] in their Example 4.1 and Avram and Taqqu [3] in their Theorem 1 (see also Example 5.1 in Krizmanić [18]).
For simplicity take and . We have and , where
[TABLE]
Let
[TABLE]
The first step is to show that does not converge in distribution in endowed with the (standard) topology. For this, according to Skorohod [27] (see also Proposition 2 in Avram and Taqqu [3]), it suffices to show that
[TABLE]
for some , where
[TABLE]
( and
[TABLE]
Note that is the distance from to , and is the oscillation of .
Let be the index at which is obtained. Fix and introduce the events
[TABLE]
and
[TABLE]
Using the facts that is an i.i.d. sequence and as for (which follows from the regular variation property of and (4.2)) we get
[TABLE]
and
[TABLE]
(see Example 5.1 in Krizmanić [16]). On the event one has and for every , , so that
[TABLE]
Therefore after standard calculations we obtain
[TABLE]
and
[TABLE]
On the set it also holds that
[TABLE]
which implies that
[TABLE]
Taking into account (4.6) and (4.7) we obtain
[TABLE]
on the event . Therefore, since is nondecreasing in , it holds that
[TABLE]
Note that tends to infinity as , and therefore we can find such that , i.e.
[TABLE]
For this , by relations (4.4) and (4.5), it holds that
[TABLE]
i.e.
[TABLE]
Thus by (4.9) we obtain
[TABLE]
and (4.3) holds, i.e. does not converge in distribution in endowed with the (standard) topology.
If would converge in distribution to some in the standard topology on , then using the fact that linear combinations of the coordinates are continuous in the same topology (see Theorem 12.7.1 and Theorem 12.7.2 in Whitt [30]) and the continuous mapping theorem, we would obtain that converges to in endowed with the standard topology, which is impossible, as is shown above.
Acknowledgements
This work has been supported in part by Croatian Science Foundation under the project 3526 and by University of Rijeka under the project numbers 13.14.1.2.02 and 17.15.2.2.01.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1]
- 2[2] Anderson, C. W. and Turkman, K. F., The joint limiting distribution of sums and maxima of stationary sequences, J. Appl. Probab. 28 (1991), 33–44.
- 3[3] Avram, F. and Taqqu, M., Weak convergence of sums of moving averages in the α 𝛼 \alpha –stable domain of attraction, Ann. Probab. 20 (1992), 483–503.
- 4[4] Bartkiewicz, K., Jakubowski, A., Mikosch, T. and Wintenberger, O., Stable limits for sums of dependent infinite variance random variables, Probab. Theory Relat. Fields 150 (2011), 337–372.
- 5[5] Basrak, B., Krizmanić, D., A multivariate functional limit theorem in weak M 1 subscript 𝑀 1 M_{1} topology, J. Theoret. Probab. 28 (2015), 119–136.
- 6[6] Basrak, B., Krizmanić, D. and Segers, J., A functional limit theorem for partial sums of dependent random variables with infinite variance, Ann. Probab. 40 (2012), 2008–2033.
- 7[7] Basrak, B., Planinić, H. and Soulier, P., An invariance principle for sums and record times of regularly varying stationary sequences, Probab. Theory Related Fields 172 (2018), 869–914.
- 8[8] Basrak, B. and Segers, J., Regularly varying multivariate time series, Stochastic Process. Appl. 119 (2009), 1055–1080.
