Coupled Continuous Time Random Maxima
Katharina Hees, Hans-Peter Scheffler

TL;DR
This paper develops a limit theory for coupled continuous time random maxima, including dependent waiting times and events, deriving distribution functions, Laplace transforms, and fractional differential equations for the limit processes.
Contribution
It introduces a new limit theorem for dependent waiting times and events in CTRM, including the OCTRM case, with explicit formulas and governing equations.
Findings
Derived distribution functions for limit processes.
Provided Laplace transform formulas for CTRM and OCTRM.
Established fractional differential equations governing the distributions.
Abstract
Continuous Time Random Maxima (CTRM) are a generalization of classical extreme value theory: Instead of observing random events at regular intervals in time, the waiting times between the events are also random variables with arbitrary distributions. In case that the waiting times between the events have infinite mean, the limit process that appears differs from the limit process that appears in the classical case. With a continuous mapping approach we derive a limit theorem for the case that the waiting times and the subsequent events are dependent and for the case that the waiting times dependent on the preceding events (in this case we speak of an Overshooting Continuous Time Random Maxima, abbr. OCTRM). We get the distribution functions of the limit processes and a formula for a Laplace transform for the CTRM and the OCTRM limit. With this formula we have another way to calculate…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHydrology and Drought Analysis · Financial Risk and Volatility Modeling · Probabilistic and Robust Engineering Design
Coupled Continuous Time Random Maxima
Katharina Hees and Hans-Peter Scheffler
Katharina Hees, Institut für medizinische Biometrie und Informatik, Universität Heidelberg, 69120 Heidelberg, Germany
Hans-Peter Scheffler, Deparment Mathematik, Universität Siegen, 57072 Siegen, Germany
Abstract.
Continuous Time Random Maxima (CTRM) are a generalization of classical extreme value theory: Instead of observing random events at regular intervals in time, the waiting times between the events are also random variables with arbitrary distributions. In case that the waiting times between the events have infinite mean, the limit process that appears differs from the limit process that appears in the classical case. With a continuous mapping approach we derive a limit theorem for the case that the waiting times and the subsequent events are dependent and for the case that the waiting times dependent on the preceding events (in this case we speak of an Overshooting Continuous Time Random Maxima, abbr. OCTRM). We get the distribution functions of the limit processes and a formula for a Laplace transform for the CTRM and the OCTRM limit. With this formula we have another way to calculate the distribution functions of the limit processes, namely by inversion of the Laplace transform. Moreover we present governing equations, which are in our case time fractional differential equations whose solutions are the distribution functions of our limit processes. Because of the inverse relationship between the CTRM and its first hitting time we get also the Laplace transform of the distribution function of the first hitting time.
1. Introduction
Classical extreme value theory assumes that observations are collected at regular intervals, or at non random points in time. In some applications, random waiting times between observations are heavy tailed. For waiting times with regularly varying probability tails the mean waiting time can be infinite. In that case, the renewal process that counts the number of observations by time grows at a sub-linear rate, and the renewal theorem does not apply (see e.g. [4], XI.5).
This paper develops the limiting behavior of the rescaled extremal observation as tends to infinity. Complementary to [11], where it is assumed that the waiting times and the observations are independent, we allow arbitrary dependence between the th waiting time and the th observation. Silvestrov and Teugels [16, 17] developed a general theory for the joint behavior of sums and maxima in random observation times. However, they do not compute the CDF of the limit process, which is the main result of this paper, see Theorem 4.1 below. Pancheva and Jordanova [12] specifically consider the case of infinite mean waiting times, by adapting arguments from [9], along with a powerful transfer theorem ([16], Theorem 3). However in all those papers it is assumed that the waiting times and the observations are at least asymptotically independent.
Allowing arbitrary dependence leads to various technical problems and the methods used in the above mentioned papers do not apply. Inspired by the well developed theory of (coupled) continuous time random walks, see [1, 10, 6], using recent results on jointly sum/max-stable laws and their domains of attraction, presented in [5], we solve this problem completely.
This paper is organized as follows: Section 2 lays out our basic assumptions, defines the processes we want to analyze and recalls some of the results in [5] needed in the formulation and proof of our main results. Section 3 presents process convergence of the CTRM and OCTRM processes using a continuous mapping approach. In section 4 we present the main result of this paper: We derive closed formulas for the CDF of the CTRM and OCTRM limit processes at a fixed point of time and compute the Laplace transform in time of those CDFs. Finally in section 5 we explicitly compute two examples showing the usefulness of the developed theory.
2. Problem formulation and basic results
Let be a sequence of iid -valued random variables modeling the th waiting time and the corresponding observation. Observe that we allow arbitrary dependence between and . Define
[TABLE]
which is the time of the -th observation resp. the maximum of the first observations. The associated partial sum-process S and the partial max-process M are defined by the paths and . Furthermore we define to be the renewal process which paths are given by
[TABLE]
This process counts the number of observations until time . Next we define the main processes of study of this paper.
Definition 2.1**.**
We call the process which is defined by
[TABLE]
Continuous Time Random Maxima (CTRM). Furthermore we call the process defined by
[TABLE]
overshooting Continuous Time Random Maxima (OCTRM).
The process is the process which gives you the maximum observation that appears until time . The OCTRM gives you also the maximum observation, but there you consider one additional jump. That means that in the OCTRM model, the waiting time is dependent of the subsequent jump size . In section 3 we prove a limit theorem for the long time behavior of this two processes. In order to do so, we need to make a natural assumption on the distribution of . Namely, we assume that there exist and such that
[TABLE]
where denotes convergence in distribution and and are assumed to be non-degenerated. Consequently the random variable is -stable with and has an extreme value distribution, hence is Fréchet, Weibull or Gumbel distributed. If (2.1) holds we say belongs to the sum-max-domain of attraction of and that is sum-max stable. A complete characterization of sum-max stable laws and their domains of attraction is presented in the recent paper [5]. Let us briefly recall some of the notations and results in [5] needed in the formulation and proofs of our main results in section 4.
For a probability measure on let
[TABLE]
for and . is called the CDF-Laplace transform (C-L transform) of .
Let denote the distribution function of in 2.1 and its left endpoint, that is
[TABLE]
By Theorem 3.5 in [5] we know that the C-L transform of the limit distribution in (2.1) can be written as
[TABLE]
for all and , where is called C-L exponent and given by
[TABLE]
for some -finite measure on called the Lévy-exponent measure of . Explicit formulas for and are given in Theorem 3.8, Theorem 3.13 and Proposition 3.11 of [5]. It follows that
[TABLE]
is the Lévy measure of and the exponent measure of , respectively. Especially it is shown in Corollary 3.10 of [5] that and in (2.1) are independent if and only if
[TABLE]
Moreover is the log-Laplace transform of that is
[TABLE]
and .
For the proof of the limit theorem for the long time behavior of our CTRM and OCTRM process under the condition (2.1) we need the next result, which tells us that the joint convergence of the sum- and the max-process is equivalent to condition (2.1). It is well known that under the assumption that belongs to the domain of attraction of a -stable random variable the partial sum-process converges in the topology with an appropriate scaling to a -stable subordinator, i.e.
[TABLE]
see for example Theorem 7.1 and Corollary 7.1 in [9]. Similarly, it is a well known result that under the assumption that belongs to the max-domain of attraction of an extreme value distributed random variable , that the partial max-process converges in the topology to a -extremal process, i.e.
[TABLE]
see for example Proposition 4.20 in [14]. The F-extremal process is defined by its finite dimensional distributions
[TABLE]
for , times and all . Especially it is . The next Theorem establishes the -convergence of the partial (joint) sum-max-process.
Theorem 2.2**.**
There exist and such that
[TABLE]
*if and only if *
[TABLE]
where and . The limit process is uniquely defined by the C-L transforms of its finite-dimensional distributions, which are given by
[TABLE]
with , and .
Proof.
The proof is similar to the proof in the case which can be found in [2]. ∎
3. Limit Theorem for the CTRM
In this section we prove a limit theorem for the long time behavior of CTRM and OCTRM processes. It is based on the following more general theorem for triangular arrays. The method of proof relies heavily on techniques developed in [19]. For any let be a sequence of iid -valued random vectors. Define the processes resp. by their paths and where
[TABLE]
Furthermore we define the renewal process by
[TABLE]
Then are
[TABLE]
the corresponding CTRM and OCTRM processes.
In the following, denotes the subset of the Skorokhod space of all functions that are unbounded from above and and the subset of all functions , with non-decreasing and strictly increasing. Furthermore set and .
We denote by the left continuous version of a càdlàg path and by the right continuous version of a càglàd path . For the purpose of better readability we sometimes also write and instead of and . Moreover we define the left continuous and right continuous inverse of a path by
[TABLE]
An unbounded, increasing function with and jumps of height one is called a discrete time change.
Theorem 3.1**.**
Let be a discrete time change and for all a sequence of -valued random vectors, such that
[TABLE]
where we assume that the paths of are a.s. strictly monotone increasing. Then
[TABLE]
where is the inverse stable subordinator.
Proof.
We first look at the case . We define . From the proof of Proposition 2.4.2 in [19] it follows that
[TABLE]
Define the mappings and by
[TABLE]
It follows that
[TABLE]
Furthermore it follows as in the proof of Proposition 2.4.2 in [19] that
[TABLE]
If we now assume that is an arbitrary discrete time change, there exists a time change such that . Hence it follows with Lemma 2.4.1 in [19], that
[TABLE]
Let be the distribution of and the distribution of . Assumption (3.1) is equivalent to in as . Let . In Lemma 2.2.1 in [19] it is shown that is Borel-measurable. Furthermore . We denote by and the restrictions and on , respectively. Due to Corollary 3.3.2 in [3] we have
[TABLE]
where is equipped with the relative topology. In Proposition 2.3.8 in [19] it is shown further that belongs to the set of continuities of and and in Lemma 2.3.5 in [19] that these two mappings are measurable. Let and denote the set of discontinuities of and , respectively. Due to the assumption that the subordinator has a.s. strictly increasing paths we have . Consequently we get . Using the Continuous Mapping Theorem it then follows that
[TABLE]
and this is equivalent to the assertion. This concludes the proof. ∎
Using Theorem 3.1 above, we are now able to prove the following limit theorem for the long time behavior of the CTRM and the OCTRM. If the waiting times between the jumps have a finite mean, it is a classical result of renewal theory that the renewal process is asymptotically equivalent to a multiple of the time variable, i.e.
[TABLE]
As a consequence, the appropriate scaled CTRM (resp. OCTRM) behaves asymptotically like a classical extremal process. The interesting case is if the waiting times between the jumps have an infinite mean. This is the case if we assume that the waiting times are in the domain of attraction of a -stable distribution for some .
Theorem 3.2**.**
Let be iid and -valued random vectors. We assume that there exist and such that
[TABLE]
where is strictly -stable with and has an extreme value distribution. Then there exist functions and such that
[TABLE]
Here is a F-extremal process with , where is the distribution function of . Furthermore is the (left continuous) inverse of the stable subordinator .
Proof.
In view of Theorem 2.2 we know that there exists a function which is regularly varying with index and functions and such that
[TABLE]
Since is regularly varying with index , is regularly varying with index . Hence there exists a function regularly varying with index such that as . (cf. p.738 in [1] or Property 1.5.5. in [15]). Let be defined as . Then as in . It follows with the generalized continuous-mapping theorem (see for example Theorem 3.4.4. in [21]) that
[TABLE]
Using Theorem 3.1 with and , and since if follows that
[TABLE]
The proof for the OCTRM is similar. ∎
4. Law of the CTRM and OCTRM scaling limit
In this section we derive the distribution functions of the limit processes obtained in Theorem 3.2. The next theorem provides two ways to calculate the distribution function of the CTRM and the OCTRM long time limit at a fixed point of time. On one hand we get a closed formula for calculating the distribution function based on the joint distribution of and the Lévy measure of . However, the joint distribution of is only in a few cases explicitly given. On the other hand we obtain a formula for a Laplace transform in time of the CDFs which can be used to calculate the distribution functions by inversion of the Laplace transform. This method will be used in the examples presented in section 5.
In the following let be the right endpoint of the distribution function of the extreme value distributed random variable , i.e.
[TABLE]
Theorem 4.1**.**
(a) For a fixed the distribution function of the CTRM limit in (3.6) in Theorem 3.2 is given by
[TABLE]
Furthermore for an arbitrary and for all we have the following Laplace transform:
[TABLE]
(b) For a fixed the distribution function of the OCTRM limit in (3.7) in Theorem 3.2 is given by
[TABLE]
Furthermore for an arbitrary and for all we have the following Laplace transform:
[TABLE]
The proof is based on a series of Lemmas presented in the following.
Lemma 4.2**.**
For an arbitrary and it is
[TABLE]
where is the C-L exponent of .
Proof.
For an arbitrary and we get with Fubini’s Theorem
[TABLE]
Furthermore we obtain due to and the definition of the C-L exponent
[TABLE]
∎
Lemma 4.3**.**
The functions and defined in (4.1) and (4.3) are distribution functions. Furthermore, for fixed the mappings and for are right-continuous. Additionally for an arbitrary and any we have
[TABLE]
and
[TABLE]
Proof.
We first show that and are distribution functions. For an arbitrary we get on the one hand that
[TABLE]
and on the other hand we we have
[TABLE]
Since
[TABLE]
where we used in the last line Corollary 6.2 in [7], it follows with dominated convergence that
[TABLE]
Similarly we can show with the dominated convergence that and . Monotonicity is obvious. That is right-continuous follows likewise with the dominated convergence since
[TABLE]
and hence we get as above that . With the same argument it follows that , as well. Monotonicity of is again obvious.
Next we show that for a fixed the mapping is right-continuous. For an arbitrary we get
[TABLE]
We first consider and obtain as in the proof of Theorem 3.1 in [10] that converges to [math] as . In fact
[TABLE]
Due to the fact that is right-continuous, we get as
[TABLE]
for all . Additionally we have
[TABLE]
and
[TABLE]
due to Corollary 6.2 in [7] it then follows that as . It remains to show that as . This also follows along the lines of proof of Theorem 3.1 in [10]. We have
[TABLE]
It then follows that
[TABLE]
as . Hence is right-continuous. We now show that is right-continuous, too. For and we get
[TABLE]
It follows as for and above, that as
[TABLE]
Consequently is also right-continuous. Next we show (4.6). Compute
[TABLE]
Since
[TABLE]
and inserting this in (4.8), we obtain
[TABLE]
Similarly we can show (4.7), because with change of variables we have
[TABLE]
and with Lemma 4.2 it follows that
[TABLE]
∎
In the following let and denote the left resp. the right endpoint of the distribution function of , i.e.
[TABLE]
Moreover, let , denote the Laplace transform of .
Lemma 4.4**.**
- (a)
For the CTRM process we have for all and all that
[TABLE]
- (b)
For the OCTRM process we have for all and all that
[TABLE]
Proof.
First we will show (a). Since we get
[TABLE]
Observe that in view of Proposition 2.3 in [5] we have
[TABLE]
Changing the order of integration and with a change of variables we obtain
[TABLE]
If we put (LABEL:BeweisLTCTRM2) and (4.11) in (LABEL:BeweisLTCTRM1) we receive
[TABLE]
Now we will prove (b). As in the proof of (a) we have
[TABLE]
The first part of the integral simplifies to
[TABLE]
For the second part of the integral we get
[TABLE]
If we put (LABEL:BeweisLTCTRM5) and (LABEL:BeweisLTCTRM6) in (4.12) we obtain
[TABLE]
and the proof is complete. ∎
Lemma 4.5**.**
Under the assumptions of Theorem 3.2 we have:
- (a)
For the CTRM process we have for all and all
[TABLE]
- (b)
For the OCTRM process we have for all and all
[TABLE]
Proof.
We know from the proof of Theorem 3.2 that there exists a regularly varying function with index with as , furthermore functions and , such that
[TABLE]
With the continuity theorem for the C-L transform (see Theorem 3.2 in [5]), it follows that
[TABLE]
for all and . Then it follows from Proposition 2.3 of [5] that
[TABLE]
If we now apply the logarithm on each side and use that as we get
[TABLE]
for all and . If we let in (4.18) it follows due to that
[TABLE]
If we set it follows since that
[TABLE]
Now we can prove (a). With the change of variables we get
[TABLE]
Using Lemma 4.4 (a) we then obtain for all
[TABLE]
By (4.18) and (4.19) we then get
[TABLE]
Now we’ll prove (b). As in the proof for (a) we obtain with
[TABLE]
With Lemma 4.4 (b) we have for all
[TABLE]
Finally, using (4.18) and (4.20) we then have
[TABLE]
and the proof is complete. ∎
We are now in the position to prove Theorem 4.1.
Proof of Theorem 4.1.
In view of Theorem 3.2 we know that
[TABLE]
Since the -convergence implies the convergence in all points in which the process is continuous in probability it follows
[TABLE]
in all but countable many , due to the fact that the process has càdlàg paths and hence no more than countable many discontinuities. As a consequence
[TABLE]
pointwise in all but countable many and . Therefore
[TABLE]
in all but countable many . By Lemma 4.5 we know that
[TABLE]
for all and all . Together with Lemma 4.3 it follows that
[TABLE]
for all but countable many . Due to the uniqueness of the Laplace transform it follows
[TABLE]
for all but countable many and . Since the sample paths of the process are càdlàg and hence right-continuous and due to the fact that is right-continuous it follows that the equality in (4.22) holds for all and for all but countable many . Since and are distribution functions, they are right-continuous as functions in x. Hence it follows that the equality in (4.22) holds for all and all . The proof for the OCTRM is similar. ∎
The following corollary answers the question under which conditions the CTRM and OCTRM limit processes are equal.
Corollary 4.6**.**
Under the assumptions of Theorem 4.1 the distributions of the CTRM and OCTRM processes are equal at any point in time if and only if and in (2.1) are independent.
Proof.
In view of (4.2) and (4.4) are equal the distributions of and are equal for all if and only if for all and . By Corollary 3.10 of [5] this is equivalent to the independence of and . ∎
Remark 4.7*.*
In [13] the case that there can be a dependence between the waiting times and the subsequent jumps and that the waiting times have infinite mean is also considered. There it is assumed that there exists a function with as , such that
[TABLE]
where is the tail function. But this condition is equivalent to asymptotic independence. It is enough to consider the 1-Fréchet case. In the following we assume that there exists such that
[TABLE]
where is -stable for some . Assume further that there exist such that
[TABLE]
where is -Fréchet. It follows from (4.23), that for ,
[TABLE]
because , as and as uniform on compact subsets. The uniform compact convergence of is not mentioned in (4.23) in [13], but is used in the proof for the limit distribution. Furthermore it follows that
[TABLE]
In addition we obtain
[TABLE]
Hence the Lévy-exponent measure of the limit distribution is concentrated on the coordinate axes. In view of (2.3) this is equivalent to and being independent.
5. Governing Equations and Examples
In this section we derive the so called governing equation for the distribution functions of the CTRM and OCTRM scaling limits. Those equations are time fractional pseudo differential equations whose solutions are those CDFs. Moreover we show in two examples, by explicit computations, the usefulness of the results in Theorem 4.1. Even though equations (4.1) and (4.3) provide explicit formulas, they depend on the joint distribution of which is hardly ever known explicitly. However, by Theorem 4.1 we have for all and
[TABLE]
and
[TABLE]
where
[TABLE]
and
[TABLE]
In the following we denote with the usual Laplace transform of a bounded and measurable function . Then (5.1) and (5.2) are equivalent to
[TABLE]
and
[TABLE]
for all and .
If we now apply in (5.3) and (5.4) on both sides the inverse Laplace transform and assume w.l.o.g. that D is a -stable subordinator with Laplace transform , we obtain for the distribution function of the CTRM limit
[TABLE]
and in view of Lemma 4.2 for the distribution function of the OCTRM limit
[TABLE]
Here is a pseudo-differential operator which is defined by
[TABLE]
for suitable functions . We call (5.5) and (5.6) the governing equations of the distribution functions of the CTRM and OCTRM scaling limits. We call the distribution functions of the scaling limits the mild solution of the governing equation, if they fulfill (5.3) and (5.4), respectively. The fractional derivative for of suitable functions is defined as the function whose Laplace transform equals for .
Example 5.1**.**
We first consider the case when the jumps and the waiting times are independent and hence and are independent as well. In view of Corollary 4.6 we have for all . In this case we obtain a governing equation with fractional time derivative. In the case that and are independent we have
[TABLE]
Let be -stable which Laplace transform is given by for some and let be a -extremal process, where is a Fréchet distribution. Hence
[TABLE]
In this case we get for the CTRM in (5.1)
[TABLE]
To get the solution, that is the distribution function of the (O)CTRM scaling limit, we apply on the right hand side in (5.8) the inverse Laplace transform. Observe that
[TABLE]
Let denote the density of . Since we have (cf. p.3 in [8])
[TABLE]
But and hence
[TABLE]
Together with (5.9) we can therefore write (5.8) as
[TABLE]
Inverting the Laplace transform yields
[TABLE]
This distribution function coincides with the distribution function of the scaling limit of the uncoupled CTRM in [11]. Rewrite (5.8) as
[TABLE]
to see that the governing equation in this case is given by
[TABLE]
Example 5.2**.**
Let be -stable for some such that , . Furthermore let be -Fréchet for some with , . Assume that and are independent and set . Let be iid copies of . Then, in view of Example 4.3 in [5] (2.1) holds with and . Moreover
[TABLE]
for . For the distribution function of the CTRM scaling limit we have by (5.1) that
[TABLE]
Using
- (i)
,
- (ii)
,
- (iii)
L^{-1}\Big{(}(\xi+x^{-\gamma})^{-\beta}\Big{)}(t)=t^{\beta-1}e^{-x^{-\gamma}t}/\Gamma(\beta),
we obtain for the distribution function of the CTRM scaling limit
[TABLE]
This is the distribution function of a random variable , where , with Beta distributed on and with density
[TABLE]
and is -Fréchet distributed with and independent of . Rewrite (5.11) as
[TABLE]
Applying the inverse Laplace transform on both sides, using
- (i)
and
- (ii)
the governing equation reads
[TABLE]
For the distribution function of OCTRM scaling limit we have by (5.2) that
[TABLE]
In view of Lemma 4.2 we have
[TABLE]
where is the Lévy measure of . From example 4.3 in [5] we know that
[TABLE]
with and . Hence we obtain
[TABLE]
Using again, we get the distribution function of the OCTRM scaling limit, namely
[TABLE]
Rewrite (5.14) as
[TABLE]
to obtain the governing equation
[TABLE]
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. Becker-Kern, M. M. Meerschaert, H. P. Scheffler (2004) Limit Theorems for Coupled Continuous Time Random Walks. The Annals of Probability 32 , No. 1, 730-756.
- 2[2] T. L. Chow, J. L. Teugels (1978) The sum and the maximum of iid random variables. Proc. Second Prague Symp. Asymptotic Statistics 81 , 81-92.
- 3[3] S. N. Ethier, T. G. Kurtz (2009) Markov Processes: Characterization and Convergence . John Wiley & Sons, New York.
- 4[4] W. Feller (1971) An Introduction to Probability Theory and its Applications , second ed., vol. II. Wiley, New York.
- 5[5] K. Hees, H. P. Scheffler (2016) The joint convergence of sum and maximum. ar Xiv.org . ar Xiv:1606.03109.
- 6[6] A. Jurlewicz, P. Kern, M.M. Meerschaert, H.-P. Scheffler (2012) Fractional governing equations for coupled random walks. Computers and Mathematics with Applications 64 , 3021–3036. Special Issue on Advances in Fractional Differential Equations III.
- 7[7] H. Kesten (1969) Hitting probabilities of single points for processes with stationary independent increments. American Mathematical Society 93 , 1-129.
- 8[8] M. M. Meerschaert, D. Benson, H. P. Scheffler, B. Baumer (2002) Stochastic solution of space-time fractional diffusion equations. Physical review. E Statistical, nonlinear, and soft matter physics 65 , 1103-1106.
