Tail asymptotics for the area under the excursion of a random walk with heavy-tailed increments
Denis Denisov, Elena Perfilev, Vitali Wachtel

TL;DR
This paper investigates the tail behavior of the distribution of the area under positive excursions of a heavy-tailed, negatively drifting random walk, providing asymptotic results for tail probabilities.
Contribution
It derives the asymptotics of tail probabilities for the area under excursions of a heavy-tailed random walk with negative drift, a novel analysis in this context.
Findings
Established asymptotic formulas for tail probabilities
Characterized the influence of heavy tails on the area distribution
Extended understanding of random walk excursion areas with heavy-tailed increments
Abstract
We study tail behaviour of the distribution of the area under the positive excursion of a random walk which has negative drift and heavy-tailed increments. We determine the asymptotics for tail probabilities for the area.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Tail asymptotics for the area under the excursion of a random walk with heavy-tailed increments
Denis Denisov
School of Mathematics, University of Manchester, Oxford Road, Manchester M13 9PL, UK
,
Elena Perfilev
Institut für Mathematik, Universität Augsburg, 86135 Augsburg, Germany
and
Vitali Wachtel
Institut für Mathematik, Universität Augsburg, 86135 Augsburg, Germany
Abstract.
We study tail behaviour of the distribution of the area under the positive excursion of a random walk which has negative drift and heavy-tailed increments. We determine the asymptotics for tail probabilities for the area.
Key words and phrases:
Random walk, subexponential distribution, heavy-tailed distribution, integrated random walk
1991 Mathematics Subject Classification:
Primary 60G50; Secondary 60G40, 60F17
1. Introduction and statement of results
Let be a random walk with i.i.d. increments . We shall assume that the increments have negative expected value, . Let be the tail distribution function of . Let
[TABLE]
be the first time the random walk exits the positive half-line. We consider the area under the random walks excursion :
[TABLE]
Since is finite almost surely, the area is finite as well. In this note we will study asymptotics for as , in the case when distribution of increments is heavy-tailed. This paper continues the research of [9], where the light-tailed case has been considered.
The heavy-tailed asymptotics for was studied previously by Borovkov, Boxma and Palmowski [2]. They considered the case when the increments of the random walk have a distribution with regularly varying tail, that is where is a slowly varying function. For they showed
[TABLE]
These asymptotics can be explained by a traditional heavy-tailed one big jump heuristics. In order to have a huge area, the random walk should have a large jump, say , at the very beginning of the excursion. After this jump the random walk goes down along the line according to the Law of Large Numbers. Thus, the duration of the excursion should approximately be around . As a result, the area will be of order . Now, from the equality one infers that a jump of order is needed. Since the same strategy is valid for the maximum of the first excursion, one can rewrite (1) in the following way:
[TABLE]
However, the class of regularly varying distributions does not include all subexponential distributions and excludes, in particular, log-normal distribution and Weibull distribution with parameter . The asymptotics for these remaining cases have been put as an open problem in [8, Conjecture 2.2] for a strongly related workload process. We will reformulate this conjecture as follows
[TABLE]
when and is a sublclass of subexponential distributions. Note that using the asymptotics for
[TABLE]
from [5] for Weibull distributions with parameter , one can see that in this case asymptotics (2) is equivalent to (1). In this note we partially settle (2). It is not difficult to show that the same arguments hold for the workload process and to prove the same asymptotics for the area of the workload process, thus settling the original [8, Conjecture 2.2]. In passing we note that it is doubtful that (2) holds in full. The reason for that is that for both and the asymptotics (3) and (2) are no longer valid for Weibull distributions with parameter . The analysis for involves more complicated optimisation procedure leading to a Cramer series and it is unlikely that the answers will be the same for the area and for the exit time.
1.1. Main results
We will now present the results. We will start with the regularly varying case. In this case the connection between the tails of and is strong and we will be able to use the asymptotics for found in [6], see also a short proof in [3], to find the asymptotics for .
Proposition 1**.**
We have the following two statements.
- (a)
If with some and then, uniformly in ,
[TABLE]
- (b)
If , where is a monotone continuously differentiable function satisfying for , and for some then (4) holds uniformly in
This statement implies obviously the following lower bound for the tail of :
[TABLE]
Furthermore, using this proposition, one can give an alternative proof of (1) under the assumption of the regular variation of , which is much simpler than the original one in [2]. We first split the event into two parts
[TABLE]
Clearly,
[TABLE]
and, therefore,
[TABLE]
When , according to Theorem I in Doney [7] or [5, Theorem 3.2],
[TABLE]
Choosing and recalling that is regularly varying, we get
[TABLE]
It follows from the first statement of Proposition 1 that
[TABLE]
Plugging this and (7) into (6), we get, as ,
[TABLE]
Letting , we arrive at (1).
The case of semi-exponential distributions is more complicated. In particular it seems that in this case there is a regime when the asymptotics (1) are no longer valid. We will treat this case by using the exponential bounds similar to Section 2.2 in [9] and asymptotics for from [5] and [4].
First we will introduce a sublclass of subexponential distributions that we will consider. We will assume that . Without loss of generality we may assume that . Let
[TABLE]
where is an eventually increasing function such that eventually
[TABLE]
for some . Due to the asymptotic nature of equivalence in (8) without loss of generality we may assume that is continuously differentiable and that (9) hold for all . Clearly, monotonicity in (9) implies
[TABLE]
for all sufficiently large . Using the Karamata representation theorem one can show that this class of subexponential distributions includes regularly varying distributions for . Also, it is not difficult to show that lognormal distributions and Weibull distributions () belong to our class of distributions. Previously this class appeared in [10] for the analysis of large deviations of sums of subexponential random variables on the whole axis.
Now we are able to give rough(logarithmic) asymptotics for .
Theorem 2**.**
Let and . Assume that the distribution function of satisfies (8) and that (9) holds with . Then, there exits a constant such that
[TABLE]
Furthermore, for any there exist such that,
[TABLE]
In, particular, if then
[TABLE]
To obtain the exact asymptotics we will impose a further assumption
[TABLE]
This assumption implies that
[TABLE]
In particular, it excludes all regularly varying distributions.
Theorem 3**.**
Let and . Assume that the distribution function of satisfies (8), that (9) holds with and that (11) holds. Then,
[TABLE]
1.2. Discussion and organisation of the paper
In this note we provided exact asymptotics for the case . We believe that this restriction is not technical and the asymptotics for is different. This boundary is well-known, for example, the same bound appears in the analysis of the exact asymptotics for and , see, correspondingly [5] and [4].
The conjecture in [8] was formulated for the workload process of a single-server queue rather than the area under the random walk excursion. However, one can prove analogous results for the Lévy processes by essentially the same arguments. It is well-known that workload of the M/G/1 queue can be represent as a Lévy process and thus our results can be transferred to this setting almost immediately. We believe that the treatment of the workload of the general G/G/1 queue is not that different as well.
The paper is organised as follows. We will start by proving Proposition 1 in Section 2. Then we will derive a useful exponential bound and prove Theorem 2 in Section 3. Finally we derive exact asymptotics for and thus prove Theorem 3 in Section 4.
2. Proof of Proposition 1
Before giving the proof we will collect some known results that we will need in this and the following Sections. We will require the following statement, the first part of which follows from Theorem 2 in Foss, Palmowski and Zachary [6] (see also [3] for a short proof), and the second part from [5, Theorem 3.2].
Proposition 4**.**
Let and either (a) with some or (b) , where is a monotone continuously differentiable function satisfying for , and for some then for any fixed ,
[TABLE]
and
[TABLE]
Proof.
To prove (13), (14) and (15), by Theorem 2 of [6] it is sufficient to show that (a) or (b) implies that , that is and
[TABLE]
The fact that (a) implies is well-known and follows immediately from the dominated confergence theorem, since for all fixed and
[TABLE]
and for some when .
Now, assume that (b) holds and show that . Consider now
[TABLE]
Uniformly in we have
[TABLE]
and, therefore,
[TABLE]
Next for ,
[TABLE]
which implies that .
The proof of (16) is very similar and can be done by straightforward verification that (8) and (9) imply that conditions of Theorem 3.1 (and hence of Theorem 3.2) of [5] hold. ∎
Define
[TABLE]
Then, for every ,
[TABLE]
It wollows from (14) and (15) that
[TABLE]
It is clear that
[TABLE]
For every fixed we have
[TABLE]
For the last term on the right hand side we have
[TABLE]
It follows from (2) that , as . Then, using (15), we get
[TABLE]
where as .
For every fixed we have
[TABLE]
Since for all , we obtain
[TABLE]
and
[TABLE]
By the Markov property, for every ,
[TABLE]
Let if satisfies the conditions of the part (b) and let in the case when is regularly varying. Fix some and consider the set
[TABLE]
Since , it follows from the Marcinkiewicz-Zygmund Law of Large Numbers that
[TABLE]
This implies that, as ,
[TABLE]
On the event one has
[TABLE]
In other words,
[TABLE]
and
[TABLE]
Therefore, for all large enough,
[TABLE]
and
[TABLE]
Lemma 5**.**
For every fixed ,
[TABLE]
Proof.
Fix some and define the events
[TABLE]
It is clear that Therefore,
[TABLE]
For the first term we have
[TABLE]
where
[TABLE]
Furthermore,
[TABLE]
where
[TABLE]
Combining (21) and (22) and letting we set the desired relation. ∎
Since with the previous lemma
[TABLE]
for , we infer that
[TABLE]
and
[TABLE]
Under our assumptions on one has
[TABLE]
Therefore,
[TABLE]
Consequently,
[TABLE]
Combining (15) and (2), one gets
[TABLE]
Therefore,
[TABLE]
Consequently,
[TABLE]
Plugging (19) and (2) into (18) and letting , we obtain
[TABLE]
Thus, it remains to show that . This is obvious for regularly varying tails and .
Assume now that satisfies the conditions of part (b). To simplify notation put . Then,
[TABLE]
Since is monotone decreasing and is differentiable then clearly
[TABLE]
Then,
[TABLE]
Therefore,
[TABLE]
3. Proof of Theorem 2
We start by proving an exponential estimate for the area when random variables are truncated. Let
[TABLE]
The next result is our main technical tool to investigate trajectories without big jumps.
Lemma 6**.**
Let and . Assume that the distribution function of satisfies (8) and that (9) holds with . Then, there exists a constant such that
[TABLE]
where .
Proof.
We will prove this lemma by using the exponential Chebyshev inequality. For that we need to obtain estimates for the moment generating function of . First,
[TABLE]
where
[TABLE]
and
[TABLE]
Then,
[TABLE]
Using the elementary bound for we obtain,
[TABLE]
Next, using the integration by parts and the assumption (8),
[TABLE]
Now note that for ,
[TABLE]
due to the condition (9). Then,
[TABLE]
and, therefore,
[TABLE]
where we also used the Chebyshev inequality. As a result, for some constant ,
[TABLE]
Consequently,
[TABLE]
Finally,
[TABLE]
∎
We can now obtain a rough upper bound using the exponential bound in Lemma 6.
Lemma 7**.**
Let and . Assume that the distribution function of satisfies (8) and that (9) holds with . Then, there exists a constant such that
[TABLE]
Proof.
Clearly,
[TABLE]
First, using Lemma 6 with we obtain,
[TABLE]
where and With formula (25) at page 146 of Bateman [1] we have,
[TABLE]
Now using the asymptotics for the modified Bessel function
[TABLE]
we obtain
[TABLE]
Therefore,
[TABLE]
Next,
[TABLE]
Then, the claim follows. ∎
Now we will give a lower bound.
Lemma 8**.**
Let and . Then, for any there exists such that,
[TABLE]
Proof.
Fix . Put where will picked later. Since , by the Strong Law of Large Numbers,
[TABLE]
Hence, for any we can pick such that
[TABLE]
Now note that there exists a sufficiently large such that, for every ,
[TABLE]
Hence,
[TABLE]
For every fixed we have
[TABLE]
Furthermore, as . Therefore, we can pick sufficiently large such that
[TABLE]
Then, for all sufficiently large,
[TABLE]
As is arbitratily small we arrive at the conclusion. ∎
Completion of the proof of Theorem 2. The upper bound follows from Lemma 7. The lower bound follows from Lemma 8. The rough asymptotics follows immediately from the lower and upper bounds and from the observation that
[TABLE]
where .
To prove (25) we note that by (9) and (10)
[TABLE]
This implies that, as ,
[TABLE]
Recalling that
[TABLE]
one obtains easily (25).
4. Proof of Theorem 3
Set
[TABLE]
and
[TABLE]
where . First we will split the probability as follows
[TABLE]
The first term will be estimated using the exponential bound proved in Lemma 6.
Lemma 9**.**
Let and . Assume that (8) and (9) hold for some together with (11). Then,
[TABLE]
Proof.
According to (24),
[TABLE]
where and . Since (9) holds for some , and hence
[TABLE]
Then,
[TABLE]
To finish the proof it is sufficient to show that
[TABLE]
We first note that
[TABLE]
Using (10) and (9) one can see that
[TABLE]
Hence,
[TABLE]
According to (27), . Therefore, (29) is valid for any satisfying .
∎
Next lemma gives the term with the main contribution.
Lemma 10**.**
Under the assumptions of Lemma 9 we have the following estimate
[TABLE]
Proof.
Put
[TABLE]
By the total probability formula,
[TABLE]
Now note that by (30) and (27)
[TABLE]
Then the statement immediately follows.
∎
We will proceed to the analysis of . Fix some and set
[TABLE]
We will split further as follows,
[TABLE]
where
[TABLE]
and, correspondingly,
[TABLE]
We will start with easier terms and . To deal with these terms we will use Proposition 4. One can see then
Lemma 11**.**
Let the assumptions (8),(9) and (11) hold for . Then,
[TABLE]
Proof.
We have, by Proposition 4,
[TABLE]
Therefore,
[TABLE]
By the mean value theorem and by the assumption (11),
[TABLE]
for every . This completes the proof. ∎
Lemma 12**.**
Let the conditions of Lemma 10 hold. Then,
[TABLE]
Proof.
We can use the formula of total probability to write
[TABLE]
Then,
[TABLE]
Using now (30) one can see that
[TABLE]
in view of (12). ∎
We are left to analyse . For that introduce
[TABLE]
Now we will complete the proof with the following Lemma.
Lemma 13**.**
Let the assumptions (8),(9) and (11) hold for . Then,
[TABLE]
Proof.
First represent event , where
[TABLE]
Then,
[TABLE]
Then,
[TABLE]
By (30),
[TABLE]
Then, in view of the relation (12) we have
[TABLE]
which implies that .
To estimate
[TABLE]
we make use of the exponential bound given in Lemma 6. Put putting
[TABLE]
Then, we have,
[TABLE]
where . Now note that
[TABLE]
Since
[TABLE]
we obtain,
[TABLE]
Thus,
[TABLE]
Next, we can pick to achieve
[TABLE]
by the condition (9). Note that since , the picked as well. Then,
[TABLE]
and using (30),
[TABLE]
Finally noting that
[TABLE]
is decreasing polynomially we obtain required convergence to [math]. The polynomial decay can be immediately seen for . However, a proper proof goes as follows,
[TABLE]
Therefore,
[TABLE]
∎
Completion of the proof of Theorem 3 Combination of the preceding Lemmas give us the upper bound. The lower bound has been shown in (5) under even weaker conditions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Bateman, H. Tables of Integral Transforms. Vol.1 Mc Graw-Hill Book Company, INC. 1954.
- 2[2] Borovkov, A.A., Boxma, O.J., and Palmowski, Z. On the integral of the workload process of the single server queue. J. Appl. Probab., 40 :200–225, 2003.
- 3[3] Denisov, D. A note on the asymptotics for the maximum on a random time interval of a random walk. Markov Process. Relat. Fields 11 165-–169, 2005.
- 4[4] Denisov, D., Dieker, A. B. and Shneer, V. Large deviations for random walks under subexponentiality: The big-jump domain. Ann. Probab. 36 1946–1991, 2008.
- 5[5] Denisov, D. and Shneer, V. Asymptotics for the first passage times of Lévy processes and random walks. J. Appl. Probab. 50 64-–84, 2013.
- 6[6] Foss, S., Palmowski, Z. and Zachary, S. J. Appl. Probab. , 15 (3):1936–1957, 2005.
- 7[7] Doney, R.A. On the asymptotic behaviour of first passage times for transient random walks. Probab. Theory Relat. Fields, , 81 , 239–246, 1989.
- 8[8] Kulik, R. and Palmowski, Z. Tail behaviour of the area under a random process, with applications to queueing systems, insurance and percolations. Queueing Syst. 68 :275–284, 2011.
