Independence by Random Scaling
Lancelot F. James, Peter Orbanz

TL;DR
This paper establishes conditions for coupling a scalar random variable with a scaled version to achieve independence, extending known results and applying to Poisson-Dirichlet distributions and diffusion excursions.
Contribution
It provides new conditions for independence via random scaling and generalizes existing results to negative parameter ranges and diffusion processes.
Findings
Conditions for independence coupling of T and ξT
Generalization of Pitman-Yor result to negative parameters
Application to diffusion excursions and exponential times
Abstract
We give conditions under which a scalar random variable T can be coupled to a random scaling factor such that T and T are rendered stochastically independent. A similar result is obtained for random measures. One consequence is a generalization of a result by Pitman and Yor on the Poisson-Dirichlet distribution to its negative parameter range. Another application are diffusion excursions straddling an exponential random time.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace and Expression Recognition
\setattribute
copyrighttext
\startlocaldefs
\endlocaldefs
Independence by random scaling
Lancelot F. Jameslabel=e1][email protected] [
Peter Orbanzlabel=e2][email protected] [ HKUST and Columbia University
Deparment of Information Systems, Business
Statistics, and Operations Management
Clear Water Bay, Kowloon
Hong Kong
Department of Statistics
1255 Amsterdam Avenue
New York, NY-10027, USA
Abstract
We give conditions under which a scalar random variable can be coupled to a random scaling factor such that and are rendered stochastically independent. A similar result is obtained for random measures. One consequence is a generalization of a result by Pitman and Yor on the Poisson-Dirichlet distribution to its negative parameter range. Another application are diffusion excursions straddling an exponential random time.
60G57,
60C05,
60E99,
60G52,
Poisson-Dirichlet distributions, stable subordinators, independence, random measures, passage times,
keywords:
[class=MSC]
keywords:
and
1 Introduction and main results
Distributional identities involving elementary random variables play an important role in probability and related fields. Such identities arise, for instance, in the study of path properties of stochastic processes [13, 12, 10], and in applications of Stein’s method [15]. A fundamental example is the following: For , generically denote by a variable. If and are independent, then . Lukacs [11] has shown this property is exclusive to gamma variables, and hence characterizes the gamma distribution. This result and its ramifications are collectively known as the beta-gamma algebra. Its relevance to path properties of Brownian motion and related phenomena is highlighted by Revuz and Yor [22].
The distributional properties studied in the following are of the form
[TABLE]
Lukacs’ characterization shows such variables exist—take and —but also implies is a sum of independent variables only if these variables are gamma. Pitman and Yor [21] have identified another case: Fix and , and abbreviate . Let be an -stable density, a variable with density proportional to , and denote by a generalized gamma subordinator, i.e. a non-decreasing Lévy process on with Lévy density . Then
[TABLE]
which follows from the proof of [21, Proposition 21]. Rescaling to gives
[TABLE]
Clearly, (2i) is an instance of (1).
Since both gamma and stable variables are distinguished by their scaling behavior, it is natural to ask in how far scaling properties are intrinsic to (1). Our first result shows that the relevant property is not scaling per se, but rather a form of exponential tilting. In the case of the stable, this exponential tilt manifests as a scaling operation; at close inspection, the relationship is visible already in [20]. Let be a non-negative random variable with density and cumulant function . For any such random variable, the exponentially tilted variable and the polynomially tilted variable T_{0}^{\text{\tiny\rm[\nu]}} are given by the densities
[TABLE]
for , and for chosen such that .
Theorem 1**.**
Fix , and let be a positive random variable with cumulant function and . Let and be positive, absolutely continuous random variables. Then
[TABLE]
holds if and only if the pair satisfies
[TABLE]
Conditional tilting thus yields a large class of random variables satisfying (1), and the scaled variable is always gamma.
The variables in (2) take scalar values. It is shown in [21], however, that the property extends to the entire path of the process : For any ,
[TABLE]
Combined with Theorem 1, this suggests an analogous result for general subordinators, which we state in terms of random measures: Let be a Polish space, a probability measure on , and a Lévy density on . We assume is strictly positive and continuous, and . Let be the points of a Poisson process on with mean measure . Then is a random measure on , with a.s. If is a non-negative function with , the random measure specified by
[TABLE]
again satisfies . If is the cumulant function of the scalar variable , one can define an exponential tilt of as .
Theorem 2**.**
Let and be random measures of the general form (6), let be the cumulant function of , and fix such that . Then
[TABLE]
if and only if and .
The results are related through the total masses of the random measures: If and satisfy Theorem 2, their total masses and satisfy Theorem 1.
Theorem 2 can be applied to normalized random measures: As is almost surely finite, is a random discrete probability measure [8]. Since in (7i) is independent of , and is a functional of , it follows that
[TABLE]
The conditions above imply is of the form
[TABLE]
and is a random sequence with almost surely. It is hence no loss of generality to assume is the uniform law on , or to neglect the atoms altogether. Throughout, we treat random probability measures and random sequences interchangeably. If the total mass of the random measure in (6) has density , then has density . This density, and the Lévy density of , completely determine the law of , which is called a Poisson-Kingman distribution [18], and denoted . A distinguished example within the Poisson-Kingman family are the two-parameter Poisson-Dirichlet distributions , with parameters and [8, 21]. For , they are known to satisfy (8): There is a random measure with total mass such that satisfies
[TABLE]
If , this is once again Proposition 21 of [21], and can be derived from (5) by choosing , in which case has law . If , choose for a gamma subordinator instead; then , and the result follows from Lukacs’ characterization.
Relative to Proposition 21 of Pitman and Yor [21], our results imply an extension to the case : Start with a generalized gamma subordinator and . Size-biasing the process turns it into a bridge
[TABLE]
In Section 2.3, we construct scalar random variables and such that randomizing by defines a random measure
[TABLE]
for which the weights of have law .
Proposition 3**.**
For any and , the ranked weights derived from (9) satisfy , independently of
[TABLE]
The remainder of this article describes applications and examples; proofs are collected in the appendix. While the results apply to quite general processes, our examples emphasize the stable subordinator, which leads to interesting extensions of Proposition 21 of [21].
2 Application to generalized gamma subordinators
In this section, we consider the scaled and time-changed process that already arose above. This process can be equivalently represented by exponentially tilting a stable subordinator [21]: Let denote the density of an -stable random variable, and an -stable Lévy density. If is a subordinator with Lévy density , then
[TABLE]
where the left-hand side is well-defined even if . The variable
[TABLE]
Exponentially tilted Lévy densities as the one above define a class of Poisson-Kingman distributions for which our results take a special form: For a Lévy density and , let be the total mass of a random measure defined by . The Poisson-Kingman distribution {\text{\rm PK}(\lambda,\mathcal{L}(T_{0}^{\text{\tiny\rm[\nu]}}))} can be embedded in a one-parameter family {\text{\rm PK}(e^{-bt}\lambda(t),\mathcal{L}(T_{b}^{\text{\tiny\rm[\nu]}}))}, for , where is the total mass of a random measure defined by . The conditioning operation in Theorem 2 then takes the form of a parameter shift: A random probability measure with law satisfies (8) if and only if
[TABLE]
where is the cumulant function of .
2.1 The basic case
Suppose the random measure in Theorem 2 is defined as for all . The total mass then has cumulant function , and substituting into the theorem yields
[TABLE]
Consequently, the random probability measure
[TABLE]
The variables and satisfy
[TABLE]
The resulting law of is . For and , this law is specifically , which recovers Proposition 21 of Pitman and Yor [21]. Both the independence property in (10) and equality in distribution to remain true if is randomized by mixing against any positive random variable.
2.2 Size-biasing
If is any positive random variable with density , we denote by the size-biased variable with density . For an independent uniform variable on , the process
[TABLE]
and can be regarded as a size-biased form of [14, 16]. Since the summands are independent, their cumulant functions are additive, and the cumulant function of is
[TABLE]
For the random measure defined on the interval by , the distributions in Theorem 2 then take the form
[TABLE]
As the variable can be defined by tilting and size-biasing a stable variable, its density is . The marginal law of is then
[TABLE]
and we obtain:
Proposition 4**.**
Let be the -stable density. If the weights of a random probability measure have law {\text{\rm PK}(f_{\alpha},\mathcal{L}(X_{\alpha,b}^{\text{\tiny\rm[\nu]}}))}, it can be represented as for
[TABLE]
and satisfies and and .
For example, choose , and abbreviate . Then, for any ,
[TABLE]
i.e. the value of the process , taken at a suitable random time, decouples from itself by random scaling. This also shows the unbiased case in Section 2.1 can be recovered from the size-biased one by choosing : Observe the term on the left is distributed as , for any . For and , we may substitute , where has density proportional to as in Section 2.1 above. Then
[TABLE]
which recovers all cases in Section 2.1.
2.3 Poisson-Dirichlet models
A random measure can be represented as
[TABLE]
This can be read from Dong, Goldschmidt, and Martin [2], or indeed from Pitman and Yor [20]. Define
[TABLE]
Now index the random variable in (12) explicitly by the value of as , and let denote the variable obtained by mixing against .
Lemma 5**.**
Let be defined as in (12). For each , let . Then
[TABLE]
We have hence established the result stated in the introduction:
Proof of Proposition 3.
Substitution of for in Proposition 4 yields the random measure defined in (9). By (13), it normalizes to a measure with weights , and the claim follows from Proposition 4. ∎
2.4 Implications for -diversities
For , it is known [19] that
[TABLE]
The random variable can be interpreted in terms of a local time, and is also known as the -diversity of the exchangeable random partition of defined by : If is the number of distinct blocks in the restriction of this partition to the subset , then almost surely as . The case arises in Bayesian statistics, stochastic processes, and models for random trees and graphs [e.g. 3, 5, 6, 15, 24].
The law considered above is , where as in (11). For , the variable is the -diversity of the two-parameter Chinese restaurant process [19]. More generally, for any value , the resulting partition is of Gibbs type [19], since defines a stable subordinator. There hence exists a subclass of Gibbs-type measures that is strictly larger than the Poisson-Dirichlet family, and whose -diversity exhibits a similar independence property .
3 Application to excursions straddling an exponential random time
This section considers applications to a type of distributions and processes that arise in a range of contexts, including passage times of Lévy processes, excursions of regular linear diffusions, interval partitions generated by a subordinator, and also in applications in statistics and finance [e.g. 1, 4, 7, 9, 21, 17, 24].
3.1 Independence of scaled excursion durations
Let again be a subordinator, with Lévy density and a.s., and denote its Lévy exponent . Following Winkel [24] and the exposition in [1], define the local time process , overshoot process , and undershoot process as
[TABLE]
where is the prepassage height, i.e. the left-hand limit . For an independent exponential time , abbreviate
[TABLE]
The variable can be interpreted as the duration of the excursion from [math] to [math] of a strongly recurrent linear diffusion that straddles the random time , and whose inverse local time is [23]. The density of and the joint density of are known to be
[TABLE]
see [17, 24, 23] regarding , and [23, eq. (33)] for . For , we define as the subordinator with exponentially tilted Lévy density
[TABLE]
An additional polynomial tilt yields the subordinator with Lévy density
[TABLE]
If the scalar variable in Theorem 1 is chosen as , the resulting law of is
[TABLE]
The variable in the theorem is then .
Proposition 6**.**
Fix and , let be a random variable with law (15). Then the conditional density of is , and
[TABLE]
The process is compound Poisson with rate and jump density
[TABLE]
whenever , in particular for .
Since , it follows that the excursion duration satisfies
[TABLE]
The result does not imply independence of and the entire process .
3.2 A concrete example
Let have Lévy density
[TABLE]
Changing parameters to , and comparing to the generalized gamma subordinator used in Section 2, shows (16) is up to a constant the Lévy density of the subordinator . The Lévy exponent of , and hence the variable defined by (15), depend on the sign of . We must distinguish three cases:
and : is a generalized gamma process with infinite activity and parameter , with
[TABLE]
where is a generalized gamma subordinator. 2. 2.
and : is a gamma process, with
[TABLE]
where is a gamma subordinator with Lévy density . The weights of the random measure have law , independently of . 3. 3.
For and , one obtains a compound Poisson process, with
[TABLE]
where is a Poisson process with rate , and the variables are i.i.d. .
In each case, the excursion duration is conditionally distributed as
[TABLE]
and satisfies , independently of .
Acknowledgments. LFJ was supported in part by grant RGC-HKUST 601712 of the HKSAR. PO was supported in part by grant FA9550-15-1-0074 of AFOSR.
Proofs
Proof of Theorem 1.
If (4) holds, the joint density of is
[TABLE]
if is the density of . It can be disintegrated either into and , which recovers (4), or into and , in which case
[TABLE]
which is just (3iii). For any measurable functions and , a change of variables then yields
[TABLE]
so (3i) and (3ii) are also true. Conversely, assume (3) holds, and hence in particular (17). The joint density of is then
[TABLE]
If additionally is any positive function and ,
[TABLE]
which is the product of the two terms in (4). ∎
The proof of Theorem 2 is similar.
Proof of Lemma 5.
has density . Integrating against the density of given in (12) shows has marginal density
[TABLE]
Taking Laplace transforms yields (14)(i), which implies is equal in distribution to , and hence yields (14)(ii). ∎
Proof of Proposition 6.
(i) holds by construction and Theorem 1. To obtain (ii) and (iii), abbreviate and . The joint density of is then
[TABLE]
It follows that, for any measureable function ,
[TABLE]
and integrating out yields . ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Bertoin et al. [2006] J. Bertoin, T. Fujita, B. Roynette, and M. Yor. On a particular class of self-decomposable random variables: the durations of Bessel excursions straddling independent exponential times. Probab. Math. Statist. , 26(2):315–366, 2006.
- 2Dong et al. [2006] R. Dong, C. Goldschmidt, and J. B. Martin. Coagulation-fragmentation duality, Poisson-Dirichlet distributions and random recursive trees. Ann. Appl. Probab. , 16(4):1733–1750, 2006.
- 3Favaro et al. [2009] S. Favaro, A. Lijoi, R. H. Mena, and I. Prünster. Bayesian nonparametric inference for species variety with a two parameter poisson-dirichlet process prior. J. R. Stat. Soc. Ser. B , 71:993–1008, 2009.
- 4Gnedin and Pitman [2005] A. Gnedin and J. Pitman. Regenerative composition structures. Ann. Probab. , 33(2):445–479, 2005.
- 5Goldschmidt and Haas [2015] C. Goldschmidt and B. Haas. A line-breaking construction of the stable trees. Electron. J. Probab. , 20:1–24, 2015.
- 6James [2007] L. F. James. Lamperti-type laws. Ann. Appl. Probab. , 20(4):1303–1340, 2007.
- 7James et al. [2015] L. F. James, P. Orbanz, and Y. W. Teh. Scaled subordinators and generalizations of the Indian buffet process. 2015. Preprint. {http://arxiv.org/abs/1510.07309} .
- 8Kingman [1975] J. F. C. Kingman. Random discrete distributions. J. R. Stat. Soc. Ser. B , 37:1–22, 1975.
