Change of measure technique in characterizations of the Gamma and Kummer distributions
Agnieszka Piliszek, Jacek Weso{\l}owski

TL;DR
This paper advances the characterization of Gamma and Kummer distributions by removing previous technical assumptions through a change of measure technique, providing a more complete understanding of their properties.
Contribution
It introduces a new approach using change of measure to characterize Gamma and Kummer distributions without smoothness or moment assumptions.
Findings
Characterizations of Gamma and Kummer distributions are completed without smoothness assumptions.
Change of measure technique effectively removes moment restrictions.
New regression-based conditions are established for distribution characterization.
Abstract
If and are independent random variables with distributions and then and are also independent for some and . Properties of this type are known for many important probability distributions and . Also related characterization questions have been widely investigated: Let and be independent and let and be independent. Are the distributions of and and , respectively? Recently two new properties and characterizations of this kind involving the Kummer distribution appeared in the literature. For independent and with gamma and Kummer distributions Koudou and Vallois observed that and are also independent, and Hamza and Vallois observed that and are independent. In 2011 and 2012 Koudou, Vallois characterizationsβ¦
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Change of measure technique
in characterizations
of the Gamma and Kummer distributions
Agnieszka Piliszek, Jacek WesoΕowski
Agnieszka Piliszek
WydziaΕ Matematyki i Nauk Informacyjnych
Politechnika Warszawska
Koszykowa 75
00-662 Warszawa, Poland
Jacek WesoΕowski
WydziaΕ Matematyki i Nauk Informacyjnych
Politechnika Warszawska
Koszykowa 75
00-662 Warszawa, Poland
Abstract.
If and are independent random variables with distributions nd then and are also independent for some transformations and . Properties of this type are known for many important probability distributions and . Also related characterization questions have been widely investigated. These are questions of the form: Let and be independent and let and be also independent. Are the distributions of and necessarily and , respectively?
Recently two new properties and characterizations of this kind involving the Kummer distribution appeared in the literature. For independent and with gamma and Kummer distributions Koudou and Vallois in [17] observed that and are also independent, and Hamza and Vallois in [13] observed that and are independent. In [16] and [17] characterizations related to the first property were proved, while the characterizations in the second setting have been recently given in [29]. These results were not fully satisfactory since in both cases technical assumptions on smoothness properties of densities of and were needed. In [31], the assumption of independence of and in the first setting was weakened to constancy of regressions of and given with no density assumptions. However, the additional assumption was introduced.
In the present paper we provide a complete answer to the characterization question in both settings without any additional technical assumptions regarding smoothness or existence of moments. The approach is, first, via characterizations exploiting some conditions imposed on regressions of given , which are weaker than independence, but for which moment assumptions are necessary. Second, using a technique of change of measure we show that the moment assumptions can be avoided.
1. Introduction
In 2009 Koudou and Vallois (their paper, [17], was published in 2012) tried to describe a class of distributions of independent and positive random variables and (their distributions) and functions such that and are independent. Two special cases have already been known in the literature.
- β’
Lukacs in [20]: and are gamma distributed random variables and , .
- β’
Matsumoto and Yor in [25]: and are generalized inverse Gaussian and gamma distributed random variables, respectively, and , .
Interestingly, due to the restriction imposed in [17], the first case was not identified there. Related characterizations were obtained in [20] for the first property and in [19] for the second. Let us emphasize that neither smoothness of densities nor existence of moment assumptions were required in both these characterizations.
In [17] the following new interesting case was discovered: has the Kummer distribution with the density
[TABLE]
and has the gamma distribution with the density
[TABLE]
and . Consequently, the random variables
[TABLE]
are independent. Moreover, has the beta first kind distribution with the density
[TABLE]
and has the Kummer distribution, .
Note that the Kummer distribution is well-defined iff and , Note that in the case it is just the natural exponential family parameterized by and generated by the second kind beta distribution. It seems that the Kummer distribution appeared for the first time in 1953 in connection with Dysonβs model of a disordered chain, [10]; its connection with random continued fractions was observed in [23]; it has been appearing in Bayesian models in queueing theory, [3], reliability analysis, [30] or [28] and econometrics, [4]; it has also been considered as a generalization of the gamma distribution, e.g. [1], [12] or [27] (and applied to drought data in the latter paper); for the distribution belongs to the generalized gamma convolutions and as such is infinitely divisible, see Th. 6.2.4 in the monograph [5]; in [2], where it appears in connection with gamma finite mixtures, it is called Kobayashiβs gamma-type distribution and thus related to problems of diffraction theory, [22].
The independence property (1) was extended to matrix variate Kummer and Wishart distributions in [14]. For more information on the matrix variate Kummer distribution one can consult [26] and Ch. 3 of [11] (the latter reference is for random matrices with complex entries). It is also known that in the univariate case, under appropriate smoothness assumptions on densities, a characterization counterpart of the property holds: if and are independent positive random variables, and also and , given by (1), are independent then and for some positive constants . Originally this result was proved in [17] under requirements that the densities of and are strictly positive and twice differentiable on . Then, in [16] it was proved under strict positivity of densities and local integrability of their logarithms. Letac in [18] (see also Remark 2.2. in [31]) conjectured that such a characterization is possibly true with no assumptions on densities. In Section 3 we prove even a stronger result: instead assuming independence of and and independence of and we impose weaker conditions which are expressed through certain relations between conditional moments of positive order of given , while the assumption of independence and is kept. Since, by its definition is bounded, no moment assumptions are necessary. This is a major difference when compared with [31], where the constancy of regressions of and given was considered. In this paper an additional requirement was needed to assure that is well defined. Our main characterization result related to (1) is given in Th. 3.2. Through a proper change of measure the original regression problem is reduced to the one solved in [31] with the required moment assumption being automatically satisfied. Finally, we utilize the results obtained under regression assumptions to obtain the characterization by independence without any smoothness or integrability conditions.
Another independence property of the Kummer and gamma distributions has been recently discovered in [13]: if and then
[TABLE]
are independent, and . A related characterization assuming smoothness of densities (as well as its multivariate version with transformations defined in the language of directed trees) has been obtained in [29] (some preliminary observations have been made also in [15]). In Section 2 we provide regression version of the characterization, Th. 2.1, which is in parallel to the result from [31] we mentioned above. Th. 2.2 is a counterpart of Th. 3.1 recalled in the latter paragraph and uses a change of measure technique and Th. 2.1. However, in both these theorems we need to assume the existence of appropriate moments of and . The main result is Th. 2.5, in which we give characterization of Kummer and gamma distributions assuming only that and are positive and independent and that and are independent. In the proof we again apply the technique of a change of measure. This time it allows to reduce the problem to the one considered in Th. 2.2, though no moment assumptions are required. We also note (Cor. 2.6) that the latter result allows to improve the characterization known in the multivariate case.
2. Characterizations related to the Hamza and Vallois property
We consider a setting proposed in [13] and developed in [29]: and are independent and and are defined in (2). We begin with a characterization of Kummer and gamma laws by constancy of regression of and given . It is an analogue of Th. 3.1 from [31].
Theorem 2.1**.**
Let and be independent positive non-degenerate random variables, such that , and . For and defined in (2) suppose that there exist real constants and such that
[TABLE]
[TABLE]
Then and there exists a constant such that
[TABLE]
Proof.
Note that
[TABLE]
This observation and Eq. (3) allows us to write that
[TABLE]
Now, we will show that for any . We rewrite Eq. (6) as
[TABLE]
When we multiply both sides of (7) by and take expectation, we get
[TABLE]
and see that finitness of the second moment of is guaranteed by the fact that , as assumed. If we multiply (7) again by the same factor, we conclude that implies . So, we can obtain the finiteness of all the moments of by multiplying (7) by , and taking expectations. (Of course, since, under assumptions of the theorem, is bounded). Therefore, we can multiply Eq.(7) by and take expectation of both sides to obtain a recurrence relation
[TABLE]
where and , .
By the definition of , Eq. (4) is equivalent to
[TABLE]
Again, since all required moments exist, we multiply the equation by , and take expectation to obtain
[TABLE]
On the left-hand side of Eq. (9) we use an elementary identity
[TABLE]
Thus we have
[TABLE]
and it holds for , with . Taking instead of in Eq. (10) we get
[TABLE]
Now we subtract Eq. (10) from Eq. (11). The factor cancels out and we have
[TABLE]
where and were defined earlier. The left-hand sides of (8) and (12) are identical and so are the right-hand sides:
[TABLE]
After simplification, and since , we arrive at a linear relation of the form
[TABLE]
Iterating the above equation one gets , where , is a real constant and . It is easy to check, that is positive, since (here we use the fact that is not degenerate). Hence, . Let us recall that . We may conclude now, that .
In order to find the distribution of , we insert into Eq. (8) the values of , and thus
[TABLE]
Comparing the last result with recurrence relation for function
[TABLE]
in Abramowitz and Stegun (13.4.16) we can read at least one of the solutions of (13):
[TABLE]
Consequently where has a Kummer distribution: , satisfies the assumptions of the theorem. The question is, if it is the only solution. To prove that, we define a function real by
[TABLE]
where the last equality follows from the definition of . Note, that is well-defined at least for . From the recurrence relation (13) we obtain a differential equation for :
[TABLE]
where and .
As we have already observed, in the case the function solves Eq. (14). Suppose that there exists a solution of Eq. (14) when , say , and that this solution has the representation for a positive random variable . Then, the function satisfies
[TABLE]
where . The general solution of (15) is of the form
[TABLE]
where is such that
[TABLE]
We know that and this value is well defined and finite. On the other hand , as . Thus, . Given Eq. (16), we have
[TABLE]
The integral on the left hand side is finite as is bounded on and the rest of it is just a beta integral.
By the definition of it follows that is analytic in its domain covering a neighbourhood, say , of [math]. Therefore , , where , . Note, that
[TABLE]
So
[TABLE]
For due to (18) the equalities in (19) are straightforward. For the definition of implies and thus, .
Any of the first two cases in (19) is impossible since the integral at the left hand side of (17) is finite. The third equality implies that this integral in (17) equals zero. Since, according to (16), the integrand has constant sign on , it follows that . Thus . Now, recurrence relation (13) with and gives unique sequence and , where is the function mentioned earlier. So we have for all . Finally, since the support of the distribution of is a subset of , we conclude that .
β
Remark 2.1**.**
Under exactly the same assumptions as in Th. 2.1 above, the equation
[TABLE]
where , , has been recently derived in [15] as a first step in a search for the characterization.
Two important consequences of Th. 2.1 will be stated in the following theorems.
Theorem 2.2**.**
Let and be independent positive non-degenerate random variables. For a fixed we assume that
- (1)
, if ; 2. (2)
, and , if ; 3. (3)
, if .
Define and through (2). If for
[TABLE]
for some real constants and , then , and there exists a constant such that
[TABLE]
Proof.
We first notice that Eq. (20) for implies
[TABLE]
which can be rewritten in the integral form as
[TABLE]
Denote by a random variable with distribution
[TABLE]
which is possibly defined on a different probability space than and . By we denote a random variable with the same distribution as which is defined on the same probability space as in such a way that and are independent. Then we can rewrite last equality as
[TABLE]
where and . Given that, we have
[TABLE]
Again, Eq. (20) with results in
[TABLE]
With , , and defined as before, the latter is equivalent to
[TABLE]
By Eqs. (22) and (23), the assumptions of Th. 2.1 are satisfied for random variables and with , . Therefore, and . From (21), we conclude that random variable has density and
[TABLE]
The inequality follows from integrability of . β
Remark 2.2**.**
Similar extensions of the Lukacs and the Matsumoto-Yor properties were given in [8] and [9], respectively. However these authors, instead of the change of measure method, which was applied above, used the standard but more cumbersome approach leading to differential equations for characteristic functions.
Corollary 2.3**.**
Let and be independent positive non-degenerate random variables. For and defined in (2) assume that there exist constants and such that
[TABLE]
Then , and there exists such that
[TABLE]
Proof.
Note that (24) implies (20) with , and . β
Corollary 2.4**.**
Let and be independent positive non-degenerate random variables and , . For and defined in (2) assume that there exist constants and such that
[TABLE]
Then and there exists a constant such that
[TABLE]
Proof.
Note that (25) implies (20) with , and . β
This results can be compared with Th. 1.1 in [21] which is its analog for the Lukacs property.
2.1. Characterization through independence
In this subsection we answer the basic question: does the independence of and for independent, positive and non-degenerate and (with no technical assumptions of smoothness of densities or integrability) characterizes Gamma and Kummer laws? Until now the only result from the literature is the equation
[TABLE]
, , obtained in [15] (Lem. 5.1.).
Below we give the complete solution of the characterization problem. Again we will use the change of measure technique.
Theorem 2.5**.**
Let and be independent positive non-degenerate random variables. Define and by (2). Suppose that and are independent. Then there exist such that ,
Proof.
Take and consider a random vector with distribution
[TABLE]
which is defined on some probability space, possibly different than the space and are defined on.
We also set and . For , due to (5) we have
[TABLE]
Therefore
[TABLE]
where and , and thus and are independent random variables.
Note that for
[TABLE]
Similarly, one can obtain the finiteness of and .
Due to independence of and we conclude that , and are non-random. Therefore, the assumptions of Th. 2.2 are satisfied with for . Thus, , where . Eventually, we conclude that and have required distributions with , and .
β
2.2. Remark on multivariate version
In [29] a multivariate analogue of the characterization of Kummer and gamma laws was considered. The approach was through a tree language and was in parallel to an earlier result of this kind involving a multivariate version of the Matsumoto-Yor property, see [24] and [6]. However the characterization given in [24] did not need any assumptions regarding density and its smoothness. Unfortunately, in the multivariate characterization given in [29] (Th. 4) we assumed that random vector X has density which is continuously differentiable. It was necessary for the first step in the inductive proof. Now, due to the result of Th. 2.5, we can omit this regularity condition. In order to state an improved version of Th. 4 from [29], first, we have to recall some definitions.
A graph , where is the set of nodes and is the set of edges, is called a tree, if it is connected and acyclic. A vertex of degree 1 is called a leaf.
Let be a tree of size . For a fixed root , we direct from the root towards leaves and denote such a directed tree by . Having the tree directed, we can say that node is a child of vertex (or is a parent of ) if and only if and the tree is directed from to (note that every node, unless it is a leaf, has at least one child and every node but the root has exactly one parent). The set of all children of in will be denoted by and the parent of vertex by .
For any (and hence ) and fixed set of parameters , () we define a transformation by
[TABLE]
where
[TABLE]
where by convention an empty product is equal to , i.e., if is a leaf then . The definition (28) is inverse recursive with a starting point being any vertex with maximal distance from the root .
Corollary 2.6**.**
Let be a tree of size . Let and be defined by (27) and (28). Let be a -dimensional random vector. Suppose that for every , which is a leaf of , the components of the random vector are independent. Then there exist and such that
[TABLE]
Proof.
We use induction with respect to . The case can be obtained from Th. 2.5 in the same way as Th. 3 in [29]. Then we just follow the proof of Th. 4 of [29]. β
3. Characterizations related to the Koudou and Vallois property
In this section we consider the property discovered in [17] and discussed also e.g. in [16] and [31]: and are independent and and are defined through (1).
3.1. Characterization through constancy of regressions
Our point of departure is the main result of [31] which is a counterpart of Th. 2.1 in this paper. We recall it here.
Theorem 3.1**.**
Let and be independent positive non-degenerate random variables and . Define and through (1). If
[TABLE]
for real constants and then and there exists a constant such that
[TABLE]
Since -a.s. one can consider conditional moments , without any additional assumptions. In the next result, we prove that some simple relations between such conditional moments characterize the Kummer and gamma laws of and . It is an analogue of Th. 2.2 and the results o for the Lukacs and Matsumoto-Yor property obtained in [8] and [9].
Theorem 3.2**.**
Let and be independent positive non-degenerate random variables. Let be a fixed number. In case assume .
Define and through (1). Let for and
[TABLE]
Then , and there exists such that
[TABLE]
Proof.
Note that if then all the moments we need: , and are finite since and in the case finiteness of these moments follows from the assumption since then .
Due to measurability of with respect to we can rewrite (30) as
[TABLE]
Equivalently, for we have
[TABLE]
Denote by a random variable with distribution
[TABLE]
which is defined on some probability space, possibly different than the probability space on which and are defined. Note that
[TABLE]
Consider a rv , defined on the same probability space as , in such a way that and are independent and . Then, dividing both sides of (31) by , we obtain
[TABLE]
and
[TABLE]
Denote and and note that due to (33) we have . That is (34) and (35) are equivalent to
[TABLE]
Then we see that (29) with and instead of and , respectively, and with and , is satisfied. Consequently, Th. 3.1 implies and for some constant
[TABLE]
Finally, from (32) we conclude that the density of exists and is of the form
[TABLE]
Consequently, integrability of implies and thus the distribution of is as asserted. β
Note that by taking a special positive value of in Th. 3.2 the following result can be obtained immediately.
Corollary 3.3**.**
Let and be independent positive non-degenerate random variables. For and defined in (1) assume that there exist constants and such that
[TABLE]
Then and there exists a constant such that
[TABLE]
Proof.
Note that (36) implies (30) with , and . β
This result can be compared with one of the main cases considered in [7] (see (i) od its Sec. 3), which is its analogue for the Lukacs property.
For a special negative value in Th. 3.2 we obtain another interesting particular case.
Corollary 3.4**.**
Let and be independent positive non-degenerate random variables and . For and defined in (1) assume that there exist constants and such that
[TABLE]
Then and there exists a constant such that
[TABLE]
Proof.
Note that (37) implies (30) with , and . β
Similarly, as Cor. 2.3 of the previous section, this result can be compared with Th. 1.1 in [21] which is its analogue for the Lukacs property.
3.2. Characterization through independence
We conclude the paper with the characterization of the Kummer and gamma laws by independence of and without any smoothness or moments conditions. We utilize the results obtained above for regressions.
Corollary 3.5**.**
Let and be independent positive non-degenerate random variables. If and defined in (1) are independent then has a Kummer distribution and has a gamma distribution.
Proof.
Since is a -valued it has all moments finite. Consequently, independence of and implies that conditions (36) are satisfied and the result follows by Cor. 3.3. β
Acknowledgement. We are grateful to G. Letac for sending us his unpublished paper on the Kummer distribution.
This research has been supported by the grant 2016/21/B/ST1/00005 of National Science Center, Poland.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Agarwal, S.K., Kalla, S.J. A generalized gamma distribution and its application in relaibility. Comm. Statist. Theory Meth. 25(1) (1996), 201-210.
- 2[2] Al-Saleh, J.A., Agarwal, S.K. Finite mixture of gamma distributions: A conjugate prior. Comput. Statist. Data Anal. 51 (2007), 4369-4378.
- 3[3] Armero, C., Bayarri, M.J. A Bayesian analysis of queueing system with unlimited service. J. Statist. Plann. Infer. 56 (1997), 241-261.
- 4[4] Arnold, B.C., Press, S.J. Bayesian inference for Pareto populations. J. Econometrics 21 (1983), 287-306.
- 5[5] Bondesson, L. Generalized Gamma Convolutions and Related Classes of Distributions and Densities , Lect. Notes Statist. 76 , Springer, New York 1992.
- 6[6] Bobecka, K. The Matsumoto-Yor property on trees for matrix variates of different dimensions. J. Multivar. Anal. 141 (2015), 22-34.
- 7[7] Bolger, E.M., Harkness, W.L. Characterizations of some distributions by conditional moments. Ann. Math. Statist. 36(2) (1965), 703-705.
- 8[8] Chou, C.-W, Huang, W.-J. Characterizations of the gamma distribution via conditional moments. Sankhya 65(2) (2003), 271-283.
