Exact Statistical Characterization of $2\times2$ Gram Matrices with Arbitrary Variance Profile
Nicolas Auguin, David Morales-Jimenez, Matthew McKay

TL;DR
This paper derives exact statistical characterizations of the $2\times2$ Gram matrix with arbitrary variances, providing new insights into its eigenvalue distribution and implications for dual-antenna communication systems.
Contribution
It introduces novel exact formulas for the distribution of the Gram matrix and its eigenvalues with arbitrary variance profiles, extending classical Wishart analysis.
Findings
Exact eigenvalue distributions derived for arbitrary variance profiles.
Simplified expressions facilitate analysis of communication system performance.
Application to outage data rate analysis in dual-antenna systems.
Abstract
This paper is concerned with the statistical properties of the Gram matrix , where is a complex central Gaussian matrix whose elements have arbitrary variances. With such arbitrary variance profile, this random matrix model fundamentally departs from classical Wishart models and presents a significant challenge as the classical analytical toolbox no longer directly applies. We derive new exact expressions for the distribution of and that of its eigenvalues by means of an explicit parameterization of the group of unitary matrices. Our results yield remarkably simple expressions, which are further leveraged to study the outage data rate of a dual-antenna communication system under different variance profiles.
| 0.01 | 0.5 | 1 | 1.2 | 1.4 | 1.6 | 1.8 | 1.95 | |
|---|---|---|---|---|---|---|---|---|
| 0% | 18% | 28% | 30% | 32% | 36% | 33% | 24% | |
| 1% | 19% | 27% | 29% | 33% | 33% | 33% | 23% |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Exact Statistical Characterization of Gram Matrices with Arbitrary Variance Profile
N. Auguin, D. Morales-Jimenez, M. R. McKay Copyright © 2015 IEEE. Personal use of this material is permitted. However, permission to use this material for any other purposes must be obtained from the IEEE by sending a request to [email protected] authors are with the Department of Electrical and Computer Engineering, Hong Kong University of Science and Technology, Hong Kong. E-mail: [email protected] work was supported by the Hong Kong RGC General Research Fund under grant number 616713, and the Hong Kong Telecom Institute of Information Technology under grant number HKTIIT16EG01.
Abstract
This paper is concerned with the statistical properties of the Gram matrix , where is a complex central Gaussian matrix whose elements have arbitrary variances. With such arbitrary variance profile, this random matrix model fundamentally departs from classical Wishart models and presents a significant challenge as the classical analytical toolbox no longer directly applies. We derive new exact expressions for the distribution of and that of its eigenvalues by means of an explicit parameterization of the group of unitary matrices. Our results yield remarkably simple expressions, which are further leveraged to study the outage data rate of a dual-antenna communication system under different variance profiles.
Index Terms:
Random matrix theory, MIMO channels, eigenvalue distribution.
I Introduction
This paper investigates the statistical properties of random matrices of the form , where is with independent entries
[TABLE]
The distinguishing feature is that the variance profile, , is allowed to be arbitrary.
Despite its apparent simplicity, it is remarkable that little is known about the statistical properties of such matrices, beyond specific examples. Most notable is the case where the variances factorize as , where the model bears a strong analogy with so-called “Kronecker correlated” models that have been studied extensively in communication theory (see, for example, [1, 2]) as well as in classical statistics (see, for example, [3, 4]). Such Kronecker models, as well as their numerous adaptations or extensions (e.g., [5, 6, 7]), enjoy certain symmetry properties that allow their characterization by leveraging classical tools in multi-variate analysis, such as known matrix-variate integrals, hypergeometric functions of matrix arguments and zonal polynomials [3, 4, 8]. The model in (1) is fundamentally different, in that it does not readily lend itself to analysis via these classical techniques.
From a communication engineering perspective, models of the form (1) are useful since they can suitably characterize channels between multiple transmit and receive antennas that are arbitrarily distributed in space. These may include, among others, the so-called distributed antenna systems (DAS), which have recently attracted interest within the wireless communications community [9, 10, 11]. Despite the interest of DAS and the trends towards ever more heterogeneous and distributed network architectures, a precise understanding of such systems remains outstanding, due in part to the scarcity of statistical results on the underlying random matrix model. Such results have mainly been established in the asymptotic regime where the dimensions of the random matrix grow large (see, [9, 12]). These asymptotic results are rather complex and serve primarily as approximations for large-dimensional systems whose behavior may differ from that of finite ones.
In this paper, we present an exact characterization of random matrix models with arbitrary variance profiles, deriving for the first time new exact expressions for the joint distribution of (i) the random matrix , and (ii) its eigenvalues. While we focus on the case, we demonstrate that the analysis is still rather complicated. A main challenge encountered in the derivations is that they involve the computation of certain integrals with respect to the group of unitary matrices. These integrals are not classical, and we solve them by working with an explicit parametrization of the unitary group. Despite the complexity of the derivations, our results yield an exact and remarkably simple expression for the matrix density, along with a tractable expression for the eigenvalue density which reduces to particularly simple forms for various choices of the variance profile. Building upon these results, we further derive simple expressions for the distribution of the extreme eigenvalues, which are then leveraged to study the outage data rate of a dual-user multi-antenna communication system under different variance profiles. In particular, we show that asymmetry in the variance profile can significantly degrade the outage rate of systems with distributed antennas.
II Main results
This section presents our key mathematical results.
Theorem 1**.**
Consider \mathbf{W}=\mathbf{H}\mathbf{H}^{\dagger}=\bigl{(}\begin{smallmatrix}w_{1}&w_{3}\\ w_{3}^{\star}&w_{2}\end{smallmatrix}\bigr{)}\succeq\mathbf{0}, with as in (1), with for . Assume for some . The probability density function (PDF) of admits
[TABLE]
where , , and .
Proof.
See Appendix -A for a complete proof. Briefly: is decomposed as , with lower triangular and unitary, and after applying the corresponding Jacobian and integrating over the unitary group to eliminate , we obtain the PDF of . Applying the variable transformation leads to the result. ∎
Theorem 2**.**
Assume for some . The joint PDF of the (ordered) eigenvalues of admits
[TABLE]
where
[TABLE]
with and .
Proof.
See Appendix -B. ∎
Remark 1** (Equivalence of the variance profile).**
Let be the matrix defining the variance profile associated with . Since and share the same eigenvalues, it is equivalent to consider or .
II-A Partially asymmetric variances
Our main results—the PDF of and of its eigenvalues— have been given for a general variance profile. Consider now the special case where asymmetry in the variances is only partially allowed; specifically, consider for some . Assume without loss of generality (by symmetry of the PDF) that and, therefore, .
Corollary 1**.**
Consider the case and define , , with (hence ). The PDF of admits
[TABLE]
and the joint PDF of its (ordered) eigenvalues reduces to
[TABLE]
with and the exponential integral function.
Furthermore, the cumulative distribution function (CDF) of the minimum eigenvalue of and the CDF of the maximum eigenvalue of are given in (6) and (II-A) (top of the next page) for all distinct.
Proof.
A sketch of the proof is given in Appendix -C. ∎
Note the remarkable simplicity of both the joint eigenvalue PDF and the marginal CDFs of the extreme eigenvalues in this special case, which retain in part the flexibility of the general model, with arbitrary variances rather than .
Remark 2** (On the tail of the extreme eigenvalue distribution).**
In the setting of Corollary 1, we have the following expansions for in the neighborhood of [math]:
[TABLE]
These results are obtained by basic algebra, and making use of [13, eq. 8.214]. The expressions are remarkably simple and shed light on how the variance profile affects the tail of the extreme eigenvalue distributions. For example, assuming the total variance is normalized, (9) suggests that a strong asymmetry in the variance profile—i.e., some variances substantially smaller than others—leads to a more heavy-tailed distribution , as compared to a more uniform profile. The insights brought by these simple expressions are further illustrated in Section III, where we use to study the outage data rate of a communication system with distributed antennas.
II-B Connection to Kronecker correlated models
It is instructive to relate the random matrix to Kronecker correlated models, which are commonly considered in multi-antenna communications [1, 14, 2, 15]. For such models, the channel matrix can be described as
[TABLE]
where are independent , while and are non-negative definite. Denoting (resp. ) an eigenbasis of (resp. ) and (resp. ) the -th eigenvalue of (resp. ), can be written (in the case) as [16]
[TABLE]
where denotes the Hadamard (entry-wise) matrix product.
Furthermore, it can be shown that the eigenvalue distribution of , described as , depends on and only through their eigenvalues (see [1, 14, 2]). Hence our result in Theorem 2 subsumes the eigenvalue distribution of Kronecker correlated models as a special case.
III Outage performance of a dual-user communication system with distributed antennas
We now demonstrate the usefulness of the mathematical results exposed above, through a concrete communications application example. Consider a communication system in which 2 single-antenna users (transmitters) communicate with a receiver comprising 2 distributed antennas. Rayleigh fading is assumed, with shadowing neglected, in which the communication channel is of the form in (1) with variance profile , where is the path loss exponent and the distance between transmit antenna and receive antenna . Thus, the placement of the antennas determines the channel variance profile. For instance, if both transmitters (i.e., users) are located at equal distance from receive antenna , then , which corresponds to the setting of Corollary 1.
We further assume that the receiver has perfect knowledge of , while the transmitters ignore such knowledge and send independent data with a total transmit power . The noise at each receiver is assumed independent ), and we define the transmit signal to noise ratio (SNR) as . We further assume that the total power gain of the channel is fixed, with .
Denoting the vector of transmitted signals and the additive noise, the received signal takes the form
[TABLE]
For detection, a linear zero-forcing receiver is considered. Such receivers are popular because of their low complexity [17], and their performance is known to approach that of minimum-mean squared error receivers at high SNR [18]. The estimate of the transmitted signal then becomes
[TABLE]
and the post-processing SNR for the -th user is [19]
[TABLE]
Here, we are interested in the outage data rate, defined as the largest transmission rate (in bits/s/Hz) that can be reliably guaranteed for both users (simultaneously) at least of the time, i.e.,
[TABLE]
with being the prescribed maximum outage level, and denoting the outage probability for a given target rate . That is, reflects the probability that a reliable transmission at rate cannot be guaranteed to both users, given by
[TABLE]
where . Since [19] with the minimum eigenvalue of , it follows that , which yields the upper bound
[TABLE]
Considering now the setting of Corollary 1 () and a small outage level, we can use the expansion of (Remark 2) to write
[TABLE]
where the influence of the variances is isolated through the factor . Also note that if , .
The results above then suggest the following lower bound for the outage data rate :
[TABLE]
where denotes the inverse function of , while in the setting of Corollary 1,
[TABLE]
Fig. 1 shows the outage data rate as a function of the SNR , for an asymmetric variance profile , and three maximum outage levels and . For each maximum outage level, we plot (i) the true empirical rate in (10)—obtained from the average over realizations of the channel, (ii) the lower bound in (11)—where we invert from (6) numerically, and (iii) the approximate analytical lower bound in (12).
Notice the tightness of the lower bound for all the considered maximum outage levels and all SNRs. Moreover, the analytical (approximate) bound , based on the expansion (8), shows excellent accuracy for small outage levels () as expected, since it corresponds to evaluating fairly deep in the tail. However, for higher outage levels (e.g., ), this bound becomes less reliable.
For small, the effect of the variance profile on the outage data rate can be analyzed from the approximate bound , given its remarkable tightness and simplicity. Recalling the normalization on the total power gain of the channel, i.e., , it is straightforward to verify that is continuous in the parameters , and that, for fixed, the mapping is minimum when and maximum in the limit (hence ). This immediately implies that, for fixed, the outage data rate is maximum when , which represents the “most symmetric” profile under the total variance normalization, and that any departure from such symmetry entails a performance loss. To quantify the range of such loss, we now consider the two extremes cases, “symmetric” and “asymmetric” profiles, and define the fractional loss in the outage data rate due to asymmetry, i.e., . In Table I, for , we report the value of for increasing values of , along with the corresponding true fractional loss , computed using the true outage data rates, obtained empirically by averaging over realizations. The numbers reveal a striking degradation in the outage data rate due to asymmetry, e.g., up to loss for and SNRdB.
Physically, it implies that, assuming the two transmitting users are equidistant from receive antenna 2, their position relative to receive antenna 1 is crucial: if the distances from the two users to receive antenna 1 are very different (asymmetric case, ), a significantly lower outage data rate is expected as compared to the case where both users are equidistant from receive antenna 1 (symmetric case, ).
-A Proof of Theorem 1
We start with the LQ decomposition , with lower triangular and unitary. and are parametrized as [20, 21, 22]:
[TABLE]
and
[TABLE]
with: , , and . The associated Jacobian is . This, along with the PDF of
[TABLE]
gives an expression for the joint PDF of . The marginal PDF of then follows by integrating over the parameters , , which leads to (13) (top of the next page), where
[TABLE]
with
[TABLE]
We now show that the integral can be computed explicitly. The result [13, Eq. 3.937.2] allows us to integrate over giving
[TABLE]
where is a modified Bessel function of the first kind. Using the expansion, and noting that does not depend on , the remaining integrals are easy to evaluate, giving
[TABLE]
Substituting into (13), rearranging terms and applying double-angle formulae, the PDF of takes the form
[TABLE]
where
[TABLE]
and
[TABLE]
with and defined in the theorem statement. Now, using [13, Eq. 3.915.4], the remaining integral evaluates to:
[TABLE]
Substituting into (14) and rearranging the terms, we get
[TABLE]
which, upon substituting for and and noting that yields the desired PDF of ,
[TABLE]
Now consider the Cholesky decomposition . The Jacobian of this transformation is . With this, along with (15), we perform the change of variables to arrive at the result stated in (2).
-B *Proof of Theorem 2 *
We consider the eigendecomposition , with , , and unitary. For , may be parametrised in terms of 2 free (angular) parameters as follows (see e.g., [21, 22]): , , . The Jacobian of this transformation is . Identifying the entries of in (2) in terms of the four real parameters and , we obtain the following for the ordered eigenvalue PDF of :
[TABLE]
where and are given in the theorem statement. After integration over , we obtain (3).
-C Proof of Corollary 1
The PDF of (4) follows directly from (2). The joint eigenvalue PDF (5) is obtained from (4) upon applying the same steps as in Appendix -B. The expression (5) is particularly convenient, allowing us to use the Cauchy-Binet formula [23] to compute the marginal CDFs of the extreme eigenvalues of . For example, for , the CDF of the minimum eigenvalue admits
[TABLE]
where the Cauchy-Binet formula was applied to obtain the third equality, while the last equality was obtained using [13, Eq. 5.231.2] and integration by parts. For the maximum eigenvalue, , which is computed using analogous steps.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] L. Hanlen and A. Grant, “Capacity analysis of correlated MIMO channels,” in Proc. IEEE Int. Symp. Inform. Theory , 2003, pp. 263–263.
- 2[2] H. Shin, M. Z. Win, J. H. Lee, and M. Chiani, “On the capacity of doubly correlated MIMO channels,” IEEE Trans. Wireless Commun. , vol. 5, no. 8, pp. 2253–2265, 2006.
- 3[3] A. T. James, “Distributions of matrix variates and latent roots derived from normal samples,” Ann. Math. Statist. , vol. 35, pp. 475–501, 1964.
- 4[4] R. J. Muirhead, Aspects of Multivariate Statistical Theory , vol. 197, John Wiley & Sons, 2009.
- 5[5] S. K. Jayaweera and H. V. Poor, “Performance analysis of decorrelating decision feedback detection for MIMO systems in Rician fading,” in Proc. IEEE Int. Symp. Wireless Pers. Multimedia Commun. , 2003, vol. 3, pp. 29–33.
- 6[6] B. Wang, J. Zhang, and A. Host-Madsen, “On the capacity of MIMO relay channels,” IEEE Trans. Inform. Theory , vol. 51, no. 1, pp. 29–43, 2005.
- 7[7] S. Jin, M. R. Mc Kay, K. Wong, and X. Gao, “Transmit beamforming in Rayleigh product MIMO channels: capacity and performance analysis,” IEEE Trans. Signal Processing , vol. 56, no. 10, pp. 5204–5221, 2008.
- 8[8] M. L. Mehta, Random Matrices , vol. 142, Academic press, 2004.
