Low-Density Code-Domain NOMA: Better Be Regular
Ori Shental, Benjamin M. Zaidel, Shlomo Shamai

TL;DR
This paper derives a spectral density expression for regular low-density code-domain NOMA, showing it outperforms irregular and dense NOMA in throughput, with feasible implementation prospects for 5G.
Contribution
It provides a closed-form spectral density for regular LDCD-NOMA and demonstrates its superior throughput compared to irregular and dense NOMA schemes.
Findings
Regular LDCD-NOMA outperforms irregular and dense NOMA in total throughput.
Spectral density expressions are derived using graph theory and statistical physics methods.
Regular LDCD-NOMA can be efficiently implemented with message-passing algorithms.
Abstract
A closed-form analytical expression is derived for the limiting empirical squared singular value density of a spreading (signature) matrix corresponding to sparse low-density code-domain (LDCD) non-orthogonal multiple-access (NOMA) with regular random user-resource allocation. The derivation relies on associating the spreading matrix with the adjacency matrix of a large semiregular bipartite graph. For a simple repetition-based sparse spreading scheme, the result directly follows from a rigorous analysis of spectral measures of infinite graphs. Turning to random (sparse) binary spreading, we harness the cavity method from statistical physics, and show that the limiting spectral density coincides in both cases. Next, we use this density to compute the normalized input-output mutual information of the underlying vector channel in the large-system limit. The latter may be interpreted as…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Low-Density Code-Domain NOMA:
Better Be Regular
Ori Shental
Communications Theory Department
Bell Labs
Holmdel, New Jersey 07733, USA
Email: [email protected]
Benjamin M. Zaidel
Faculty of Engineering
Bar-Ilan University
Ramat-Gan 52900, Israel
Email: [email protected]
Shlomo Shamai (Shitz)
Department of Electrical Engineering
Technion
Haifa 32000, Israel
Email: [email protected]
Abstract
A closed-form analytical expression is derived for the limiting empirical squared singular value density of a spreading (signature) matrix corresponding to sparse low-density code-domain (LDCD) non-orthogonal multiple-access (NOMA) with regular random user-resource allocation. The derivation relies on associating the spreading matrix with the adjacency matrix of a large semiregular bipartite graph. For a simple repetition-based sparse spreading scheme, the result directly follows from a rigorous analysis of spectral measures of infinite graphs. Turning to random (sparse) binary spreading, we harness the cavity method from statistical physics, and show that the limiting spectral density coincides in both cases. Next, we use this density to compute the normalized input-output mutual information of the underlying vector channel in the large-system limit. The latter may be interpreted as the achievable total throughput per dimension with optimum processing in a corresponding multiple-access channel setting or, alternatively, in a fully-symmetric broadcast channel setting with full decoding capabilities at each receiver. Surprisingly, the total throughput of regular LDCD-NOMA is found to be not only superior to that achieved with irregular user-resource allocation, but also to the total throughput of dense randomly-spread NOMA, for which optimum processing is computationally intractable. In contrast, the superior performance of regular LDCD-NOMA can be potentially achieved with a feasible message-passing algorithm. This observation may advocate employing regular, rather than irregular, LDCD-NOMA in 5G cellular physical layer design.
I Introduction
Non-orthogonal multiple-access (NOMA) is a main enabler of the new radio (NR) design of 5G cellular networks and beyond. The underlying idea is to loosen the paradigm of orthogonal transmissions by allowing different users (or “layers”) to concurrently share the same physical resources, in either time, frequency or space. Consequently, more connections can be supported in massive Machine-Type-Communications (mMTC), or alternatively, a higher total throughput can be achieved in enhanced Mobile Broadband (eMBB) scenarios.
The plethora of NOMA techniques can be roughly categorized into two main classes: signature-domain multiplexing, and power-domain multiplexing (see, e.g., [1] for a recent overview). In the latter class, signals corresponding to different users are superimposed, and commonly decoded via successive interference cancellation (SIC). Signature-domain multiplexing is based on distinguishing spreading codes, or interleaver sequences (concatenated with low-rate error-correcting codes).
Low-density code-domain (LDCD) NOMA is a prominent sub-category of signature-based multiplexing, which relies on low-density signatures (LDS) [2]. Sparse spreading codes comprising a small number of non-zero elements are employed for linearly modulating each user’s symbols over shared physical resources. Significant receiver complexity reduction can be achieved by utilizing message-passing algorithms (MPAs) [3], which enable user separation even when the received powers are comparable (as opposed to power-domain NOMA). Different variants of LDCD-NOMA have recently gained much attention in 5G 3GPP standardization [1]. For instance, Sparse-Code Multiple-Access (SCMA) [4] further optimizes the low-density sequences to achieve shaping and coding gains by using multidimensional constellations. In this paper, we chose, however, to focus on the more conventional linear spreading. Our results can therefore be regarded as providing information-theoretic lower bounds on the expected performance of the various LDCD-NOMA schemes discussed in the literature.
The sparse mapping between users and resources in LDCD-NOMA can be either regular, where each user occupies a fixed number of resources, and each resource is used by a fixed number of users; or irregular, where the respective numbers are random, and only fixed on average. The optimal spectral efficiency of irregular LDCD-NOMA was investigated in[5], and shown to reside below the well-known spectral efficiency of dense random-spreading (RS) [6]. The result stems from the random nature of the user-resource mapping, due to which some users may end up without any designated resources, while some resources may be left unused. This raises the question of whether a regular user-resource mapping leads to any capacity gains. Note in this respect that a regular mapping requires some kind of coordination or central scheduling, and may therefore pose some additional practical challenges.
In this paper, we investigate the total achievable throughput per dimension of regular LDCD-NOMA, while considering Gaussian signaling, non-fading channels and the large-system limit. We show that it is not only superior to irregular LDCD-NOMA [5], but also outperforms RS-NOMA [6] (preliminary observations of similar nature were numerically obtained for binary-inputs in [7]). This result is remarkable, since regular LDCD-NOMA allows for feasible near-optimal (MPA-based) multiuser receiver implementation, whereas the complexity of the optimum receiver for RS-NOMA is prohibitive for large systems. Our information-theoretic observation relies on deriving a closed-form expression for the limiting squared singular value density of the underlying channel transfer matrix. For a simple repetition-based sparse spreading scheme, the result directly follows from a rigorous analysis of spectral measures of infinite graphs [8]. For random (sparse) binary spreading, we harness the cavity method from statistical physics [9], and show that the limiting density coincides in both cases.
The paper is organized as follows. The regular LDCD-NOMA system model is described in Section II. Section III derives the limiting density of the squared singular values of the underlying channel transfer matrix. Section IV presents numerical results for the total achievable throughput. Finally, Section V ends this paper with some concluding remarks.
II Regular Low-Density Code-Domain NOMA
Consider a system where the signals of users (“layers”) are multiplexed over shared orthogonal dimensions (resources). Multiplexing is performed while employing randomly chosen sparse spreading signatures of length (namely, -dimensional vectors). Each sparse signature is assumed to contain a small number of non-zero entries (typically much smaller than ), while the remaining entries are set to zero. For the sake of simplicity, but without loss of conceptual scope, we focus henceforth on real-valued channels. We further restrict the discussion to the following simple generic Gaussian vector channel model, representing the -dimensional received signal at some arbitrary time instance:
[TABLE]
where is a -dimensional vector comprising the coded symbols of the users. Assuming Gaussian signaling, full symmetry, and no cooperation between encoders corresponding to different users, the input vector is distributed as , where denotes the power allocated to each user. The matrix denotes the sparse signature matrix, whose th column represents the spreading signature of user , and its non-zero entries designate the user-resource mapping (namely, user occupies dimension if , where denotes the th entry of ). Finally, denotes the -dimensional additive white Gaussian noise (AWGN) vector. The normalization factor of in (1), where , accounts for the sparsity of the signatures (as explained in the sequel). We use to denote the per-user signal to noise ratio (SNR), and to denote the system load (users per dimension). In the NOMA context we are specifically interested in the overloaded regime of , where user orthogonality is infeasible. However, extension of the results to the underloaded setting () is straightforward.
In LDCD-NOMA, since the signature matrix is sparse, typically only a few of the users’ signals collide over any given orthogonal dimension. The regularity assumption dictates that each column of (respectively, row) has exactly (respectively, ) non-zero entries. is chosen here so that . We note in this respect that the matrix is dubbed irregular when in a corresponding setting the number of non-zero entries in each column (respectively, row) is Poisson distributed with average (respectively, ). The non-zero entries of are assumed in this paper to either equal , corresponding to repetition-based spreading; or to be independent identically distributed (i.i.d.) random variables, corresponding to random binary spreading. Thus, the normalization in (1) ensures that the columns of have unit norm. We further note that the signature matrix can be associated with the adjacency matrix of a random bipartite (factor) graph, , where a user node and a resource (dimension) node are connected if and only if . This factor graph is assumed to be locally tree-like111Loosely speaking, this assumption implies that short cycles on the graph are rare. More precisely, this property implies that the random graph converges in law to a random tree [10]., similarly to LDPC codes [11, Chapters 3-4]. Such construction allows for reduced complexity near-optimal multiuser detection, which can be performed iteratively by applying MPAs over the underlying factor graph.
Assuming that the signature matrix is perfectly known at the receiving end, and uniformly chosen randomly and independently per each channel use from the set of -regular matrices, the performance measure considered in the sequel is the normalized conditional input-output mutual information:
[TABLE]
This quantity corresponds to the total achievable throughput in bits/sec/Hz per dimension with optimum processing if (1) is interpreted as representing a multiple-access channel (uplink) setting. Alternatively, it may be interpreted as representing the total normalized throughput in a fully symmetric broadcast channel (downlink) setting with superposition coding, where all users are capable of decoding all messages, and perform the same type of joint decoding. We thus conclude that is a reasonable choice for characterizing the expected performance of LDCD-NOMA systems, for both the uplink and the downlink.
III Spectral Analysis of Regular LDCD-NOMA
We now derive a closed-form expression for the limiting empirical eigenvalue distribution of (cf. (2)), which constitutes the main contribution of this paper. A key step in the derivation is the association of the signature matrix with a -semiregular bipartite graph comprising resource nodes, and user nodes. The symmetric adjacency matrix of this bipartite graph can be expressed as
[TABLE]
while
[TABLE]
Thus, observing that the eigenvalues of are the eigenvalues of together with those of (and for the latter are the same as those of with additional zeros), the spectral density of (and thus of ) can be easily derived from the spectral density of (see, e.g., [12]). We now proceed with the statement of the main results.
Consider first repetition-based spreading, for which is a sparse -matrix.
Theorem 1**.**
Let be a random sparse -matrix with exactly ’s in each column, exactly ’s in each row (where , and ), and a locally tree-like associated -semiregular bipartite graph (cf. (3)). Then, for and with , the empirical distribution of the eigenvalues of converges weakly to a distribution whose density function is given by
[TABLE]
*where , , , , and . *
Proof:
The result relies on the properties of the associated bipartite graph of . More specifically, Godsil and Mohar rigorously derive in [8, Corollary 4.5] the limiting eigenvalue distribution of the adjacency matrix of large semiregular bipartite graphs, which asymptotically weakly converge to a bipartite Galton-Watson tree [10] (see also [13] for an alternative proof). The result gives the limiting spectral density of in (3), from which the spectral density of in (4) is readily obtained. Finally, the density (5) is derived via the relation between the eigenvalues of and , as discussed at the beginning of this section. ∎
Next, we turn to random (sparse) binary spreading. For this setting, the existence of a limiting distribution follows from [10]. The derivation of the spectral density relies here on the heuristic cavity method from statistical physics, as initially developed by Mézard et al. [14]. At the heart of the cavity approach is the relation between the sought after spectral density, and an appropriately defined partition function (as clarified in the sequel). When the graph associated with is locally tree-like (essentially, with no short cycles going through a typical node), if one removes a node from the graph (thus generating a “cavity”), the joint distribution of its neighborhood factorizes (subject to the associated Boltzmann distribution). This produces a set of recursive equations, out of which the cavity distributions can be obtained, and the method is expected to be asymptotically exact for tree-like graphs[9]. Postulating the validity of the cavity method for our setting, we obtain the following result (stated as a “claim”).
Claim 1*.*
Let be defined as in Theorem 1, but with non-zero entries (rather than ’s). Then, for and with , the empirical distribution of the eigenvalues of converges weakly to a distribution whose density function is identical to that given in (5).
Proof:
The spectral density of in (3), i.e.,
[TABLE]
where are the eigenvalues of , can be expressed via the Edwards-Jones identity [9] as
[TABLE]
Here, the partition function is defined via Gaussian integrals as (see [9] and references therein)
[TABLE]
with the Hamiltonian
[TABLE]
Ignoring convergence aspects in (8) as in [9, 14], the spectral density can then be expressed as
[TABLE]
where denotes averaging over the Boltzmann distribution . The next step at this point is to employ the cavity method, which provides an approximate approach for computing the variances in (10), and is expected, as said, to be exact in the large system limit when applied to tree-like graphs.
Omitting details for conciseness, we note that the cavity analysis produces a set of self-consistent equations given in terms of the “cavity variances” [9]:
[TABLE]
where is the set of neighbors of node , , and denotes the set with the node removed. The variances in (10) then read for [9]
[TABLE]
from which the spectral density can be derived. Note that the cavity analysis implies that the node variances (and hence the spectral density of ) depend only on the squared values of the non-zero entries of .
Recall at this point that we are, in fact, interested in the spectral density of , rather than . Identifying the limiting mean variance in (10) as the Cauchy transform of the asymptotic eigenvalue distribution of [12], we now invoke the following relation between and (cf. (4)):
[TABLE]
Using (13), the relation between the eigenvalues of and those of , and relying on the full symmetry between the “cavity variances” corresponding to each type of nodes (namely, either resource nodes or user nodes), one eventually obtains the following simplified set of cavity equations:
[TABLE]
where and are as in (5). Here represents the Cauchy transform of the limiting eigenvalue distribution of . Solving the above equations, and applying the Stiletjes inversion formula (10) on , we finally get (5). This concludes the proof of Claim 1. ∎
The cavity method is a powerful computational tool, yet heuristic in nature (similarly to the “replica method” [14]). We note in this respect that the fact that the cavity-based result of Claim 1 coincides with that of Theorem 1, which is based on fully rigorous arguments, supports the validity of the cavity method in the current setting. To further validate our results, we examine two special cases of interest.
Let the matrix be defined as in Theorem 1 with . Consequently, we have . Then, the limiting spectral density in (5) reads
[TABLE]
which is exactly the probability density function of the squared singular values of the well-known Kesten-McKay law [15] for regular square -matrices.
As a second special case, let the matrix be defined either as in Theorem 1 or in Claim 1. Then, as , the limiting spectral density (5) converges to
[TABLE]
where . As expected [9], this density is nothing but the Marc̆enko-Pastur law [16]. We note that similar observations were made in [17], while considering matrices (as in Theorem 1), and focusing on the case in which while at an appropriate rate (see therein).
To get more insight on our limiting results, Fig. 1 and its inset illustrate the spectral density for several pairs of load and sparsity . Fig. 1 shows the limiting spectral density for , and loads (the Kesten-McKay law), , and . For , the analytical result (5) is also compared to the average empirical density obtained via Monte Carlo simulations, while considering a regular sparse spreading matrix of dimensions , and matrix realizations (as anticipated, simulation results for either entries, or entries, yield indistinguishable curves). An excellent match to the analytical results is observed. Trivial eigenvalues that appear in finite-dimensional simulations, but have vanishing weight in the large-system limit, were discarded from the figure (e.g., the maximal eigenvalue of which equals ). The inset of Fig. 1 demonstrates the convergence of the limiting spectral density to the Marc̆enko-Pastur law for increasing values of and . Note that setting already seems large enough for the limiting density (5) to approach the Marc̆enko-Pastur law, which holds for dense spreading matrices (corresponding to RS-NOMA), where the average number of non-zero entries in each row, or column, is proportional to the respective dimension [6] (a similar observation was reported for the irregular setting in [5]).
IV Numerical Results
With the limiting eigenvalue distribution results of Theorem 1 and Claim 1, the limiting normalized total achievable throughput of regular LDCD-NOMA in (2) can be analytically computed as (see, e.g., [6, Proposition III.2])
[TABLE]
where is given in (5). Fig. 2, its inset, and Fig. 3 show (computed via numerical integration), plotted, respectively, as a function of the load , the sparsity parameter , and (via the relation , see [6]). We note in this respect that the regularity constraints imply that only values for which and have a practical meaning. The latter are marked by circles in Fig. 2. For the sake of comparison we also included in the figures the spectral efficiencies of irregular LDCD-NOMA [5, Eqs. (28)–(32)], overloaded dense (i.e., ) RS-NOMA [6, Eq. (9)], and the Cover-Wyner upper bound [6, Eq. (4)], which corresponds to the absence of spreading.
The results indicate that regular LDCD-NOMA not only outperforms its corresponding irregular LDCD-NOMA scheme, but even outperforms dense RS-NOMA [6]. More specifically, Figs. 2 and 3 show that regular LDCD-NOMA exhibits a throughput gain of about 20% over irregular LDCD-NOMA, at a typical working point of , dB and . For , a throughput gain close to is observed. We further note that the inset of Fig. 2 shows how the limiting throughput of regular LDCD-NOMA approaches that of dense RS-NOMA from above, as the sparsity parameter increases. Irregular LDCD-NOMA exhibits a similar behavior but from below. Fig. 3 also shows simulation results for of (2) with (averaged over matrix realizations with binary sparse spreading). The excellent match with the analytical results establishes the relevance of our asymptotic analysis for practical system dimensions (e.g., [4]).
V Concluding Remarks
Understanding the fundamental information-theoretic performance limits of the various NOMA technologies suggested in recent years, is crucial for efficient state-of-the-art designs of future 5G and beyond cellular communication systems. The topic is therefore timely, and of both theoretical and practical interest. An insightful attempt in this framework was presented in this paper, by examining the advantages of regular LDCD-NOMA transmission schemes. Harnessing tools from the spectral theory of large random graphs, as well as the heuristic, yet powerful, cavity method of statistical physics, the achievable total throughput of regular LDCD-NOMA was analytically investigated in the large system limit. The results demonstrate that regular sparse spreading may potentially lead to significant performance enhancement over conventional irregular sparse spreading (and in fact also over legacy dense RS-NOMA). Extensions of the results to account for non-binary spreading, fading channel models, and suboptimal receiver designs, are currently investigated.
Acknowledgment
The work of B. M. Zaidel and S. Shamai (Shitz) was supported by the Heron consortium via the Israel Ministry of Economy and Industry. O. Shental would like to thank R. Valenzuela, D. Ezri, and E. Melzer for useful discussions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] L. Dai, B. Wang, Y. Yuan, S. Han, C.-L. I, and Z. Wang, “Non-orthogonal multiple access for 5G: Solutions, challenges, opportunities, and future research trends,” IEEE Commun. Mag. , vol. 53, no. 9, pp. 74–81, Sep. 2015.
- 2[2] R. Hoshyar, R. Razavi, and M. Al-Imari, “LDS-OFDM an efficient multiple access technique,” in Proc. 2010 IEEE 71st Veh. Technol. Conf. , May 2010, pp. 1–5.
- 3[3] A. Bayesteh, H. Nikopour, M. Taherzadeh, H. Baligh, and J. Ma, “Low complexity techniques for SCMA detection,” in 2015 IEEE Globecom Workshops (GC Wkshps) , Dec. 2015, pp. 1–6.
- 4[4] M. Taherzadeh, H. Nikopour, A. Bayesteh, and H. Baligh, “SCMA codebook design,” in Proc. 2014 IEEE 80th Veh. Technol. Conf. (VTC 2014-Fall) , Sep. 2014, pp. 1–5.
- 5[5] M. Yoshida and T. Tanaka, “Analysis of sparsely-spread CDMA via statistical mechanics,” in Proc. 2006 IEEE Int. Symp. Inf. Theory (ISIT’06) , Seatle, WA, Jul. 2006, pp. 2378–2382.
- 6[6] S. Verdú and S. Shamai (Shitz), “Spectral efficiency of CDMA with random spreading,” IEEE Trans. Inf. Theory , vol. 45, no. 2, pp. 622–640, Mar. 1999.
- 7[7] J. Raymond and D. Saad, “Sparsely spread CDMA - a statistical mechanics-based analysis,” J. Phys. A: Mathematical and theoretical , vol. 40, no. 41, p. 12315, 2007.
- 8[8] C. D. Godsil and B. Mohar, “Walk generating functions and spectral measures of infinite graphs,” Linear Algebra Appl. , vol. 107, pp. 191–206, 1988.
