Spatially Coupled LDPC Codes and the Multiple Access Channel
Sebastian Cammerer, Xiaojie Wang, Yingyan Ma, Stephan ten Brink

TL;DR
This paper presents a novel application of spatially coupled LDPC codes in a non-orthogonal multiple access scheme, achieving excellent thresholds, flexibility, and low complexity for multi-user communication over various channels.
Contribution
It introduces a universal SC-LDPC based scheme with outer repetition coding for flexible multi-user access, verified by density evolution and simulations, suitable for Rayleigh channels.
Findings
Achieves near-capacity decoding thresholds for multi-user channels.
Provides a flexible scheme adaptable to different user loads and rates.
Demonstrates effective performance on Rayleigh fading channels.
Abstract
We consider spatially coupled low-density parity-check (SC-LDPC) codes within a non-orthogonal interleave division multiple access (IDMA) scheme to avoid cumbersome degree profile matching of the LDPC code components to the iterative multi-user detector (MUD). Besides excellent decoding thresholds, the approach benefits from the possibility of using rather simple and regular underlying block LDPC codes owing to the universal behavior of the resulting coupled code with respect to the channel front-end, i.e., the iterative MUD. Furthermore, an additional outer repetition code makes the scheme flexible to cope with a varying number of users and user rates, as the SC-LDPC itself can be kept constant for a wide range of different user loads. The decoding thresholds are obtained via density evolution (DE) and verified by bit error rate (BER) simulations. To keep decoding complexity and…
| uncoupled () | coupled222Remark: for a better comparison the rate loss due to termination effects is not considered here. () | |||
| 4 | 3 | 6 | ||
| 4 | 4 | 8 | ||
| 4 | 5 | 10 | ||
| 4 | 6 | 12 | ||
| 2 | 3 | 4 | ||
| 2 | 6 | 8 | ||
| 2 | 9 | 12 | – |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Spatially Coupled LDPC Codes and the
Multiple Access Channel
*(Invited Paper)
*
Sebastian Cammerer, Xiaojie Wang, Yingyan Ma, and Stephan ten Brink
Institute of Telecommunications, Pfaffenwaldring 47, University of Stuttgart, 70569 Stuttgart, Germany
{cammerer,wang,tenbrink}@inue.uni-stuttgart.de
Abstract
We consider spatially coupled low-density parity-check (SC-LDPC) codes within a non-orthogonal interleave division multiple access (IDMA) scheme to avoid cumbersome degree profile matching of the low-density parity-check (LDPC) code components to the iterative multi-user detector (MUD). Besides excellent decoding thresholds, the approach benefits from the possibility of using rather simple and regular underlying block LDPC codes owing to the universal behavior of the resulting coupled code with respect to the channel front-end, i.e., the iterative MUD. Furthermore, an additional outer repetition code makes the scheme flexible to cope with a varying number of users and user rates, as the SC-LDPC itself can be kept constant for a wide range of different user loads. The decoding thresholds are obtained via density evolution (DE) and verified by bit error rate (BER) simulations. To keep decoding complexity and latency small, we introduce a joint iterative windowed detector/decoder imposing carefully adjusted sub-block interleavers. Finally, we show that the proposed coding scheme also works for Rayleigh channels using the same code with tolerable performance loss compared to the additive white Gaussian noise (AWGN) channel.
ADC analog-to-digital converter AGC automatic gain control ASIC application-specific integrated circuit AWGN additive white Gaussian noise BER bit error rate BICM bit interleaved coded modulation BLER block error rate CFO carrier frequency offset DL deep learning DQPSK differential quadrature phase-shift keying ECC error correcting code FPGA field programmable gate array GNR GNU Radio GPU graphic processing unit ISI inter-symbol interference LOS line-of-sight MIMO multiple-input multiple-output ML machine learning MLP multilayer perceptron MSE mean squared error NN neural network PLL phase-locked loop ppm parts per million PSK phase-shif keying PFB polyphase filterbank QAM quadrature amplitude modulation ReLU rectified linear unit RNN recurrent neural network RRC root-raised cosine RTN radio transformer network SDR software-defined radio SFO sampling frequency offset SGD stochastic gradient descent SNR signal-to-noise ratio TDL tapped delay line OFDM orthogonal frequency division multiplex IFFT inverse fast Fourier transform FFT fast Fourier transform IFT inverse Fourier transform FT Fourier transform IDFT inverse discrete Fourier-transform DFT discrete Fourier-transform CP cyclic prefix MMSE minimum mean squared error QPSK quadrature phase-shift keying BP belief propagation SC spatial coupling LDPC low-density parity-check SC-LDPC spatially coupled low-density parity-check DE density evolution MAP maximum a posteriori VN variable node CN check node LLR log likelihood ratio NOMA non-orthogonal multiple access IDMA interleave division multiple access MUD multi-user detector VND variable node decoder CND check node decoder GA Gaussian approximation EXIT extrinsic information transfer BPSK binary phase shift keying GMAC Gaussian multiple access channel REP repetition code
I Introduction
While in the single-user case the Shannon capacity has been almost achieved for practical coding schemes [1, 2], the situation changes when considering the multi-user non-orthogonal multiple access (NOMA) scenario, i.e., when multiple transmitters and a single receiver share the same medium [3]. Although several NOMA approaches exist (see [4, 5] and references therein), it is still an open and interesting research direction to find low-complexity coding (and detection) schemes that operate close to the multi-user capacity. Further, multi-user systems open up yet unsettled research opportunities such as the flexibility towards a dynamically varying number of users and, likely, having different power levels.
One attractive NOMA scheme, featuring low-complexity, parallelizable computation and asynchronous transmission, is IDMA [6, 7]. In this work, we focus on the IDMA scheme, where a low-complexity parallel interference cancellation (PIC) receiver is used and an effective separation between users is done by an individual interleaver. Relying on feedback from single-user channel decoders, the performance of IDMA systems strongly depends on the performance of the underlying channel codes.
Thus, in classical LDPC-based IDMA systems, the LDPC code needs to have matched degree profiles [8, 9] to the channel front-end, i.e., the MUD. As this optimization depends on several parameters such as the channel type, the number of users and the individual signal-to-noise ratios, the drawback is that in practice either multiple LDPC codes need to be (pre-)designed, or a degraded system performance has to be accepted. In this work, we make use of the fact that SC-LDPC codes do not have this drawback as they are known for a universal behavior regarding the channel front-end [10, 11].
SC-LDPC codes are widely known for their capacity achieving decoding behavior via threshold saturation [12]. More precisely, it has been shown that coupled codes approach the maximum a posteriori (MAP) decoding performance of the underlying block LDPC code under low-complexity belief propagation (BP) decoding for properly chosen code parameters. However, a second powerful property of SC-LDPC codes is not so often referred to, but can be seen in their universality with respect to the channel front-end, i.e., for carefully chosen code parameters SC-LDPC codes do not need any re-design when the channel characteristics change. It also offers potentially low error-floors as typically a regular code design suffices which simplifies the code construction. This universality renders SC-LDPC codes into a promising candidate for NOMA schemes where a wide range of different scenarios must be supported such as different number of users, channels and user power.
Unfortunately, as SC-LDPC codes are constructed out of multiple coupled sub-blocks, they typically introduce long block lengths. Thus, for practical decoder implementations, i.e., feasible decoding complexity, a windowed decoder is crucial [13]. We show that the MUD can be integrated into the iterative detection/decoding scheme with negligible performance loss. Yet, this requires some attention with respect to the decoding window and the interleaver design to separate individual users, as the iterative detection/decoding loop needs to be performed sub-block-wise to maintain the benefits of threshold saturation.
II IDMA System Model
Fig. 1 shows the IDMA system model with uncooperative users. Each user encodes and decodes its data separately using a channel encoder (SC-LDPC code here) of code rate and a common serially concatenated repetition code of rate (see [9] for details). Note that the SC-LDPC code and, thus, also the code parameters, e.g., degree profile and coupling width , are the same among all the users. Thus, the total code-rate is . The interleaver is, on the contrary, user-specific to allow efficient user separation at the receiver. After interleaving, the coded bits are mapped to symbols, e.g., using binary phase shift keying (BPSK), and transmitted over the Gaussian multiple access channel (GMAC).
The th received signal (i.e., the th element of in Fig. 1) of all users can be written as
[TABLE]
where is the discrete-time index, denotes the signal power of the th user, is the uncorrelated (both over time and among different users) small-scale Rayleigh fading channel coefficient, is circularly symmetric (complex-valued) AWGN with zero mean and variance , and is a pseudo random phase scrambling to avoid ambiguity of the super-constellation (Cartesian product of all user constellations). This random phase shift could also be the consequence of, e.g., the channel and/or explicit “scrambling” and we include this into each user’s mapper (only in AWGN channels; for Rayleigh channels this step can be omitted). Throughout this paper, the phases are independently and uniformly distributed in . The output of the mapper of the th user with BPSK modulation at the th time instant is . The “phase scrambling” can improve the superimposed multiuser codeword distance [14], particularly in AWGN channels. The so-called multi-user SNR is defined as
[TABLE]
The received signal is first processed by a multi-user detector (MUD). An optimum MUD is to compute the maximum a posteriori (MAP) probability of each bit. This requires a complexity of where denotes the number of constellation symbols per user. The exponentially increasing complexity with the number of users prohibits its practical implementation for a large number of users. Therefore, a sub-optimal soft interference cancellation (SoIC) based low complexity MUD was proposed in [6]. The sub-optimal MUD first cancels out the other users’ signals; for instance, the th user’s signal is estimated by the conditional minimum mean-square error (MMSE) estimator for BPSK
[TABLE]
based on, e.g., the a posteriori knowledge of the channel decoder (the SC-LDPC decoder output is ; it is then re-encoded by a repetition code (REP) and re-interleaved with the outputs denoted by and , respectively). For an arbitrary user (the symbol index is dropped for brevity), the output of the MUD after the SoIC can be written as
[TABLE]
Then, each user starts its single user detection and decoding in parallel. The (soft) demapper computes the log-likelihood-ratio (LLR) of each bit while treating the residual interference as noise. For BPSK, an approximation of the true a posteriori LLR can be computed according to
[TABLE]
where the noise variance , the random phase shifts and the channel coefficients are assumed to be known at the receiver. The interference power can be estimated by
[TABLE]
where the interference term is assumed to be Gaussian distributed, provided that the number of users is large enough and the transmitted symbols are independent among users (central limit theorem).
Then, the LLRs are deinterleaved (denoted by which means the extrinsic message from the MUD corresponds to the a priori knowledge of the REP obtained by the MUD) and sent to a repetition decoder. The extrinsic message from the repetition code to the LDPC decoder is given by
[TABLE]
Subsequently, channel decoding can be performed by the corresponding channel decoder.
III Spatially Coupled LDPC
We follow the definitions in [15], i.e., consider SC-LDPC code ensembles defined by their protograph matrix . Protographs can be seen as a blueprint of larger graphs, where copies of the protograph are randomly connected by edge permutations. Each non-zero entry of the corresponding base matrix represents the number of connected edges to this node type. For further details we refer interested readers to [15, 16].
For the sake of spatial coupling, can be divided into sub-matrices of dimension [15], i.e.,
[TABLE]
The approach from [15] is used to construct the SC-LDPC protograph matrix , where denotes the replication factor (i.e., the number of sub-blocks). For a terminated code and a coupling window , we get
[TABLE]
Finally, a lifting step with lifting factor results in the parity-check matrix .
III-A Density Evolution for the GMAC with iterative detection/decoding
The decoding threshold can be obtained via density evolution [16, 17]. We apply a Gaussian approximation (GA), i.e., we only track the mean value of messages passed along within the decoder and the iterative MUD with transfer function as in [10].
We denote the entry of in the -th row and the -th column as . Let denote the mean value of messages passed from check node decoder (CND) with spatial position to a connected variable node decoder (VND) at spatial position and let denote the mean value passed from VND to CND . The update rules become111For readability, we only consider edges where , all unconnected edges () virtually transmit . [10, 17]
[TABLE]
with as in [17]
[TABLE]
Due to the serial concatenation of a REP of rate , the mean of the messages passed from VND (including the REP code) to the MUD is therefore
[TABLE]
Here denotes the mean of the message from MUD to VND after the PIC processing at MUD nodes. These updated messages can be written as [9]
[TABLE]
The variable node update from VND to CND is
[TABLE]
In this work, we use codes as proposed in [15]:
- •
: SC-LDPC code with and
- •
: SC-LDPC code with ,
[TABLE]
Table I shows the decoding thresholds and for the uncoupled and the SC-LDPC ensemble, respectively. As expected a higher node degree degrades the uncoupled thresholds, however, the SC-LDPC codes show an improved threshold which coincides well with the effect of threshold saturation [12].
III-B EXIT analysis
Fig. 2 shows the extrinsic information transfer (EXIT) chart for the proposed MUD system with a SC-LDPC code at an SNR of , i.e., below the uncoupled decoding threshold of . As it can be seen, convergence is possible although no open decoding tunnel exists in the EXIT chart (cf. micro-convergence in [10]). As successful decoding is possible even if VND and CND curves intersect, no extensive degree profile matching of the code components is required anymore. This intuitively visualizes the universal behavior of SC-LDPC codes as their decoding thresholds are (approximately) universal for varying channel conditions [10, 11].
IV Windowed MUD and channel decoder
So far, we considered full BP decoding, meaning that all spatial positions are updated in parallel for each iteration. However, the authors in [13] showed that a windowed decoding scheme reduces decoding complexity without significant BER performance loss. Throughout this work, we assume a constant number of iterations per window shift, yet, an adaptive implementation is possible [18].
IV-A Windowed receiver
The windowed decoder makes use of the fact that the BER per spatial position converges in a wavelike manner, i.e., subsequent blocks can only be decoded if the previous blocks have been successfully decoded. Therefore, it is sufficient to only update nodes within a few spatial positions (active window), i.e., per decoding iteration only sub-blocks are active. We keep the decoding structure as in Fig. 1, but activate the same window for all users in parallel (i.e., all nodes at the same spatial positions). The windowed MUD estimates the SNR per sub-block (see Sec. IV-B for the intuition behind) and updates its outgoing messages accordingly. Finally, the window position is shifted by one spatial position after decoding iterations until all sub-blocks are decoded. For further details on the initialization, see [18].
IV-B Subblock interleaving
The general idea of IDMA systems is to separate users by user-specific interleavers which are straightforward to implement for block-codes (besides complexity considerations). However, for SC-LDPC codes (and also due to the windowed receiver scheme) these interleavers require some further attention regarding the interleaving depth.
In (5), we assumed that the incoming messages from the MUD are all from spatial position for all users, i.e., they have the same underlying statistics and, thus, is the same for all users. However, when assuming random interleaving over the whole , the update in (5) changes to
[TABLE]
and, thus, a full interleaver potentially destroys the locality of the SC-LDPC code and spatial positions with high interference noise (yet unconverged positions) hinder wavelike convergence. Further, the windowed MUD does not even update spatial positions outside the currently active window. Intuitively, this can be explained as illustrated in Fig. 3 for the two-user scenario. As the current decoding progress of spatial position shares messages with the other users, a random interleaver causes the access of random spatial positions (messages potentially not yet updated) of the other users. This means a user observes the high interference noise as if no (only little) a priori knowledge at the receiver exists. Thus, the overall performance can be approximated by a non-iterative scheme, where the initial estimate of the MUD provides a lower bound on its performance, i.e., .
To keep the spatial structure of the code, we propose to use sub-block interleavers which only permute locally within a spatial position. This suffices for the required user separation, but still maintains the locality of the SC-LDPC code. However, the price to pay is a potentially smaller interleaver size (or larger sub-block size) and, thus, a slightly degraded BER performance of the IDMA system. Fig. 4 compares the BER performance for a system with the proposed sub-block interleaver (simulation parameters in Sec. V). It can be seen that the decoding performance under full interleaving together with windowed decoding degrades to the expected non-iterative performance, i.e., each user sees the SINR while the sub-block interleaving yields results close to as provided in Table I. If full BP decoding is used with full interleaving, the performance can be dramatically enhanced with 1500 allowed iterations, but is still worse than the sub-block interleaved version with windowed decoding.
V Simulation results
We consider an IDMA system with users and a targeted sum-rate of . Both, AWGN and Rayleigh fading channel models are considered. For the AWGN channel case, an explicit phase scrambling is included into the symbol-mapper to improve the distance between multi-user superimposed codewords [14]. For Rayleigh fading channels, we consider that the channel states are uncorrelated among users and vary rapidly from symbol to symbol (ergodic fading, i.e., uncorrelated fast fading) and, therefore, a phase scrambler is not necessary in Rayleigh channels. Furthermore, the received signal power levels are assumed to be the same, i.e., and BPSK is used as modulation format. For the unequal-power case, the repetition code can be used as ”power equalizer” (see [9]).
Fig. 5 shows the BER results for such SC-LDPC-coded IDMA systems with the windowed detection and decoding scheme as described in Sec. IV. In the simulations, we use a decoding window length of sub-blocks, each consisting of 8000 symbols; iterations are carried out per window shift. As provided in Sec. III-A, the code construction with , , , and the construction with , , , are considered (for sum-rate one) and the total codeword length of the serially concatenated SC-LDPC and repetition code is fixed to . The simulated BERs for both cases at in AWGN channel are about larger than the decoding thresholds obtained from density evolution. The gap to the ultimate GMAC capacity is about and for the (3,4) and (3,6) codes, respectively. Compared to the AWGN channel case, the performance loss due to Rayleigh fading is only for both codes, due to the so-called multiuser diversity in fading channels [3]. The performance of block LDPC code (code-word length is , same as SC-LDPC codes) with EXIT chart based matching degree profiles is included for comparison. Besides the cumbersome matching procedure, the required irregularity in the parity-check matrix unfortunately degrades the error-floor performance of the code.
As the number of users in a MAC system can vary, we propose to use the additional REP to cope with the varying number of users [9]. Fig. 6 shows the GA DE-based gap-to-capacity results for various repetition codes and number of users, while for all those curves the used SC-LDPC code is fixed. It can be observed that increasing the repetition factor leads to a quite universal support over a wide range of number of users . For instance with , the gap-to capacity can be kept below for the number of users in the range . For comparison, the results for a block LDPC code with optimized degree profile are also included, where the block LDPC code is of the rate . With a further repetition code of , the total code rate is the same as the (3,6) SC-LDPC code with . It is obvious that (if fixed) the SC-LDPC code can support a wider range of users, although the gap-to-capacity can be larger for some number of users.
VI Conclusions and outlook
We have analyzed SC-LDPC codes as coding scheme for an IDMA multi-user system with a sliding windowed-based iterative detection and decoding receiver. We have examined the decoding thresholds through density evolution and shown that thresholds saturation occurs. The SC-LDPC codes benefit from the anticipated universal behavior of SC-LDPC codes with respect to the channel front-end and, thus, do not require explicitly matched degree profiles for a specific number of users or changing channel characteristic. It also relaxes potential error-floor issues in finite-length code design, as regular node degrees instead of highly irregular degree profiles are sufficient. Further, a windowed receiver implementation, consisting of both windowed detector and windowed decoder, keeps the overall decoding complexity within a feasible range but requires sub-block interleaving. As a result, the proposed system operates below 1 dB away from the GMAC capacity at a BER of for finite length code constructions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] C. Berrou, A. Glavieux, and P. Thitimajshima, “Near Shannon limit error–correcting coding and decoding: Turbo–codes,” Proc. IEEE Int. Conf. on Commun. (ICC) , pp. 1064–1070, May 1993.
- 2[2] S.-Y. Chung, G. D. Forney, T. J. Richardson, and R. Urbanke, “On the design of low-density parity-check codes within 0.0045 d B of the Shannon limit,” IEEE Comm. Letters , vol. 5, no. 2, pp. 58–60, 2001.
- 3[3] D. Tse and P. Viswanath, Fundamentals of Wireless Communications . Cambridge University Press, 2005.
- 4[4] L. Dai, B. Wang, Z. Ding, Z. Wang, S. Chen, and L. Hanzo, “A survey of non-orthogonal multiple access for 5G,” IEEE Commun. Surveys Tuts. , vol. 20, no. 3, pp. 2294–2323, 2018.
- 5[5] L. Dai, B. Wang, Y. Yuan, S. Han, C. I, and Z. Wang, “Non-orthogonal multiple access for 5G: solutions, challenges, opportunities, and future research trends,” IEEE Commun. Mag. , vol. 53, no. 9, pp. 74–81, Sep. 2015.
- 6[6] L. Ping, L. Liu, K. Y. Wu, and W. K. Leung, “Approaching the capacity of multiple access channels using interleaved low-rate codes,” IEEE Comm. Letters , vol. 8, no. 1, pp. 4–6, Jan 2004.
- 7[7] L. Ping, L. Liu, K. Wu, and W. K. Leung, “Interleave division multiple-access,” IEEE Trans. Wireless Commun. , vol. 5, no. 4, pp. 938–947, April 2006.
- 8[8] S. ten Brink, G. Kramer, and A. Ashikhmin, “Design of low-density parity-check codes for modulation and detection,” IEEE Trans. Commun. , vol. 52, no. 4, pp. 670–678, April 2004.
