Spatially Coupled LDPC Codes with Non-uniform Coupling for Improved Decoding Speed
Laurent Schmalen, Vahid Aref

TL;DR
This paper introduces optimized non-uniform coupling in spatially coupled LDPC codes to enhance decoding speed and performance under low-complexity decoding constraints, using differential evolution for optimization.
Contribution
It proposes a novel non-uniform coupling scheme for spatially coupled LDPC codes, improving decoding speed and performance while maintaining regular degree distribution.
Findings
Optimized coupling improves decoding speed.
Simulation confirms performance gains.
Regular degree distribution maintained.
Abstract
We consider spatially coupled low-density parity-check codes with finite smoothing parameters. A finite smoothing parameter is important for designing practical codes that are decoded using low-complexity windowed decoders. By optimizing the amount of coupling between spatial positions, we show that we can construct codes with improved decoding speed compared with conventional, uniform smoothing constructions. This leads to a significantly better performance under decoder complexity constraints while keeping the degree distribution regular. We optimize smoothing configurations using differential evolution and illustrate the performance gains by means of a simulation.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6| Code | Rate () | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3 | 3 | 0.46 | 0.37124 | 0.00835 | 0.62041 | — | — | — | — | — | 0.49062 | |
| 4 | 3 | 0.46 | 0.44135 | 0 | 0.00814 | 0.55051 | — | — | — | — | 0.48556 | |
| 5 | 4 | 0.46 | 0.37919 | 0 | 0 | 0.00125 | 0.61956 | — | — | — | 0.48045 | |
| 6 | 4 | 0.46 | 0.36720 | 0.00274 | 0.00134 | 0.00091 | 0.00098 | 0.62683 | — | — | 0.47562 | |
| 8 | 4 | 0.46 | 0.37520 | 0.00685 | 0.00356 | 0.00194 | 0.00111 | 0.00015 | 0 | 0.61119 | 0.46573 | |
| 3 | 3 | — | — | — | — | — | — | 0.49089 | ||||
| 4 | 3 | — | — | — | — | — | 0.48694 | |||||
| 5 | 3 | — | — | — | — | 0.48313 | ||||||
| 6 | 4 | — | — | — | 0.47776 | |||||||
| 8 | 4 | — | 0.46971 | |||||||||
| 3 | 4 | 0.47 | 0.34281 | 0.00501 | 0.65218 | — | — | — | — | — | 0.49034 | |
| 8 | 5 | 0.49 | 0.34485 | 0 | 0.00125 | 0.00443 | 0.00655 | 0.00976 | 0.01293 | 0.62023 | 0.46544 | |
| 3 | 4 | — | — | — | — | — | — | 0.49039 | ||||
| 8 | 4 | — | 0.46971 |
| Decoder Setup A | Decoder Setup B | |||
| Coupling width | ||||
| 3 | 15 | 1 | 15 | 5 |
| 4 | 20 | 1 | 20 | — |
| 5 | 25 | 1 | 25 | — |
| 6 | 30 | 1 | 30 | — |
| 8 | 40 | 1 | 40 | 2 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Spatially Coupled LDPC Codes with Non-uniform Coupling for Improved Decoding Speed
Laurent Schmalen
now with Karlsruhe Institute of Technology (KIT)
Communications Engineering Lab (CEL)
(e-mail: {first.last}@kit.edu)
Vahid Aref
Nokia Bell Labs, Stuttgart, Germany.
(e-mail: {first.last}@nokia-bell-labs.com)
Abstract
We consider spatially coupled low-density parity-check codes with finite smoothing parameters. A finite smoothing parameter is important for designing practical codes that are decoded using low-complexity windowed decoders. By optimizing the amount of coupling between spatial positions, we show that we can construct codes with improved decoding speed compared with conventional, uniform smoothing constructions. This leads to a significantly better performance under decoder complexity constraints while keeping the degree distribution regular. We optimize smoothing configurations using differential evolution and illustrate the performance gains by means of a simulation.
I Introduction
††The work of L. Schmalen and V. Aref has been performed in the framework of the CELTIC EUREKA project SENDATE-TANDEM (ProjectID C2015/3-2), and it is partly funded by the German BMBF (Project ID16KIS0450K).
Low-density parity-check (LDPC) codes are widely used due to their outstanding performance under low-complexity belief propagation (BP) decoding. However, an error probability exceeding that of maximum-a-posteriori (MAP) decoding has to be tolerated with (sub-optimal) low-complexity BP decoding. A few years ago, it has been empirically observed that the BP performance of some protograph-based, spatially coupled (SC) LDPC ensembles (also termed convolutional LDPC codes) can improve towards the MAP performance of the underlying LDPC ensemble [1]. Around the same time, this threshold saturation phenomenon has been proven rigorously in [2, 3] for a newly introduced, randomly coupled SC-LDPC ensemble. In particular, the BP threshold of that SC-LDPC ensemble tends towards its MAP threshold on any binary memoryless symmetric channel (BMS).
SC-LDPC ensembles are characterized by two parameters: the replication factor , which denotes the number of copies of LDPC codes to be placed along a spatial dimension, and the smoothing parameter . This latter parameter indicates that each edge of the graph is allowed to connect to neighboring spatial positions (for details, see [2] and Sec. II). The proof of threshold saturation was given in the context of uniform spatial coupling and requires both and . This poses a serious disadvantage for realizing practical codes, as relatively large structures are required to build efficient codes.
In practice, the main challenges for implementing SC-LDPC codes are the decoding complexity and the rate-loss due to termination. The decoding complexity can be managed by employing windowed decoding (WD) [5], however, the average number of operations needed to decode conventional SC-LDPC codes is still larger as for uncoupled LDPC codes. In high-speed communications, e.g., optical communcations, the number of operations that can be carried out per bit is usually heavily limited [6]. Reducing the decoding complexity is hence an important step towards finding practical SC-LDPC codes. Both the WD complexity and the rate-loss scale almost linearly with suggesting to keep as small as possible.
It has been shown in [2, 7] that the decoding behavior of SC-LDPC codes exhibits a profile that behaves like a “wave”: it shifts along the spatial dimension with “a constant speed” as the BP decoder iterates. The WD complexity is also inversely proportional to the wave propagation speed, which has been analytically analyzed and bounded in [8],[9] and used to design irregular degree distributions in [6]. To decrease the WD complexity and the rate-loss, we introduced non-uniform coupling in [10] to construct codes with and having good thresholds as well as improved decoding speeds. It was recognized earlier in [11, 12] that non-uniform protographs can lead to improved thresholds in some circumstances by sacrificing a one-sided convergence of the chain, which is not problematic when using WD. A particular exponential coupling was used in [13] to guarantee anytime reliability. Non-uniform coupling has also been successfully used in compressed sensing [14].
In this paper, we extend non-uniform coupling to randomly coupled SC-LDPC ensembles with . We analyze their performance under message passing using density evolution. We show that properly optimized smoothing profiles can achieve significantly higher decoding speeds than their uniform counterparts using regular variable and check node degrees only. The numerically optimized smoothing profiles exhibit some interesting properties that may be used in the future for more targeted code design. We verify the properties of the obtained smoothing schemes by means of simulation.
II Spatially Coupled LDPC Codes
We briefly describe the construction of non-uniformly coupled LDPC codes: we focus on the random ensemble which is easier to analyze and exhibits the general advantages of non-uniform coupling. In general, protograph-based ensembles are of more practical interest. All approaches that we present in this paper can be extended to protograph codes, as was shown also in [10].
II-A The Random Ensemble
We now briefly review how to sample a code from a random, non-uniformly coupled () SC-LDPC ensemble with regular degree distributions. We first lay out a set of positions indexed from to on a spatial dimension. At each spatial position (SP) , there are variable nodes (VNs) and check nodes (CNs), where and and denote the variable and check node degrees, respectively. The non-uniformly coupled structure is based on the smoothing distribution where , and denotes the smoothing (coupling) parameter. The special case of leads to spatial coupling with the uniform smoothing distribution [3].
For termination, we additionally consider sets of CNs in SPs . Every CN is assigned with “sockets” and imposes an even parity constraint on its neighboring VNs. Each VN in SP is connected to CNs in SPs as follows: For each of the edges of this VN, an SP is randomly selected according to the distribution , and then the edge is uniformly connected to any free socket of the sockets arising from the CNs in that SP . This graph represents the code with code bits, distributed over SPs. Because of additional CNs in SPs , but also because of potentially unconnected CNs in SPs , the design rate is slightly decreased to where
[TABLE]
which increases linearly with . An exemplary protograph representation of such SC-LDPC ensemble with smoothing distribution is shown in Fig. 1-a). A single element of the chain is separately depicted in Fig. 1-b) exhibiting the non-uniform edge spreading between different SPs.
In the limit of , the asymptotic performance of this ensemble on a binary erasure channel (BEC) can be analyzed using density evolution, with
[TABLE]
where denotes the channel erasure probability and the average erasure probability of the outgoing messages from VNs in SP at iteration . The messages are initialized as , if and otherwise. For , (1) becomes the known DE equation for SC-LDPC codes with uniform coupling [2, Eq. (7)].
II-B Decoding Speed & Windowed Decoder Complexity
The decoding complexity is an important parameter for practical SC-LDPC codes. Consider the profile of densities in (1). It has been shown in [2, 7] that the profile behaves like a “wave”: it shifts along the spatial dimension with “a constant speed” as the BP decoder iterates. The wave-like behaviour enables efficient sliding windowed decoding [5]: the decoder updates the BP messages of edges lying in a window of SPs times, and then shifts the window one SP forward and repeats. Thus, the decoding complexity scales with as there are BP messages and each BP message is updated times.
The required window size is an increasing function of the smoothing factor [5] which implies that we should keep small. The number of iterations where is the speed of the wave. In the continuum limit of the spatial dimension, is defined as the amount displacement of the profile along the spatial dimension after one iteration. For the discrete case of (1), the speed can be estimated by
[TABLE]
where in the minimum number of iterations required for the displacement of the profile by more than SPs, i.e.,
[TABLE]
The approximation of becomes more precise by choosing larger . We chose in this paper to minimize the influence of boundary effects, even when is large.
III Non-Uniform Coupling for Higher Decoding Speeds
In this section, we optimize random non-uniformly SC-LDPC ensembles with the goal of constructing coding schemes that have the highest possible decoding speed. In [10], we have shown that for , non-uniform coupling significantly improves the threshold of regular SC-LDPC ensembles and also slightly increases the decoding speed. In this paper, we do not constrain but instead allow for a larger to assess the potential increase in decoding speed. In order to keep the exposition simple, we optimize the speed using the BEC. However, all the techniques can be used in a similar way for other binary symmetric channels as well. In what follows, we describe the cost function used to estimate the speed .
Assume that we have carried out density evolution (1) for iterations and that we have obtained a profile and assume that , i.e., we have not yet achieved full convergence (assuming two-sided convergence is possible). We define the wave position as
[TABLE]
where SP such that and . Now, let denote the number of iterations until and define the cost function . Minimizing is directly related to maximizing the speed , which can be approximated as . In practice, we can find by carrying out DE using a finite number of iterations, checking whether the code converges and if a wave is currently propagating, followed by finding . We can repeat the procedure and use a binary search over the number of iterations to find such that .
First, we consider with . This case has a high practical interest as is the smallest smoothing parameter leading to rather small decoding latency111This assumes that is fixed. Increasing and decreasing such that is fixed would lead to an approximately fixed latency. and window length of WD. In [10], we showed that non-uniform coupling improves the BP threshold in this case. In Fig. 2, the dashed lines illustrate the decoding speeds of some regular, uniformly coupled codes. We can clearly see that the best threshold is obtained for (the threshold is given by the largest for which ) and the largest speed is shared between (for ) and (for ). We carried out an optimization of the decoding speed with non-uniform coupling: for each , and each , we find, using a simple line search, the (we restrict to allow only for a left-propagating wave) that minimizes and compute the corresponding speed . For each , we only keep the value of that minimizes . We can see in Fig. 2 (solid line) that non-uniform coupling increases significantly the threshold, however, the speed is only marginally improved.
If we increase , the search space for finding a good can become too large. In this case, we use differential evolution [17] to find the best smoothing profiles . The dimensionality of the search space is and we use a population consisting of vectors , which we initialize by uniformly sampling from the -dimensional polytope of valid (as , we only need values) and keeping those vectors that allow convergence (, ). Inside the differential evolution step, for population entry , we first generate a candidate , where element-wise restricts the input to the range and such that , and . We then replace entry () of vector by with probability . If (i.e., the cost function for a code where is obtained from the , or , respectively), we store and replace in the next iteration with the stored . We repeat the steps for all entries and iteratively repeat for 1000 iterations. During the evolution, we keep track of the vector leading to the lowest cost .
In Fig. 3 and 4, we compare the speeds of the smoothing profile optimized with cost function for and . In contrast to the case , we see a clear advantage in terms of decoding speed , and less so in terms of decoding threshold (which is already very good for the reference schemes). This advantage gets larger when becomes larger as well with a very steep decline observed. Again, we see a similar behavior for the reference schemes where the largest speed is obtained for . As the evaluation of the cost function becomes increasingly more complex when close to the threshold, we didn’t extend the curves towards the threshold (which is similar then for the uniformly coupled case).
In practice, we can often use a simpler cost function, as the binary search to find can be computationally demanding (especially if carrying out a numerical optimization like differential evolution, requiring a large number of cost function evaluations). Let denote the iteration at which SP becomes virtually error free, i.e.,
[TABLE]
assuming that the code converges, i.e., , . The value has been chosen as a compromise between accuracy and numerical stability. The value of hence denotes the number of iterations until the decoding wave fully passes beyond SP . The cost function is then given as , with as defined in (3). While the cost function is easier to calculate, it may be misleading, as due to numerical inconsistencies, may not indicate the true position of the wave. However, it only requires a single execution of DE. To highlight the fact that can be used as well to optimize smoothing profiles, we carried out differential evolution for , with the same parameters, but using cost function instead of . For the smoothing profiles obtained from the optimization routine with cost function , we compute the value and the speed , which we plot as an additional curve in Fig. 4 (solid line with markers). We can see that the difference is marginal and the obtained speeds even coincide in some regions. We observe similar results for other values of (not shown here). Hence, we may use during optimization as it is significantly less complex to evaluate. Further increasing will result in even larger speed gains, as we will also see in the simulation example below.
IV Simulation Results
In order to assess the performance of the optimized non-uniformly coupled codes, we carry out a simulation example using the BI-AWGN channel. As SC-LDPC codes are (asmyptotically) universal [3], we use the BEC-based optimization as a simple proxy to find parameters of the codes. Note that the universality has been proven in [3] only for the uniformly coupled case and may not apply to the non-uniformly coupled codes. We have seen before that the decoding speed depends on the erasure probability and (slightly) different are obtained for each different . We have therefore carried out the optimization for , yielding an optimized and a corresponding for each . In a next step, we have constructed codes of rate with and bits per SP for each of these four cases. We have carried out finite length simulations using WD [5] with window length and iterations per decoding window step. We consider two decoder configurations in this paper: In decoder configuration A, we carry out a single iteration () per decoding window, as is frequently done in high speed (e.g., optical) communications. To avoid issues with too short windows (see [18] for details), we select . Decoder configuration B targets a higher decoding complexity (and hence also a better performance) and selects such that effective iterations are carried out for each bit. The decoder configurations are summarized in Tab. II.
From the finite length simulation, we select the code performing best (which is associated with a certain ). We call the respective optimized codes , where denotes the decoder configuration. We would like to point out that the optimized do not vary significantly if we use cost function or cost function (see also Fig. 4 and the discussion above). Interestingly, it appears that the dominant terms in are and and the remaining terms are negligible.
For each , we constructed additionally reference codes of rate with uniform coupling and regular with (). We have carried out simulations and selected the best uniformly coupled reference code for each and each decoder setup. The parameters of all the codes are summarized in Tab. I.
In Fig. 5 (Decoder Setup A) and Fig. 6 (Decoder Setup B), we show the performance of the codes when simulated over a BI-AWGN channel. We use the codes from Tab. I with and both uniform and optimized non-uniform coupling. As expected, for , the performance differs almost not at all, while for larger , the performance gap becomes increasingly larger. In particular for , we can obtain an advantage of about dB and obtain codes that are quite close to capacity. Note that codes with larger also have larger decoding latency as is fixed. The same gains are observed with Decoder Setup B, where a larger baseline complexity is used during decoding. Interestingly, the rate loss of the optimized non-uniform codes is slightly larger than the rate loss of the reference, uniformly coupled, codes. This is in contrast to the results of [10] where we have shown that for , non-uniform coupling always reduces the rate loss. However, for , this is not necessarily the case, and we observe here an increase in the rate loss. An interesting open question is the optimization of non-uniform coupling profiles that do not lead to an additional rate loss but still improve decoding speed.
V Conclusion
In this paper, we have considered spatially coupled LDPC codes with finite smoothing parameter. A finite smoothing parameter is important for realizing practical codes that are decoded using, e.g., windowed decoders. We have shown that by carefully optimizing the amount of coupling in each SP, we can construct codes with excellent thresholds and decoding speeds of the wave that are faster compared to conventional uniformly coupled codes. An interesting observation is that the dominant terms in the numerically optimized smoothing profiles are only the first and the last elements while the remaining terms are negligible. The numerical simulation finally confirms the excellent, close-to-capacity performance of the constructed codes.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] M. Lentmaier, G. P. Fettweis, K. Zigangirov, and D. J. Costello, Jr., “Approaching capacity with asymptotically regular LDPC codes,” in Proc. ITA , La Jolla, CA, USA, 2009.
- 2[2] S. Kudekar, T. Richardson, and R. Urbanke, “Threshold saturation via spatial coupling: Why convolutional LDPC ensembles perform so well over the BEC,” IEEE Trans. Inf. Theory , vol. 57, no. 2, Feb 2011.
- 3[3] ——, “Spatially coupled ensembles universally achieve capacity under belief propagation,” IEEE Trans. Inf. Theory , vol. 59, no. 12, 2013.
- 4[4] P. M. Olmos and R. Urbanke, “A scaling law to predict the finite-length performance of spatially-coupled LDPC codes,” IEEE Trans. Inf. Theory , vol. 61, no. 6, pp. 3164–3184, June 2015.
- 5[5] A. R. Iyengar, P. H. Siegel, R. L. Urbanke, and J. K. Wolf, “Windowed decoding of spatially coupled codes,” IEEE Trans. Inf. Theory , 2013.
- 6[6] L. Schmalen, V. Aref, J. Cho, D. Suikat, D. Rösener, and A. Leven, “Spatially coupled soft-decision error correction for future lightwave systems,” J. Lightw. Technol. , vol. 33, no. 5, pp. 1109–1116, 2015.
- 7[7] S. Kudekar, T. J. Richardson, and R. L. Urbanke, “Wave-like solutions of general 1-d spatially coupled systems,” IEEE Trans. Inf. Theory , 2015.
- 8[8] V. Aref, L. Schmalen, and S. ten Brink, “On the convergence speed of spatially coupled LDPC ensembles,” in Proc. Allerton Conf. , 2013.
