Pseudocodeword-based Decoding of Quantum Stabilizer Codes
July X. Li, Pascal O. Vontobel

TL;DR
This paper adapts pseudocodeword analysis from classical to quantum stabilizer codes to improve sum-product algorithm decoding, addressing its limitations.
Contribution
It introduces a novel application of pseudocodeword analysis to quantum codes and proposes modifications to SPA decoding for better performance.
Findings
Pseudocodeword analysis extends to quantum stabilizer codes.
Modified SPA decoding shows improved robustness.
Insights help overcome SPA weaknesses in quantum decoding.
Abstract
It has been shown that graph-cover pseudocodewords can be used to characterize the behavior of sum-product algorithm (SPA) decoding of classical codes. In this paper, we leverage and adapt these results to analyze SPA decoding of quantum stabilizer codes. We use the obtained insights to formulate modifications to the SPA that overcome some of its weaknesses.
| empty vertex | for syndrome bit associated with -th parity check |
|---|---|
| filled vertex | for syndrome bit associated with -th parity check |
| black edge | channel introduced no error at that location |
| red edge | channel introduced an error at that location |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Pseudocodeword-based Decoding
of Quantum Stabilizer Codes
July X. Li and Pascal O. Vontobel
Department of Information Engineering, The Chinese University of Hong Kong, Hong Kong
Email: {july.x.li, pascal.vontobel}@ieee.org
Abstract
It has been shown that graph-cover pseudocodewords can be used to characterize the behavior of sum-product algorithm (SPA) decoding of classical codes. In this paper, we leverage and adapt these results to analyze SPA decoding of quantum stabilizer codes. We use the obtained insights to formulate modifications to the SPA that overcome some of its weaknesses.
I Introduction
Graph covers have been shown to be a useful tool for analyzing sum-product algorithm (SPA) decoding of classical codes [1]. The task of analyzing the behavior of SPA decoding for quantum stabilizer codes is more challenging, especially because the degeneracy of quantum stabilizer codes needs to be taken into account. Despite these challenges, being able to understand and improve the behavior of the SPA is highly desirable, since it has been observed that the performance of the SPA is far from satisfactory when decoding quantum stabilizer codes of high degeneracy (see, e.g., the discussion of simulation results of various massage-passing iterative decoding algorithms and LP decoders in [2, 3, 4]).
In this paper, in a first step, we use graph-cover pseudocodewords to analyze the behavior of SPA. In particular, we can show that the decoding ability of the SPA is limited by the minimum distance of the normalizer label code, which is a serious problem for quantum LDPC codes, e.g., the toric codes [5] and MacKay’s bicycle codes [6], where the minimum distance of the normalizer label code is no larger than the row weight of its parity-check matrix due to the self-orthogonality of the stabilizer label code.
In a second step, we use the obtained insights to formulate modifications to the SPA that overcome some of its weaknesses. Taking advantage of the degeneracy of the quantum stabilizer code, the performance of the decoder is then limited by the minimum distance of the quantum stabilizer code instead of the minimum distance of the normalizer label code . For notational details, see Section II-A.
This paper is organized as follows. In Section II, we review some basic notations including the stabilizer formalism and the standard SPA for quantum stabilizer codes. In Section III, we analyze the performance of SPA for quantum stabilizer codes and give some other theoretical results about degenerate decoders of quantum stabilizer codes. In Section IV, we propose, first, some methods to improve the performance of the SPA for general quantum stabilizer codes and, second, a pseudocodeword-based decoder for quantum cycle codes. Finally, we show some simulation results in Section V.
II Basics
II-A Quantum Stabilizer Formalism
We refer the readers to [7, 8] for a detailed introduction to quantum stabilizer codes, some recent developments of quantum error-correction codes, and more details of the notations. Moreover, see [3] for the use of pseudocodewords in the context of quantum stabilizer codes. Due to the page limitations, we only introduce the essential notations which are used throughout the paper.
Consider an quantum stabilizer code of length , dimension , and minimum distance . The quantum stabilizer code may be characterized using the equivalent binary representation of its stabilizer, namely its binary stabilizer label code , which is self-orthogonal under the symplectic inner product to guarantee the commutativity of the generators of the stabilizer. The binary representation of a Pauli operator on qubits is a length- binary vector , where each is obtained by mapping , , , and onto as follows
[TABLE]
and the weights of them are defined to be, respectively,
[TABLE]
In this paper, we make the following assumptions:
- •
the normalizer label code is the dual code of under the symplectic inner product (note that the self-orthogonality of implies that );
- •
both and are binary linear codes of length and of dimension and , respectively;
- •
the weight of is ;
- •
and ;
- •
and .
A quantum stabilizer code is called a quantum cycle code if its normalizer label code is a cycle code, which means that the number of ’s per column of the parity-check matrix describing is two. For example, the toric codes are quantum cycle codes (see, e.g., [5, 9]).
The quantum channel that we use in this paper is the quantum depolarizing channel (QDCh). Similar to the binary symmetric channel (BSC), the action of a QDCh with depolarizing probability is such that it acts independently on each qubit: a qubit is either unchanged with probability , or affected by a unitary operator , , or , each with probability . Since we are decoding with respect to binary normalizer label codes, decoding is based on approximating the QDCh by two independent BSCs with crossover probability , i.e., the probability for having a bit-flip and a phase-flip is independently for each qubit.
Definition 1**.**
Given a syndrome , let be the mapping giving a coset representative of the coset of corresponding to the syndrome . Note that if is the binary representation of the actual error, then and .
A non-degenerate decoder outputs a vector based on the syndrome ; an error vector leads to a decoding error for if . A degenerate decoder outputs a coset of based on the syndrome ; an error vector leads to a decoding error for if . The blockwise ML (non-)degenerate decoders , , and are defined to be, respectively,
[TABLE]
where is the probability of the coset based on the syndrome .
For the simulations in this paper, there is a decoding error if the output vector is not in the same coset of as the actual error or the output coset is not the same coset of as the coset of the actual error.
II-B SPA decoding, graph covers, and pseudocodewords
SPA decoding of a quantum stabilizer code consists of the following steps: 1) running the SPA on a factor graph representing a coset of the normalizer label code , where the coset is defined by the syndrome that is obtained from suitable quantum measurements; 2) outputting a vector , 3) finding the coset of containing . (For further details, see, e.g., [2, Section IV].) In this paper, the factor graphs are normal factor graphs, where variables are associated with edges.
It was shown in [10] that fixed points of the SPA correspond to stationary points of the Bethe free energy function. As discussed in [1], for LDPC codes this means that the beliefs obtained at a fixed point of the SPA induce a pseudocodeword . For example, if we consider a binary linear code, then the component of is assuming the belief of the variable is . The paper [1] also introduced the symbolwise graph-cover decoder, a decoder that finds the pseudocodeword with minimal Bethe free energy, or, equivalently, the pseudocodoword with the most pre-images in all -covers of the base normal factor graph (after properly discounting for a channel-output-dependent term), when goes to infinity. For general codes, symbolwise graph-cover decoding is an approximation of the true behavior of SPA decoding. However, for cycle codes it was shown in [11] that SPA decoding is equivalent to symbolwise graph-cover decoding. Note that, although symbolwise graph-cover decoding is based on -covers where goes to infinity, in many instances the study of pseudocodewords induced by codewords in -covers for small gives already many insights into the suboptimality of SPA decoding (see, e.g., the upcoming Fig. 3 that shows an -cover for ).
III Theoretical Analysis
In this section we characterize the performance of the non-degenerate and degenerate decoders defined in Definition 1. In particular, in Theorems 2 and 3 we prove that the minimum weight of errors that the non-degenerate and degenerate decoders fail to decode are and , respectively. Moreover, in Theorems 4 and 5, we show two types of decoding errors limiting the performance of SPA decoding of quantum cycle codes.
Theorem 2**.**
The minimum weight of errors leading to decoding errors for is .
Proof.
See Appendix A. ∎
Theorem 3**.**
The minimum weights of errors leading to decoding errors for and both are .
Proof.
See Appendix B. ∎
Theorem 4**.**
The minimum weight of errors that the SPA fails to decode for a toric code is . For a toric code with , the number of such weight- errors is .
Proof.
For a toric code with , it cannot correct some weight-2 errors because of its minimum distance. For a toric code with , there are two types of weight- errors that cannot be corrected using SPA decoding as shown in Fig. 3. (Here and for other similar figures we use the drawing conventions listed in Table I; moreover, edges with components close to [math] are not drawn). For both cases, we obtain an SPA pseudocodeword , for some . When the SPA decoder makes hard decisions based on , it outputs either or and hence fails to match the syndrome. The minimum weight of errors resulting in decoding failures for toric codes is , since weight- errors can be corrected. If we count the number of such weight- errors, there are in each length- cycle and in total. ∎
For a quantum cycle code with even , the minimum weight of errors that the SPA fails to decode is no larger than because of similar problems as in Fig. 3.
Theorem 5**.**
The minimum weight of errors that the SPA fails to decode for a toric code is no larger than .
Proof.
We want to show that there exist errors of weight that the SPA fails to decode. Since the minimum weight of vectors in the normalizer label code is , there exists a cycle of length in and we assume that the error is a path of length starting from any check involved in that cycle. Fig. 3 is a -cover of the relevant part of a toric code. We claim that the SPA cannot decode the above-mentioned error. The reason is as follows. There are two valid configurations in the 2-cover, where the red one can be projected down as a codeword with a valid syndrome, while the blue one cannot. The components of the pseudocodewords resulting from these valid configurations are shown next to the corresponding edges in Fig. 3. The SPA pseudocodeword is a linear combination of such pseudocodewords, e.g., a rescaled SPA pseudocodeword in Fig. 3, and the SPA decoder fails to output a vector with a valid syndrome no matter how to scale such SPA pseudocodeword. ∎
More generally, for quantum cycle codes, the SPA fails to decode errors of minimum weight no larger than for similar reasons.
IV Pseudocodeword-based Decoding
If we want to improve the performance of SPA of quantum stabilizer cycle codes, or, more generally, quantum stabilizer codes, the first task is to address the problem mentioned in the proof of Theorem 4 by breaking the symmetry of the SPA to avoid ending up with pseudocodewords like the ones in Fig. 3.
IV-A Reweighted SPA Decoding
Our first approach is to use the reweighted SPA decoding proposed in [12], which reweights message calculations. However, instead of uniformly reweighing the messages, we randomly select weights from a certain interval. We call the resulting algorithm randomly reweighted SPA (RR-SPA). Empirically, this method can improve the performance of SPA decoding of the toric codes, but there is not much improvement for MacKay’s bicycle codes.
IV-B Initial-message-reweighted SPA of Quantum Stabilizer Codes
In order to introduce our second approach, we recall that the SPA is based on the log-likelihood ratios (LLRs) and the syndrome . Our second approach is called initial-message-reweighted SPA (IMR-SPA) and described in Algorithm 1. The IMR-SPA also runs the SPA, however, with the reweighted LLRs, i.e., is replaced by , where is a weighting factor randomly generated from some interval. Empirically, it is observed that the RR-SPA and the IMR-SPA have similar performance for the toric codes. From an analysis point of view, the IMR-SPA may be preferable compared to the RR-SPA and other approaches like random perturbation [13], because after suitable adapations, we can apply the Bethe free energy framework [10, 1, 11] to analyze the IMR-SPA.
We briefly explain why the IMR-SPA helps to improve the performance of SPA decoding of quantum stabilizer codes. Namely, assume that we know, for analysis purposes, the actual error vector . For SPA decoding, using the LLR vector with the syndrome is equivalent to using the LLR vector , where , with the syndrome . SPA decoding succeeds when it converges to the all-zero vector based on the LLR vector and the syndrome . The IMR-SPA changes the LLR vector for the standard SPA from to be and hence may move some from the “bad” region to the “good” region in which the SPA converges to the all-zero vector.
IV-C Pseudocodeword-based Decoder of Quantum Cycle Codes
For quantum cycle codes, the IMR-SPA decoding can improve the minimum weight of errors leading to decoding failures beyond , but it is still limited by the problems mentioned in Theorem 5. Therefore, we propose a pseudocodeword-based decoder abbreviated as SPA+PCWD, which is described in Algorithm 2, to further improve the performance of SPA decoding for quantum cycle codes. When SPA decoding fails to output a vector with valid syndrome, we hope to make use of the SPA pseudocodeword to obtain one with valid syndrome. There are two difficulties in this task:
- the components contributed by codewords from graph covers without a valid syndrome need to be removed;
- the components contributed by codewords from graph covers with a valid syndrome are mixed together and need to be separated.
The main idea of the decoder is to first decompose the pseudocodeword into a set of paths and then output a vector with a valid syndrome, where the support of is determined by a collection of paths. The paths are obtained by starting from an unsatisfied check and by always following the edge with the largest possible component of for the next step without repetition until reaching an unsatisfied check , where the weight of the path is defined as the minimum component of on that path. The contribution of that path from the pseudocodeword is then subtracted and the path is included in the set of candidate paths. We use a simple example to explain the procedure of Algorithm 2.
Example 6**.**
Consider a toric code of and . We obtain an SPA pseudocodeword after 100 iterations. The rescaled pseudocodeword is shown in Fig. 3, where edges with component are omitted. First, by Algorithm 3 we can obtain a set of paths , e.g., and with and for . Then, Algorithm 2 picks an arbitrary path since their costs are the same and outputs , where the support of is determined by .
V Simulation Results
Fig. 4 shows some simulation results of SPA+LPPCWD decoding of toric codes described in Algorithm 2, where we use at most 100 iterations of SPA to obtain SPA pseudocodewords. According to the simulation results in [4], the performance of the original SPA gets worse as the code block length of toric codes increases. As shown in Fig. 4, the performance of the SPA+LPPCWD improves as the code block length of toric codes increases and the SPA+LPPCWD has similar performance as the neural belief-propagation decoder in [4] and the Markov chain Monte Carlo algorithm in [14]. Fig. 5 shows the weight distribution of the decoding errors of SPA+PCWD decoding of toric codes, where the minimum weight of errors increases as the block length increases. We also observed that the IMR-SPA and the RR-SPA have similar performance as the SPA+PCWD for toric codes with , but unfortunately they are limited by some weight- errors for .
Fig. 6 shows some simulation results of the IMR-SPA of a MacKay’s bicycle code with the total row weight for . The maximum number of iterations of SPA is 100 and the maximum number of IMR trials is 10. The IMR-SPA achieves lower WER at around compared with the the neural belief-propagation decoder [4] for MacKay’s bicycle codes with the same parameters.
Appendix A Proof of Theorem 2
Proof sketch: The idea is to show each coset of contains at most one vector of weight less than or equal to and there exists some coset of containing two vectors of weights less than or equal to , one of which is a decoding error.
Let the set of decoding errors and the minimum weight of decoding errors for be and . We show that and .
- •
() For any syndrome , there is at most one such that , otherwise suppose there are such that and then with . A contradiction arises.
Hence for all the vectors with weight no more than , they must have distinct syndromes and they are all in and not in , which implies .
- •
() Since , there exists such that . There exist such that , , and . Then for some and at most one of them can be in . Hence for some and .
Appendix B Proof of Theorem 3
Let the set of decoding errors and the minimum weight of decoding errors for be and . We first show that and then .
- •
() Since , there exists such that . There exist such that , , and . Then we have and , for some and . Then at most one of them can be in or . Hence and for some , and and .
- •
() For any syndrome , there is at most one coset of in containing vectors of weights smaller or equal to , otherwise suppose there are with such that and for , and then with . A contradiction arises. Hence all vectors of weight no larger than are in and not in , which implies .
The main contribution of the probabilities of cosets comes from the vectors with minimum weights as . Hence which implies .
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. O. Vontobel, “Counting in graph covers: A combinatorial characterization of the Bethe entropy function,” IEEE Trans. Inf. Theory , vol. 59, no. 9, pp. 6018–6048, 2013.
- 2[2] Z. Babar, P. Botsinis, D. Alanis, S. X. Ng, and L. Hanzo, “Fifteen years of quantum LDPC coding and improved decoding strategies,” IEEE Access , vol. 3, pp. 2492–2519, 2015.
- 3[3] J. X. Li and P. O. Vontobel, “LP decoding of quantum stabilizer codes,” in Proc. IEEE 2018 Int. Symp. Inf. Theory , Vail, Colorado, USA, June 17–22 2018, pp. 1306–1310.
- 4[4] Y.-H. Liu and D. Poulin, “Neural belief-propagation decoders for quantum error-correcting codes,” ar Xiv preprint ar Xiv:1811.07835 , 2018.
- 5[5] J.-P. Tillich and G. Zémor, “Quantum LDPC codes with positive rate and minimum distance proportional to the square root of the blocklength,” IEEE Trans. Inf. Theory , vol. 60, no. 2, pp. 1193–1202, 2014.
- 6[6] D. J. Mac Kay, G. Mitchison, and P. L. Mc Fadden, “Sparse-graph codes for quantum error correction,” IEEE Trans. Inf. Theory , vol. 50, no. 10, pp. 2315–2330, 2004.
- 7[7] M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information . UK: Cambridge University Press, 2010.
- 8[8] D. A. Lidar and T. A. Brun, Quantum Error Correction . Cambridge University Press, 2013.
