Polynomial Linear System Solving with Errors by Simultaneous Polynomial Reconstruction of Interleaved Reed-Solomon Codes
E. Guerrini, R. Lebreton, I. Zappatore

TL;DR
This paper introduces a novel algorithm for solving polynomial linear systems with errors during evaluation, enhancing error correction bounds by leveraging decoding techniques from Interleaved Reed-Solomon Codes.
Contribution
The paper presents a new algorithm that improves error correction bounds in polynomial linear system solving by applying decoding methods from interleaved Reed-Solomon codes.
Findings
Enhanced error correction bounds achieved
Algorithm effectively handles errors in evaluation step
Inspired by Reed-Solomon decoding techniques
Abstract
In this paper we present a new algorithm for Polynomial Linear System Solving (via evaluation/interpolation) with errors. In this scenario, errors can occur in the black box evaluation step. We improve the bound on the number of errors that we can correct, using techniques inspired by the decoding procedure of Interleaved Reed-Solomon Codes.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Polynomial Linear System Solving with Errors
by Simultaneous Polynomial Reconstruction
of Interleaved Reed-Solomon Codes
Eleonora Guerrini, Romain Lebreton, Ilaria Zappatore
*LIRMM, Université de Montpellier, CNRS
*Montpellier, France
{guerrini, lebreton, zappatore}@lirmm.fr
Abstract
In this paper we present a new algorithm for Polynomial Linear System Solving (via evaluation/interpolation) with errors. In this scenario, errors can occur in the black box evaluation step. We improve the bound on the number of errors that we can correct, using techniques inspired by the decoding procedure of Interleaved Reed-Solomon Codes.
I Introduction
The problem of decoding a Reed-Solomon code (shortly RS), also known as the Polynomial Reconstruction Problem (PR) has been largely studied in Coding Theory [1, 2, 3]. In [7], Bleichenbacher et al. proposed a new scenario of the PR problem, called Simultaneous Polynomial Reconstruction (SPR). This problem was associated to the decoding of Interleaved Reed-Solomon codes. Instead of the separate reconstruction of each interleaved codeword, the main idea was to correct several codewords simultaneously in order to gain an error correction capability which depends also on the amount of messages received (interleaving parameter). They proposed an algorithm that, under some hypotheses on the error distribution, allows to correctly decode Interleaved RS codewords, beyond the unique decoding bound, with a certain probability. This probability depends on the number of errors and on the order of the field of the coefficients. Interleaved Reed Solomon codes (IRS) are widely studied in the last 20 years. In the original work [7] the key equations for recovering the codewords are a generalization of Berlekamp-Welch decoding method for RS. A more general scenario is due to [10] (improved by [11]) where codewords are issue of differents RS codes ( namely Heterogeneous IRS ) and the decoding method is based on Berlekamp-Massey algorithm as for the classical BCH codes. Recently, in [9] by applying Power Decoding method for generating independent key equations [12], the IRS decoding radius is significantly improved.
The purpose of the present work is to introduce a new algorithm, inspired by SPR problem, to solve a full rank consistent linear system where erroneous evaluations occur.
In order to solve this system, a classical technique (see for example [4]) consists in evaluating in a certain number of points, solving the evaluated system and then interpolating these evaluated solutions. The solution is a vector of rational functions , where is a vector of polynomials and is the least common denominator.
In [5, 6], authors studied the problem in a scenario where some evaluations can be erroneous. They introduced an algorithm that recovers the solution by fixing a certain number of evaluation points. This method is a generalization of the Berlekamp-Welch algorithm for PR. Thus, the error correction capability coincides with the unique decoding bound.
In this work, we generalize the SPR problem to the Simultaneous Rational Function Reconstruction (SRFR) in order to solve a polynomial linear system with errors. In the special case where the matrix is the identity matrix, we observe that our problem reduces to the SPR, or equivalently, to the problem of decoding an Interleaved RS code. Still in this special case, we can apply the decoding technique of Interleaved RS codes and correct more errors than [5] under the probabilistic hypotheses of [8]. In order to generalize this, we reexamine the scenario of [5, 6] with a probabilistic assumption. In this context, we introduce a new algorithm that can be seen as the generalization of the decoding algorithm of Interleaved RS codes. Our algorithm can correctly reconstruct the vector solution of our system with a smaller number of points . However it can fail for a small fraction of possible errors as in [8]. In our case, the fraction is at most where is the degree of the common denominator of the rational function vector, is the number of errors and the order of the field.
II Polynomial linear system solving with errors
In [5] and [6], authors studied the problem of solving a consistent linear system
[TABLE]
where,
- •
is a full rank matrix whose entries are polynomials in , is a field and ;
- •
is an -th vector of polynomials in .
The system admits a solution whose coordinates are rational functions and, since the matrix is full rank, there is a unique solution
[TABLE]
where is the monic least common denominator, and
[TABLE]
In general, this solution can be found by evaluating the system at a certain number, say , of distinct points with , solving the evaluated system and then interpolating the parametric solution from the evaluated solution [4]. The authors in [5] proved that it is possible to reconstruct the solution even if some evaluations are erroneous. They focused on a model where there is a black box that, for any evaluation point , provides and which may not be equal to and . More specifically, the resulting evaluations and are considered erroneous if . In this scenario they proved that with
[TABLE]
number of points, it is possible to uniquely reconstruct the solution of the linear system (1), where
- •
,
- •
,
- •
is a bound on the erroneous evaluations where
[TABLE]
- •
is a bound on the rank drops where
[TABLE]
Their method consists in solving the homogeneous linear system
[TABLE]
where
- •
and for any , ,
- •
, .
The unknowns of the linear system (4) are the coefficients of and . In particular, they proved the following:
Theorem 1** ([5]).**
Under previous assumptions, let be the solution of (4) of minimal degree and monic. Then
[TABLE]
where
[TABLE]
is the error locator polynomial.
From now on we omit the rank drops study and we assume .
This method is a generalization of the Berlekamp-Welch decoding algorithm for Reed-Solomon codes [1]. In fact, if , , and is the constant polynomial , then
[TABLE]
Hence, in this case, the problem of recovering the solution of the linear system (1) with errors, coincides with the problem of decoding of RS code and the linear system (4) is exactly the key equation of the classical Berlekamp-Welch method.
We now define the Interleaving RS encoding procedure.
Let be an RS code.
- •
we consider codewords . For any , where has degree and is the set of distinct evaluation points;
- •
we arrange these codewords row-wise and we obtain the matrix ;
- •
by interpreting this matrix as a row vector , we obtain a codeword of an Interleaved RS code of length , dimension over . The number of codewords is the amount of interleaving.
Definition 1** (Simultaneous polynomial reconstruction [7]).**
Let and distinct points in . An instance of the SPR is , that verifies the following. There exists
- •
* with ,*
- •
polynomials , with
such that
[TABLE]
The solution of the SPR is the tuple .
The SPR problem is exactly the problem of decoding an Interleaved RS code with length , dimension and amount of interleaving .
We can now observe that,
Remark 1**.**
If , , and is the constant polynomial , then the linear system (1) becomes
[TABLE]
Hence, the problem of solving the linear system (1) with errors coincides with the problem of decoding an Interleaved RS code (SPR [7]) with length , dimension and amount of interleaving .
In [7], the authors proposed an algorithm that, under some hypotheses on the error distribution, allows to decode an Interleaved RS code with a certain probability. In particular, they introduced key equations,
[TABLE]
The unknowns of this linear system are the coefficients of and , polynomials of degrees at most respectively and . This linear system (5) has equations and unknowns. Moreover,
Theorem 2** ([7]).**
Let the received word of an Interleaved RS code, or equivalently an instance of the SPR problem, where
[TABLE]
and for each ,
- (i)
if , are uniformly distributed over 2. (ii)
if , and are uniformly distributed over the vector space of polynomials of of degree at most ;
then the linear system (5) admits at most one solution with probability at least .
Since if ,
[TABLE]
then they proved that, under the probabilistic assumptions (i) and (ii), it is possible to correctly decode the received word beyond the unique decoding bound. The failing probability, i.e. the probability that the algorithm fails, is then upper bounded by .
In a following paper [8], the probabilistic assumptions are reduced and it was proved that the failing probability is which is independent of the number of errors. In detail,
Theorem 3** ([8]).**
Given the received word of an Interleaved RS code, where
[TABLE]
and for each ,
- (i)
if , are uniformly distributed over 2. (ii)
if , ,
then the linear system (5) admits at most one solution with probability at least .
In this paper, starting from Remark 1 we reexamine the problem of solving the linear system (1) with errors as a generalization of the decoding of an Interleaved RS code under some hypotheses on the error distribution. In particular, following the [7] approach, we prove that the failing probability is at most (where is the degree of the common denominator of the vector of rational functions). We stress out that, in our scenario, we relax the hypotheses on the error distribution as in [8]. However we are not able to prove a bound on the failing probability as tight as [8] (see Section IV for more comments).
III Generalization of decoding of Interleaved RS codes
We study the problem of solving a consistent, full rank, linear system (1), with polynomial entries over a finite field .
In a first instance, we focus on the square case, i.e. . Let be the reduced unique solution as in (2).
We fix evaluation points with
[TABLE]
where
- •
,
- •
,
- •
for ,
- •
is the number of erroneous evaluations where
[TABLE]
Remark 2**.**
In this way, since , we reduce the number of evaluation points,
[TABLE]
We slightly modify the black box scenario described in the previous section, by introducing a probabilistic assumption. More specifically, we assume that for any erroneous evaluation, , the entries of and are uniformly random elements of . Moreover, since we skip the rank drops study, we also suppose that all the are always full rank.
We study, for any , the homogeneous linear systems
[TABLE]
Remark 3**.**
Let be the coefficients matrix of any of these linear systems,
[TABLE]
Since any system have equations and unknowns and is full rank, the rank of is and in particular, the kernel of any is one dimensional.
Proposition 1**.**
Let be the vector that generates the right kernel of , with . Then,
[TABLE]
Proof.
By our assumptions, for any . Now, since the right kernel is one dimensional, its generator is a nonzero vector, and also . Let , be a correct evaluation. Since and , then . The matrix is full rank, hence . Then we can conclude that . ∎
Following the previous notations, if we denote by , for any we have that
[TABLE]
Remark 4**.**
By our probabilistic assumption, are uniformly random elements of .
In this way, we reduce the problem of solving the linear system (1) to the reconstruction of a vector of rational functions with errors. In particular, we observe that if is the constant polynomial , our problem coincides exactly with the decoding of an Interleaved RS code, with length , dimension and amount of interleaving . This is why we can consider our problem as a generalization of the decoding of Interleaved RS codes.
Now, we study the key equations
[TABLE]
or, in other terms, if we denote for ,
[TABLE]
where
- •
and ,
- •
has degree at most .
The linear system (9) has equations and unknowns, which are the coefficients of and .
The coefficient matrix of the system is
[TABLE]
where,
- •
is the Vandermonde matrix,
- •
for , is the diagonal matrix with on the diagonal.
Recall that the error locator polynomial is monic and has degree . We observe that is a solution of the system. Therefore, if the kernel of has dimension 1, the non-zero solutions are collinear to , meaning that we can correctly reconstruct the fraction .
We do not have a priori any other information about this kernel. In our following main result, we adapt the approaches of [7, 8] to prove that this favorable situation happens with high probability.
Theorem 4**.**
Under the previous assumptions, the dimension of the (right) kernel of is one with probability at least .
The cornerstone of the proof is the following lemma.
Lemma 1**.**
There exists a random draw of such that the dimension of the right kernel of is one.
Proof.
We can partition with sets such that for since . We start by fixing a part of the random variables : for all and , we set while for remain free variables for now, for a total of free variables.
Now, we study the equations (9). Fixed , for , . Therefore, since the polynomial has degree at most and at least roots, it is the zero polynomial. Hence, the two fractions are equals,
[TABLE]
Moreover, since the fraction is reduced, there exists a polynomial such that , and .
Hence for , and and so by replacing in (9) we have
[TABLE]
We observe that for any , there exists such that , so is still a free variable and we can give it a value so that since . Therefore for and and so is a scalar multiple of . We have proved that for some values of the kernel is spanned by and has dimension 1.
∎
Proof of Theorem 4.
We recall that is a solution of the linear system (9) so it has kernel dimension at least 1. Since is a monic polynomial of degree , the last column of is linearly dependent on the previous ones. As a consequence, the kernel of has dimension iff the rank of is iff there exists a non-zero minor of of size that avoids the last column. Considering the minors as polynomials in the variables , we have shown in Lemma 1 that one of these -minors is not the zero polynomial because it does not vanish on some value of . Finally, since this -minor has degree at most , by Schwartz-Zippel Lemma, it cannot be zero in more than a -fraction of its domain. Therefore, we can conclude that the kernel has dimension 1 with probability at least . ∎
Summing up, working under our probabilistic assumptions, we are able to recover the correct solution with a failing probability upper bounded by .
Up to this point, we have assumed that the linear system (1) is square, i.e. . With our method it is possible to recover the solution with the same probability also in the general case by considering random , for any such that (see Remark 3).
IV Experiments and Conclusions
In this work we prove that, in our probabilistic scenario, by using the evaluation interpolation technique [4] with evaluation points, we can reconstruct the vector solution of the linear system (1). Recall that is the number of points that guarantees to uniquely reconstruct the solution for every error. In our case since , we cannot reconstruct the solution for every error, but for almost all of them.
We implement our algorithm in SageMath (http://www.sagemath.org). In particular, we solve different linear systems with polynomial coefficients, of size . For every system we apply our algorithm times, with errors and . We compute the percentage of the number of times the algorithm fails. We compare our experimental results with , i.e. the failing probability of Theorem 4, and with , i.e. the failing probability of [8]. We recall that the last one is linked to a related problem, the decoding of Interleaved RS, but not to our problem. We obtain the following results:
[TABLE]
First of all, these experiments suggest that the failing probability is very small and that it decreases when the cardinality of the field grows. Moreover, since experiments are significantly under our theoretical bound, our bound could be strongly improved, which we leave to future work. This may also suggest that our bound is not optimal. Therefore, we have done some experiments using an inferior number of evaluation points
[TABLE]
and we note the corresponding probability. This new is chosen in such a way that the coefficient matrix has now equations and unknowns so that its kernel might have dimension 1. We can observe that also in this case, we have a very high probability to reconstruct the correct vector rational solution in practice. Therefore future work could try to extend our results to this new number of evaluation points.
Finally we can remark that, since we use an evaluation interpolation technique, there exist finitely many evaluation points such that the evaluated matrix is not full rank anymore. In this work, we have chosen the evaluation points such that the evaluated matrix is full rank, thus omitting the rank drop analysis, which we leave again to future work.
V Acknowledgements
This work has been supported by Occitanie Region through the ARPE HPAC project. We would also like to thank Daniel Augot and Bruno Grenet for useful discussions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Elwyn R. Berlekamp, Lloyd R. Welch, Error Correction of Algebraic Block Codes. US Patent 4, 633470, 1986.
- 2[2] Venkatesan Guruswami, Madhu Sudan, Improved decoding of Reed-Solomon and algebraic-geometric codes. in IEEE Transactions on Information Theory, vol. 45, no. 6, pp. 1757-1767, Sept. 1999.
- 3[3] Madhu Sudan, Decoding of Reed-Solomon codes beyond the error-correction bound. Journal of Complexity, vol. 13, no. 1, pp. 180-193, 1997.
- 4[4] Michael T. Mc Clellan The Exact Solution of Systems of Linear Equations with Polynomial Coefficients. J. ACM 20, pp. 563-588, 1973.
- 5[5] Brice B. Boyer, Erich L. Kaltofen, Numerical Linear System Solving With Parametric Entries By Error Correction. SNC’14 Proceedings 2014 International Workshop on Symbolic-Numeric Computation, pp.33-38.
- 6[6] Erich L. Kaltofen, Clément Pernet, Arne Storjohann, Cleveland Waddell, Early Termination in Parametric Linear System Solving and Rational Function Vector Recovery with Error Correction. ISSAC ’17 Proceedings of the 2017 ACM on International Symposium on Symbolic and Algebraic Computation, p. 237.
- 7[7] Daniel Bleichenbacher, Aggelos Kiayias, Moti Yung, Decoding Interleaved Reed-Solomon codes over Noisy Data. ICALP Springer, pp. 97-108, 2003.
- 8[8] Andrew Brown, Lorenz Minder, Amin Shokrollahi, Probabilistic Decoding of Interleaved RS-Codes on the Q-ary symmetric channel. In Proc. of IEEE Intern. Symposium on Inf. Theory, p. 327, 2004.
