Good cyclic codes and the uncertainty principle
Shai Evra, Emmanuel Kowalski, Alexander Lubotzky

TL;DR
This paper explores the connection between the uncertainty principle in harmonic analysis and the existence of good cyclic error-correcting codes, suggesting that a weak uncertainty principle could imply their existence.
Contribution
It establishes a novel link between the uncertainty principle and cyclic codes, proposing that a weak form of the principle may guarantee the existence of good cyclic codes.
Findings
A weak uncertainty principle implies the existence of good cyclic codes.
Heuristic arguments support the potential validity of this implication.
The work connects harmonic analysis principles with coding theory challenges.
Abstract
A long standing problem in the area of error correcting codes asks whether there exist good cyclic codes. Most of the known results point in the direction of a negative answer. The uncertainty principle is a classical result of harmonic analysis asserting that given a non-zero function on some abelian group, either or its Fourier transform has large support. In this note, we observe a connection between these two subjects. We point out that even a weak version of the uncertainty principle for fields of positive characteristic would imply that good cyclic codes do exist. We also provide some heuristic arguments supporting that this is indeed the case.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Good cyclic codes and the uncertainty principle
Shai Evra, Emmanuel Kowalski, Alexander Lubotzky
Abstract.
A long standing problem in the area of error correcting codes asks whether there exist good cyclic codes. Most of the known results point in the direction of a negative answer.
The uncertainty principle is a classical result of harmonic analysis asserting that given a non-zero function on some abelian group, either or its Fourier transform has large support.
In this note, we observe a connection between these two subjects. We point out that even a weak version of the uncertainty principle for fields of positive characteristic would imply that good cyclic codes do exist. We also provide some heuristic arguments supporting that this is indeed the case.
1. Introduction
Let be a field. Given integers , and with , an -code, or code over , is a subspace of of dimension , such that for every , we have , where the weight of a vector is the number of non-zero components . The integer is called the distance of the code .
Furthermore, a code is called cyclic if it is invariant under cyclic permutations of the coordinates, i.e. if
[TABLE]
(see [R, Ch. 8]).
The code , or more properly a family of codes in where , possibly along some subsequence of positive integers, is called good if there exists a constant such that
[TABLE]
for all .
We are interested in the case of cyclic codes over a finite field with elements. The practical interest of such codes goes back at least to Brown and Peterson [BP] (e.g., they can be used to efficiently detect so-called “burst errors”). A long standing open problem in the area of error correcting codes is whether, for a fixed value of , there exists an infinite sequence of good cyclic codes.
Most evidence, and maybe the prevailing opinion, goes towards the non-existence of good cyclic codes. Indeed, it was proved by Berman [B] in 1967 that if ranges over integers whose prime factors are bounded, and these factors are coprime to the characteristic of the underlying field , then no sequence of cyclic codes of lengths , is good. Babai, Shpilka and Stefankovic [BSS] proved that this is also the case if ranges over integers such that the primes dividing all satisfy for some fixed constant . Furthermore, they also showed that there are no good cyclic codes that are either locally testable or LDPC (“low density parity check”) codes. We refer to the book [MWS] of MacWilliams and Sloane and to the textbook of Roth [R] for basic terminology and concepts in coding theory.
On the other hand, the uncertainty principle is a classical result of harmonic analysis, which in one form asserts that given a function , either or its Fourier transform has large support. Many variants exist, and we refer to Folland and Sitaram [FS] for a survey of the continuous setting. We will consider the version of the uncertainly principle where is a complex valued function on a finite group , and even more particularly, when is the cyclic group of prime order . In this case, the uncertainty principle states that for , we have
[TABLE]
where is the support of a function (see Meshulam [M1], Goldstein, Guralnick, Isaacs [GGI], Tao [T] or §3 below).
One can formulate the uncertainty principle for functions from to any algebraically closed field (see Section 3). The case of interest to us is when has positive characteristic , in particular when . The inequality (1.2) does not hold in general in this case (see §4 below), but we will give some heuristic argument suggesting that some weaker version may still hold.
We will then show that even a much weaker version of the inequality (1.2) for would suffice to imply the existence of good cyclic codes. This should come as quite a surprise, as it goes against the common wisdom in the theory of error correcting codes.
Acknowledgements
The authors are grateful to E. Ben-Sasson, B. Poonen, P. Sarnak and M. Sudan for discussions and suggestions, many of which have been incorporated into the text. We thanl F. Voloch for pointing out his note [V]. We acknowledge support by the ERC, NSF, ISF, Dr. Max Rössler, the Walter Haefner Foundation and the ETH Foundation, and the ETH Institute for Theoretical Studies. EK’s work is partially supported by an DFG-SNF lead agency program grant (grant 200021L_153647).
1.1. Organization of the paper
This note is arranged as follows:
In 2, we describe cyclic codes of length over the prime field of order , as ideals in the group algebra . We then describe the structure and the ideals of when is a prime, and express the dimension and the distance of such an ideal in terms of this data (using in particular the multiplicative order of modulo ).
In 3, we formulate the uncertainty principle for functions . To illustrate the connection with cyclic codes, we show how this uncertainty principle implies the existence of good cyclic codes over – the examples we recover are the well-known Reed-Solomon codes over . This is of course not the end of the story, as one wants such codes over finite fields.
In 4, we formulate a few variants of the uncertainty principle over various fields. We present a proof of the uncertainty principle for any field of characteristic zero, following [GGI]. Afterwards, we present some counter-examples to a naive generalization of the uncertainty principle to finite fields.
In 5, we propose a weaker version of uncertainty principle, and show how this weaker version implies the existence of good cyclic codes. In 6, we present some heuristics, both for this weak uncertainty principle and for the existence of good cyclic codes.
We conclude with an Appendix that explains that the uncertainty principle for is equivalent to an old result of Chebotarev.
2. Cyclic codes
2.1. Introduction
The following is a long standing open problem.
Problem 2.1**.**
Are there good cyclic codes over a fixed finite field ?
This was asked by MacWilliams and Sloane [MWS, Problem 9.2, p. 270]. See also [MPW] who attribute the problem to [AMS]. It seems that the common belief is that there are no such codes and there are a number of results in support of such a conjecture.
For instance, the most commonly used cyclic codes are the long BCH codes (see [R, §5.6] for definition and background of BCH codes), and Lin and Weldon [LW] proved that these codes are not good.
Partial results toward the conjecture were obtained by Berman [B] in 1967 and by Babai, Shpilka and Stefankovic [BSS] in 2005. We state their results formally:
Theorem 2.2** (Berman).**
Let be a finite field of order , and a family of -cyclic codes such that there exists some real number with for all . Assume furthermore that there exists such that all primes dividing are coprime to and at most . Then there exists an integer , depending on and , such that . In particular, this family is not a good family of codes.
Theorem 2.3** (Babai-Shpilka-Stefankovic).**
Let be a finite field, and let be a family of -cyclic codes over . Assume that there exists , independent of , such that for every and for every prime dividing , we have . Then the family is not a good family of codes over .
There are other results which give some support to a negative answer to Problem 2.1, for example:
Theorem 2.4** (Babai-Shpilka-Stefankovic).**
Let be a finite field. Then:
- •
There are no good cyclic LDPC (low density parity check) codes over ;
- •
There are no good cyclic locally testable codes over .
We refer to [McK, Ch. 47] for the definition of LDPC codes, and to [GS] for locally testable codes; these are important concepts in coding theory in recent years.
Let be any field. The key to the investigation of cyclic codes over is their description in algebraic terms using the polynomial ring .
Proposition 2.5**.**
Let be an integer. Under the isomorphism
[TABLE]
between and the ring , a subspace is a cyclic code over if and only if is an ideal of .
Proof.
Indeed, an -vector subspace of is a cyclic code if and only if for any , which is equivalent to asking that be an ideal of . ∎
It will also often be convenient to identify the ring with the subspace of polynomials of degree less than .
2.2. Describing the ideals of
If we specialize to the case where is a prime number, we can describe and its ideals in quite concrete and well-known terms:
Proposition 2.6**.**
Let be a prime number different from the characteristic of . Then:
- (1)
The ring is a direct sum of finite extensions of ; these finite extensions are in one to one correspondence with the irreducible factors of the polynomial . 2. (2)
If splits in linear factors in (e.g. if is algebraically closed), then is isomorphic to as a ring; 3. (3)
Assume that is a finite field of order . Let , i.e. the order of as an element of the multiplicative group . Denote . Then
[TABLE]
i.e., it is isomorphic as a ring to a direct sum of and copies of the extension of .
Proof.
- (1)
As , the polynomial is separable in and hence factors as a product of distinct irreducible polynomials , where we put . It then follows from the Chinese Remainder Theorem that
[TABLE]
Since is irreducible, each quotient ring is a field extension of of degree . 2. (2)
By assumption, , where runs over the -th roots of unity in . Since , we get an isomorphism
[TABLE] 3. (3)
Since is a cyclic group of order , the order of modulo divides , and hence is an integer.
We have and is a cyclic group of order , hence the field extension of contains an element of order , and is the smallest extension with this property. In fact, the field contains all the -th roots of unity, i.e. is the splitting field of the polynomial . For every -th root of unity , the extension is equal to (in a fixed algebraic closure of ). This shows that all the irreducible factors of , with the exception of , are of degree . Hence
[TABLE]
∎
We can now describe the ideals of . Since is a direct sum of fields, every ideal in is the direct sum of a certain subset of these fields. If is algebraically closed, for instance, we see that has distinct ideals of dimension , for every , and a total of ideals.
If where is the power of a prime number, let be the order of modulo and as in the proposition. In the special case , namely when , the polynomial splits completely in and the ideals are exactly the same as those in the algebraically closed case.
Now assume that , which is the case we are most interested in since we will consider a fixed value of as tends to . Then has ideals of dimension and ideals of dimension for all integers with . Hence the total number of ideals in is .
We note that , and hence .
There are two extreme cases which are worth singling out, although whether they actually occur is somewhat conjectural:
**(a): **
Assume that is a primitive root mod , i.e. generates the cyclic group . Then and so , i.e. and has only two non-trivial ideals.
**(b): **
Assume that and that is a Mersenne prime, namely for some . Then we have and ; in this case, has the “maximal” possible number of ideals .
We stated that it is not known if these cases occur infinitely often. Indeed, it is a very famous conjecture of Artin (see Moree’s survey [Mo]) that, for a given prime number , there exist infinitely many primes such that is a primitive root modulo . The validity of this conjecture is extremely likely, since it was shown by Hooley [H] to follow from a suitable form of the Generalized Riemann Hypothesis. Moreover, although it not known to hold for any concrete single prime , Heath-Brown [HB] has shown that it holds for all but at most two (unspecified) prime numbers.
On the other hand, although it is expected that there are infinitely many Mersenne primes, very little is known about this question, or about small values of in general, even assuming such conjectures as the Generalized Riemann Hypothesis (see however Lemma 6.2).
The most convenient analytic criterion to find primes with under control is the following elementary fact:
Lemma 2.7**.**
Let , and be different primes. If is totally split in the extension , then is congruent to modulo and the order of modulo divides , in particular .
Proof.
Let be the ring of integers of . If is totally split in , then the quotient ring is a product of copies of the field . So contains the -th roots of unity (in particular, ) and the -th roots of . So is an -th power in , which means that divides . ∎
Note that as an application of Chebotarev’s density Theorem [N, Th. 13.4], for any primes , there exists infinitely many primes which totally splits in .
To summarize the discussion: the ideals of and their dimensions can be easily described, although the existence of certain configurations might be subject to the truth of certain arithmetic conjectures.
It is more complicated to evaluate the distance of ideals of when interpreted as cyclic codes. For this we will use the Fourier transform and the uncertainty principle in the next section. We begin first with a general lemma.
Lemma 2.8**.**
Let be a prime. For any polynomial , let be the ideal generated by the image of in and let .
- (1)
We have , i.e. the ideal generated by is the same as the ideal generated by the greatest common divisor of and . 2. (2)
We have
[TABLE]
Proof.
(a) We obviously have in , and since is a principal ideal domain, there exist polynomials and in such that . Hence we get in , which proves claim (a).
(b) The first equality follows from (a). For the second equality, it suffices to note that, by euclidean division by the polynomial of degree , the elements form a basis of . ∎
For later reference, we will denote for any polynomial and any prime . If has characteristic different from , then is a separable polynomial, and in that case, the integer is therefore the number of -th roots of unity , in an algebraic closure of , such that . This interpretation will be very useful as we now turn to the uncertainty principle…
3. The uncertainty principle over
3.1. The Fourier transform on finite abelian groups
Let be a finite abelian group. The dual group of is the group of all homomorphisms , where is the group of complex numbers of modulus . The product on is the pointwise multiplication of functions. The dual group is also a finite abelian group, in fact it is isomorphic to (non-canonically).
The Fourier transform on is a linear map from the space of complex-valued functions on to the analogue space of complex-valued functions on the dual group. For a function , its Fourier transform is defined by
[TABLE]
for any .
The Fourier transform is also an algebra isomorphism, where is viewed as an algebra with the convolution product
[TABLE]
and has the pointwise product of functions. In other words, we have
[TABLE]
The connection that we will make with cyclic codes emphasizes the group algebra of a cyclic group. It is therefore convenient to interpret the Fourier transform in terms of the group algebra of the group instead of .
We identify and by the map
[TABLE]
Then the Fourier transform gives an isomorphism
[TABLE]
of algebras over , where the image of the standard basis is the basis of characters of the algebra of functions .
3.2. The general uncertainty principle for finite abelian
groups
For , or equivalently , we denote by the support of , namely the set of such that .
Intuitively, by“uncertainty principle”, we mean a statement that asserts that there are no non-zero functions such that both and have “small” support (for instance, in the continuous case, there is no non-zero smooth function with compact support whose Fourier transform is also compactly supported). There are many variants of this principle. One well-known elementary “uncertainty principle” version, valid for all finite abelian groups, is the following result of Donoho and Stark [DS, §2]:
Proposition 3.1** (Uncertainty principle).**
Let be a finite abelian group and let be a function from to . Then we have
[TABLE]
We present the proof of this fact from [GGI], which fits well with our point of view of working with group algebras. For other proofs and generalizations, we refer to the papers [M2], [M3] and [T], as well as to the references contained in those articles.
Proof.
We view as an element of the group algebra , which is commutative. Let be the principal ideal generated by . Using the isomorphism given by the Fourier transform, as we recalled above, the ideal corresponds to the principal ideal in generated by the Fourier transform of . This ideal is simply
[TABLE]
In particular, the dimension of , as a -vector space, is the cardinality of the support of . Since the elements for span as -vector space, there exist elements , …, such that is the span of , …, .
For any , the support of is . Since , its support is not empty, hence for any , we can find some element such that .
We then have
[TABLE]
which implies that
[TABLE]
as claimed. ∎
3.3. The uncertainty principle for simple cyclic groups
In the late 1980’s, R. Meshulam observed that an old result of Chebotarev implies a version of the uncertainty principle for cyclic groups of prime order that is much stronger than Proposition 3.1. This strong version has been rediscovered several times since then, and admits a number of proofs and generalizations (see for instance, Chebotarev [C], Meshulam [M1, M2, M3], Goldstein, Guralnick and Isaacs [GGI], Tao [T], Stevenhagen and Lenstra [SL], and the references therein).
Theorem 3.2** **(Uncertainty principle for cyclic groups
of prime order).
Let be a cyclic group of prime order , and an element of . Then
[TABLE]
We will postpone the proof to Section 3.2, and in the appendix, we will also explain Meshulam’s original observation that this statement is equivalent to a classical result of Chebotarev about Vandermonde matrices.
To bring the connection with codes, we will now reformulate this statement. The group algebra of the cyclic group of order is isomorphic to the quotient algebra by mapping the generator of to the image of . The dual group is isomorphic to the group of -th roots of unity in , by mapping a character to the -th root of unity . The Fourier transform of an element , represented as the image of a polynomial
[TABLE]
is then identified with the function defined on -th roots of unity by
[TABLE]
In other words, is the evaluation of the representing polynomial (3.3) at roots of unity.
With this notation, recalling the definition and the fact that this is number of zeros of among -th roots of unity, the uncertainty principle of Theorem 3.2 gets the following form:
Theorem 3.3**.**
Let be a prime. For any polynomial
[TABLE]
of degree , let and let , i.e. the number of -th roots of unity of which are also roots of . Then we have
[TABLE]
Indeed, by definition, if we view as an element of , then we have and , and therefore (3.2) and (3.4) are equivalent.
Remark 3.4**.**
(1) The restriction is necessary: the polynomial has and .
(2) The inequality (3.4) is best possible. For instance, the cyclotomic polynomial vanishes on all the non-trivial -roots of unity, so . Another example is , in which case we also obtain .
We can now use Lemma 2.8 to obtain another reformulation of Theorems 3.2 and 3.3. The point is that if is a polynomial in of degree , viewed also as an element of , then by Lemma 2.8 (2), the dimension of the ideal generated by the image of in satisfies
[TABLE]
From Theorem 3.3, we get therefore:
Theorem 3.5** (Uncertainty principle reformulated).**
For every non-zero polynomial of degree , considered as an element of , we have:
[TABLE]
when is the ideal of generated by the image of .
We conclude this section by showing how this interpretation of the uncertainty principle gives a good family of cyclic codes over :
Corollary 3.6**.**
There exists a family of good cyclic codes over .
Proof.
Let , and define
[TABLE]
Since , we have by Lemma 2.8 (2).
Let then be an element of . We then have , so that
[TABLE]
by Theorem 3.5. The ideal is therefore a -cyclic code, and the family is a good family of cyclic codes. ∎
The codes we have “found” in this proof are special cases of the famous Reed-Solomon codes (see, e.g., [R, §5.2]).
4. Uncertainty principle for general fields
4.1. General statements
The formulation of the uncertainty principle in Theorems 3.3, in the form of the inequality (3.4) and in Theorem 3.5, through (3.5), make sense for all fields. As we will see later, these statements are not true in such generality, but they might be true, and useful, in some weaker form. For this reason, we make the following definition.
Definition 4.1**.**
Let be a field, a prime number and . For , represented by a polynomial of degree , we denote by the ideal generated by in , and we denote
[TABLE]
We then define the invariant
[TABLE]
We will sometimes write instead of , when the field and prime involved are clear in context.
Here are some simple observations:
- •
If is a field extension and , then for any prime number . In particular, it follows that for each .
- •
For , we have and . It follows that for any field and any prime .
- •
According to the uncertainty principle for (Theorems 3.2, 3.3 and 3.5), we have for every prime .
So for any field we can state the uncertainty principle as follows:
Definition 4.2** (Uncertainty principle).**
A field is said to satisfy the uncertainty principle if, for any prime number , we have , or equivalently if , for all .
As we shall see in §4.2, the uncertainty principle does not hold in general, but let us start with some positive results:
Proposition 4.3**.**
Let be the finite field of prime order and assume that is a primitive root modulo , i.e., that . Then .
Proof.
Let be a primitive -th root of unity in . As recalled in Section 2.2, the extension is then of degree . This implies that the polynomial is irreducible over . In particular, for every polynomial of degree less then , the gcd of and can only be one of , or . Then the dimension is equal to , or , respectively (Lemma 2.8 (2)).
We consider each case in turn and show that in any case. If , then since (because ), we get . If , then we have , so . Since the only non-zero polynomials of weight are monomials with , and for , we must have , and therefore . Finally, if , then we have for some , and then and . ∎
Another case is the following claim (which appears also in [F, Lemma 2] and [GGI, Lemma 6.5]), that we will use later:
Proposition 4.4**.**
Let be a prime and let be a field of characteristic . Then we have .
Proof.
By Lemma 2.8 (2), we need to show that for any , we have
[TABLE]
Since has characteristic , we have , which means that there exists some integer with such that . So we need to prove that for a polynomial with , we have .
We proceed by induction on . In the base case , we have . Then , so that and , as claimed.
Now assume that the property is valid for all polynomials of degree and that . If , we deduce that , hence by induction we obtain . If , on the other hand, then we consider the derivative of . From , it follows that : indeed, writing and differentiating, we get , which is divisible by . By induction, we therefore get . But then, since and , we have , as needed. ∎
4.2. Fields of characteristic zero
We will now present a proof (following [GGI]) of the uncertainty principle for any field of characteristic zero. Note that Theorems 3.2, 3.3 and 3.5 are special cases of this result, where the field is . Since it is elementary that we need only prove the uncertainty principle for finitely generated fields , and since such a field of characteristic [math] can be embedded into , we could simply deduce the result from the case of . We give a complete proof anyway.
The next lemma is the key step in the proof.
Lemma 4.5** (Specialization).**
Let be a prime, a field of characteristic [math], and
[TABLE]
a non-zero element of . Then for every prime number , there exists a field of characteristic and a polynomial such that and .
Sketch of the proof:.
c
- (1)
Since , the field is a subfield of . Let , which is a -subalgebra of . By Hilbert’s Nullstellensatz, the homomorphisms , where is the algebraic closure of , separate the points of , and therefore there exists a morphism , such that for every , with , such that . Let be the number field (a finite extension of ) generated by the image of and the polynomial
[TABLE]
Then by the definition of , we have . Moreover, induces an isomorphism between the -th roots of unity in and those in , so that also. This means that we may replace and by and , and reduce to the case where is a number field. 2. (2)
Let be the ring of integers of , and a maximal ideal in that contains . Then is a finite field of characteristic . 3. (3)
Let be a non-zero integer such that for all , and such that there exists some such that (this exists because not all are zero). Then, if is the image of under the reduction map from to , we have in , and is a polynomial of degree . 4. (4)
By construction, we have . On the other hand, we get
[TABLE]
∎
Theorem 4.6**.**
For every field of characteristic [math] and every prime , we have , i.e., the uncertainty principle is true over any field of characteristic [math].
Proof.
Let be a field of characteristic zero, and let be a prime. Let be non-zero. By the Specialization Lemma 4.5 with , there exists a field of characteristic and a non-zero element such that . Because has characteristic , Proposition 4.4 implies that . Since this holds for all , the result follows. ∎
4.3. Counter examples to the uncertainty principle over finite
fields
Specific examples of finite fields for which the uncertainty principle of Definition 4.2 does not hold over a finite field are given in [GGI]. One such example is . If we take and , then we have
[TABLE]
hence while , so that .
The next counter-examples to the naive uncertainty principal for finite fields were suggested to us by Madhu Sudan.
Let be two different primes, and . Let and , so that contains all the -th roots of unity. Moreover, is generated as an -vector space by the -th roots of unity. We consider the trace polynomial
[TABLE]
A basic but crucial observation is that the function from to defined by the trace polynomial is a surjective -linear map from to the subfield , which we denote . In particular, is not identically zero on , and since the -th roots of unity generate as -vector space, this means that is not identically zero on the -th roots of unity.
By the pigeon-hole principle, there exists some such that at least of the -th roots of unity in are roots of . Let then . Then we have
[TABLE]
(using the interpretation of as the number of roots of unity where does not vanish), and consequently
[TABLE]
In particular, if , we obtain a counter example to the uncertainty principle for the field .
There exist infinitely many pairs of primes with this property. For instance, take and let be a prime such that the Legendre symbol is equal to . Then is a square modulo , which implies that , hence that the order of modulo is .
More generally, fix the prime and take any prime . By Lemma 2.7, if is any prime that is totally split in the Galois extension , we have . It is a well-known consequence of the Chebotarev density theorem that there are infinitely such primes.
In anticipation of the next section, we note however that, for any pair with , it still remains true that
[TABLE]
or in other words, the uncertainty principle for does not fail drastically.
5. The weak uncertainty principle
5.1. Statement
The uncertainty principle in its current version over states that for each prime , we have . We have seen that this inequality does not always hold if is replaced by any field. Because of the link with good cyclic codes, we introduce a weaker version:
Definition 5.1** (Weak uncertainty principle).**
Let be a real number such that . We say that a field satisfies the -uncertainty principle for a prime if
[TABLE]
This variant of the uncertainty principle is weaker than the one in the previous section in two respects: the lower bound for is relaxed, and it is stated with respect to an individual prime , and not all of them.
Example 5.2**.**
We first present some finite fields that satisfy the weak uncertainty principle for certain primes. Let be a prime number, and let be an infinite set of primes such that is a primitive root in for all . As we have already mentioned, Artin’s Conjecture asserts that such a set exists for any prime , and Hooley [H] confirmed this under a suitable form of the Generalized Riemann Hypothesis. By Proposition 4.3, we have , for any , and hence the weak uncertainly principle is satisfied by the field for any prime in .
This example does not however lead to good cyclic codes. Indeed, if we consider proper ideals for , the fact that is a primitive root modulo means that is generated either by or by . In the first case, we have , but the element has weight , so that the distance of the code is . In the second case, we have . In either case, the codes corresponding to are not good as in since one of the inequalities in (1.1) fails.
This example motivates our last variant of the uncertainty principle.
Definition 5.3** (Weak uncertainty principle, 2).**
Let and be real numbers such that and . We say that a field of size satisfies the -uncertainty principle if there exists an infinite set of primes such that, for all primes , the two following conditions holds:
- (1)
We have , 2. (2)
We have .
The existence of finite fields which satisfy such an uncertainty principle implies the existence of good cyclic codes over :
Theorem 5.4**.**
Let be a finite field prime order . Assume there exist real numbers such that satisfies the -uncertainty principle. Then there exists an infinite family of good cyclic codes over the field .
Proof.
For each prime , let be a non-zero ideal such that
[TABLE]
Such an element exists because by definition, and is a sum of ideals of dimension each, plus a one dimensional ideal, see Proposition 2.6 (3).
For every element , we have and hence . From the weak uncertainty inequality that we assume, we get
[TABLE]
The cyclic code has length ; the last computation shows that its distance is , and its dimension is . Hence by definition (see (1.1)), the sequence is an infinite sequence of good cyclic codes over .
∎
Generally speaking, condition (1) in Definition 5.3 ensures that we can find ideals with “large” distance, while condition (2) is used to show the existence of such ideals with “large” dimension.
Remark 5.5**.**
Our proof shows that any choice of ideal , such that will give a good code. There are many possibilities for such ideals. This suggests that a randomized process might be used to prove existence of cyclic good codes even under a weaker uncertainty principle.
5.2. A uniform weak uncertainty principle does not hold
It is only natural to ask (and maybe hope) that a uniform weak uncertainty principle, uniform with respect to , should hold for all finite fields, or in other words, to ask whether there exists such that for any finite field and any prime .
We will show – following an argument of Eli Ben-Sasson – that, assuming the existence of infinitely many Mersenne primes, this is not the case.
Proposition 5.6** (No uniform weak uncertainty principle).**
*Assume that there exist infinitely many Mersenne primes. Then, for any , there exists a finite field and a prime number such that . *
For the proof, we will use the following result of Ore [O]:
Lemma 5.7** (Ore).**
Let be a prime number and . Let , and view as an -vector space of dimension . For every integer and every -affine subspace of dimension , the polynomial
[TABLE]
satisfies
[TABLE]
where and are elements of . In particular, we have .
Proof.
It is easy to see that it suffices to consider the case where is a vector subspace of dimension . Then is a separable polynomial whose roots form an additive subgroup of . This implies that is an additive polynomial (see [G, Th. 1.2.1]), which is necessarily of the desired form (with in that case) by [G, Prop. 1.1.5]. ∎
Remark 5.8**.**
In general, if is any field, an additive polynomial is a polynomial such that for any and in . If has characteristic zero, it is easy to check that is necessarily of the form for some , but this is not so in characteristic , since any monomial is then an additive polynomial. The result we used is that any additive polynomial is a linear combination of these monomials.
Proof of Proposition 5.6.
Let and let be a Mersenne prime, so that . Let . Then the non-zero elements of are precisely the -th roots of unity.
We view as an -dimensional vector space over , and fix a basis , …, . Let be an integer parameter such that .
There exist disjoint affine subspaces , …, in , none of which contains [math], with (for instance, we could take to be the subspace defined by the equations
[TABLE]
where are the coordinates of an element of with respect to the chosen basis ).
The disjoint union of the subspaces has cardinality
[TABLE]
Thus if we denote by the polynomial associated to as in Lemma 5.7, and put
[TABLE]
then we have
[TABLE]
since and
[TABLE]
Since , we have
[TABLE]
Let be any given real number. Take some integer such that . By the assumption that there exist infinitely many Mersenne primes, we can find a prime for which and
[TABLE]
Then using the polynomial obtained as above for these parameters and , we get
[TABLE]
and therefore . ∎
It is important to notice that this counter-example does not show that does not satisfy the -uncertainty principle for the prime , since the polynomials and do not usually belong to . Furthermore, as the underlying field depends on the primes , this counter example is not really relevant to our search of families of cyclic good codes, since in such a family we need to work with a fixed underlying field while in the last example, the size of grows to infinity.
6. Why good cyclic codes should exist
6.1. Preliminaries
In this section, we describe some heuristic arguments that all point in the direction of the existence of families of good cyclic codes, and of the weak uncertainty principle according to Definition 5.3.
In both arguments, the main unproved claim is that for a polynomial of degree , the property of being “sparse” (i.e., of having small weight ) and of vanishing on many roots of unity should be roughly independent. The following result is then relevant.
Lemma 6.1**.**
Let be a fixed real number with . Let be the set of polynomials in with . Then we have
[TABLE]
where and
[TABLE]
is the entropy for Bernoulli random variables.
Sketch of proof.
We have
[TABLE]
which the Stirling formula reveals to be of size
[TABLE]
as claimed. ∎
We also recall some fairly classical results on primes where has relatively small multiplicative order.
Lemma 6.2**.**
(1)* For any with , there exist infinitely many primes such that .*
(2)* Assume the Generalized Riemann Hypothesis for Dedekind zeta functions of number fields. For any , there exist infinitely many primes such that .*
Proof.
In both cases, we use the criterion of Lemma 2.7: if is an odd prime and if is an odd prime distinct from such that is totally split in the field , then and the order of modulo divides , hence is .
Hence, taking to be any prime such that , the first statement follows from the existence of infinitely many primes totally split in (this is an easy consequence of the Chebotarev Density Theorem, see for instance [N, Th. 13.4]).
For the second, we use the explicit form of the Chebotarev Density Theorem, following Serre’s presentation of the results of Lagarias and Odlyzko: for any odd prime and any , the number of primes which are totally split in satisfies
[TABLE]
where the implied constant is absolute, under the assumption that Dedekind zeta functions satisfy the Riemann Hypothesis. Precisely, this follows from [S, Th. 4], applied with , and the trivial conjugacy class of the identity element; then and the discriminant is estimated using the bound [S, (20)].
In particular, since the integral is of size and , this result shows that if is fixed and is any prime large enough, there exists a prime totally split in with . Such a prime satisfies
[TABLE]
and the result follows. ∎
The interest of these statements is that if the order of modulo is “small” compared with , then by the discussion following Proposition 2.6, the ring contains many ideals. In particular, if and with is fixed, and if we look for ideals of dimension , then for such primes we have approximately ideals of dimension , where (see Proposition 2.6), we have and . By Stirling’s formula, as in the Lemma 6.1, this numbers grows exponentially with .
6.2. Picking ideals at random
Fix some real number with . Let be a prime such that there exists an ideal in with .
Let be another parameter. Assuming that the probability for an element of to be in the set of Lemma 6.1 is approximately the same as the probability for a general element of , the expected cardinality of the intersection should be about
[TABLE]
by Lemma 6.1. If and are chosen so that
[TABLE]
this expectation is . So, as in the Borel-Cantelli lemma, if we select an ideal of this approximate dimension for all primes where this is possible (an infinite set, by Lemma 6.2 and Proposition 2.6), we may expect that only finitely many will have the property that intersects . Since as , a suitable choice of exists for any fixed .
Moreover, under the Generalized Riemann Hypothesis, picking the primes as given by Lemma 6.2 (2), the number of options for grows exponentially as a function of , and we need to succeed only with a single one of them to obtain a good cyclic code with rate .
6.3. The weak uncertainty principle should hold
Here we give a heuristic argument, suggested by B. Poonen, as to why the weak uncertainty principle of Definition 5.3 should hold for the field for an infinite sequence of primes. This is a variant of the previous argument.
First, the Generalized Riemann Hypothesis implies that there are infinitely many primes such that (this is a simple variant of the argument of Hooley [H] for primitive roots, where we count primes that are split in the quadratic field , and not split in any field for prime, see Lemma 2.7 and [Mo]).
We consider such primes and explain that all but finitely many should satisfy Definition 5.3 with and . Indeed, the condition holds by construction. Suppose . Then there exists a non-zero of degree such that
[TABLE]
Since , the polynomial has exactly two irreducible factors of degree . So the gcd of and is of degree , or . In the first case, the inequality (6.1) is clearly false. In the third case, we have , with , and again (6.1) is false. So must be divisible by exactly one of the two factors of degree , say , and then we must have for (6.1) to hold.
Now comes the heuristic argument, where we will assume that the property of being divisible by and of having support of size are “independent”: the number of polynomials of degree divisible by is about , and on the other hand, the number of polynomials of degree with is by Lemma 6.1. Since
[TABLE]
we may hope that the expected number of polynomials in the intersection is
[TABLE]
and since the sum of the series is finite, this suggests (by analogy with the Borel-Cantelli lemma) that the set of primes where the intersection is non-empty is finite.
F. Voloch has pointed out that one must be careful with this heuristic. Indeed, let , for odd, be the quadratic residue code of dimension , namely the cyclic code corresponding to the principal ideal generated by the polynomial
[TABLE]
If the last step is taken literally, the previous argument suggests that the family of the cyclic codes , parameterized by primes such that , is good. However, assuming GRH, Voloch’s results [V] imply that this is not the case.
More precisely, Voloch shows, under the Generalized Riemann Hypothesis, that there exist an infinite sequence of primes for which the distance of the code is (he obtains an unconditonal bound of size ). Although the primes that he constructs in [V] do not necessarily satisfy the condition that we wish to impose, we will now show that the two can be combined (as was suggested to us by Voloch).
Indeed, Voloch defines a sequence of Galois extensions of degree about , for a prime. He shows that if is totally split in , then the distance of is (for this purpose, he uses a formula of Helleseth). It turns out that the splitting restrictions in are compatible with those involved in constructing primes with . Under the Generalized Riemann Hypothesis, one gets by following Hooley’s method (see, e.g., [Mo, §5]) that for a given odd prime and for , there are roughly
[TABLE]
primes satisfying all the desired combined splitting conditions. Since the degree of over is about , we can find a prime of size about that satisfies the desired conditions. This provides an infinite family of codes with distance , under the Generalized Riemann Hypothesis.
Although this discussion shows that the heuristic argument cannot be literally correct, the optimist might still hope that the events which we consider are sufficiently independent to still lead to infinitely many primes where the weak uncertainty principle holds. It is maybe a positive sign that the primes given by Voloch’s argument are rather sparse, and even then, only a very slow decay of their distance is proved.
Appendix
Chebotarev’s Theorem
A well-known (but not the best-known!) result of Chebotarev [C] states the following:
Theorem 6.3** (Chebotarev).**
Let be a prime and . Let be the Vandermonde matrix . Then each minor of the matrix is invertible, i.e., we have for any , , where denotes the minor of with rows in and columns in .
Let . Then is a vector space over with basis the images of the monomials for .
(A multiple of) the Fourier transform on can be interpreted as the linear map from to such that
[TABLE]
It is elementary that the matrix representing this linear map is . Then each minor of the matrix has a non-zero determinant if and only if the same property holds for the matrix , so we may replace by in proving Chebotarev’s Theorem.
We now show that Theorem 6.3 is equivalent to the uncertainty principle over . For a direct simple proof of Chebotarev’s Theorem, see the note [F] of Frenkel.
Proposition 6.4**.**
Chebotarev’s Theorem 6.3 is equivalent to the uncertainty principle for over , i.e., to Theorem 3.2.
Proof.
For each , we denote by the space of elements of which have zero coefficients for the basis vectors for , i.e., polynomials with support contained in . For an element
[TABLE]
we denote by the element
[TABLE]
of .
For any two subsets and of with the same cardinality, the linear map obtained by restricting the Fourier transform (i.e., for ) is represented by the matrix with respect to the bases and .
(Theorem 6.3 Theorem 3.2) Assume for contradiction that there exists a non-zero element
[TABLE]
such that . Let . Since , the complement of has cardinality . We can therefore find a subset of the complement of such that . Let . We then have since is in the complement of the support of , but is non-zero in . Hence is not invertible. Hence, by the previous remark, the matrix has determinant zero, which contradicts Chebotarev’s Theorem.
(Theorem 6.3 Theorem 3.2) Now assume that there exist subsets with and . This means that the linear map is not invertible. In particular, is not injective. Let be an element of such that . Then and is contained in the complement of the support of . Hence
[TABLE]
which contradicts the uncertainty principle. ∎
In this argument, we may replace with any other field containing a -primitive root of unity . So for any prime and for any field containing a -primitive root of unity , Theorem 6.3 with respect to the prime (i.e. the claim that each minor of the Vandermonde matrix is invertible) is equivalent to the uncertainty principle for the field with respect to , i.e., to the claim that .
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[AMS] E. F. Assmus, H. F. Mattson, and R. Turyn, Cyclic Codes, AF Cambridge Research Labs, Bedford, MA, Summary Sci. Rep. AFCRL (1966): 66-348.
- 2[B] S.D. Berman, Semisimple cyclic and Abelian codes. II., Cybernetics and Systems Analysis 3.3 (1967): 17-23.
- 3[BP] D.T. Brown and W.W. Peterson, Cyclic codes for error detection, Proceedings of the IRE 49 (1): 228–235. doi:10.1109/JRPROC.1961.287814
- 4[BSS] L. Babai, A. Shpilka, and D. Stefankovic, Locally testable cyclic codes, Information Theory, IEEE Transactions on 51.8 (2005): 2849-2858.
- 5[C] N. G. Chebotarev, Mathematical autobiography, Uspekhi Matematicheskikh Nauk 3.4 (1948): 3-66.
- 6[DS] D.L. Donoho and P.B. Stark, Uncertainty principles and signal recovery, SIAM J. Appl. Math 49 (1989): 906–931.
- 7[EI] R. J. Evans, I. M. Isaacs, Generalized Vandermonde determinants and roots of unity of prime order, Proceedings of the American Mathematical Society 58.1 (1976): 51-54.
- 8[F] P. E. Frenkel, Simple proof of Chebotarev’s theorem on roots of unity, ar Xiv:math/0312398 , (2003).
