PIT for depth-$4$ circuits and Sylvester-Gallai conjecture for polynomials
Alexey Milovanov

TL;DR
This paper explores extending Sylvester-Gallai-based techniques to develop deterministic polynomial-time blackbox identity testing algorithms for depth-4 circuits with bounded top fanin, achieving partial success and conditional results.
Contribution
It generalizes Sylvester-Gallai approach from depth-3 to depth-4 circuits, providing a conditional deterministic PIT algorithm and an unconditional algorithm for a subclass.
Findings
Conditional polynomial-time PIT algorithm for depth-4 circuits with bounded top fanin.
Unconditional polynomial-time algorithm for a specific subclass of depth-4 circuits.
Extension of Sylvester-Gallai theorem-based methods to higher circuit depths.
Abstract
This text is a development of a preprint of Ankit Gupta. We present an approach for devising a deterministic polynomial time blackbox identity testing (PIT) algorithm for depth- circuits with bounded top fanin. This approach is similar to Kayal-Shubhangi approach for depth- circuits. Kayal and Shubhangi based their algorithm on Sylvester-Gallai-type theorem about linear polynomials. We show how it is possible to generalize this approach to depth- circuits. However we failed to implement this plan completely. We succeeded to construct a polynomial time deterministic algorithm for depth- circuits with bounded top fanin and its correctness requires a hypothesis. Also we present a polynomial-time (unconditional) algorithm for some subclass of depth- circuits with bounded top fanin.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComplexity and Algorithms in Graphs · Machine Learning and Algorithms · VLSI and Analog Circuit Testing
PIT for depth- circuits and Sylvester-Gallai conjecture for polynomials
Alexey Milovanov
Abstract
This text is a development of preprint [11].
We present an approach for devising a deterministic polynomial time blackbox identity testing (PIT) algorithm for depth- circuits with bounded top fanin. This approach is similar to Kayal-Shubhangi [15] approach for depth- circuits. Kayal and Shubhangi based their algorithm on Sylvester-Gallai-type theorem about linear polynomials. We show how it is possible to generalize this approach to depth- circuits. However we failed to implement this plan completely. We succeeded to construct a polynomial time deterministic algorithm for depth- circuits with bounded top fanin and its correctness requires a hypothesis. Also we present a polynomial-time (unconditional) algorithm for some subclass of depth- circuits with bounded top fanin.
1 Introduction
Polynomial Identity Testing : In blackbox polynomial identity testing (PIT), given only query access to a hidden circuit, one has to determine if it outputs the zero polynomial. In whitebox PIT one has to solve the same problem with possibility to see a circuit.
This problem has numerous applications and has appeared in many fundamental results in complexity theory. Although this problem exhibits a trivial randomized algorithm, designing an efficient deterministic algorithm is one of the most challenging open problems. Strong equivalence results between derandomizing PIT and proving super-polynomial circuit lower bounds for explicit polynomials are known (cf. Chapter 4 of [19]).
Depth- Circuits : In a surprising result, Agrawal-Vinay [2] showed that a complete derandomization of PIT for just depth-4 () circuits implies an exponential lower bound for general circuits and a near complete derandomization of PIT for general circuits of poly-degree. Hence the problem of derandomizing PIT for such fanin restricted depth- circuits is equivalent to the general case.
There has been an incredibly large number of results for -circuits with diverse restrictions. A study for the case in which the bottom fan-in of such depth- circuits is at most ( circuits) was initiated by Dvir-Shpilka [6] (whitebox) and Karnin-Shpilka [14] (blackbox). A different study for the case with the restriction of bounded transcendence degree was initiated by Beecken et al. [5]. Recently, Agrawal et al. [1] reproved all these diverse results using a single unified technique based on the Jacobian criterion. In allmost all these results, the fanin of the top gate is assumed to be . For details see the survey by Shpilka-Yehudayoff [19] or the one by Saxena[18].
The Model : In this work we consider the model of circuits over , the field of complex numbers. We first define circuits. These are circuits having four alternating layers of and gates where the fanin of the top gate is . Such a circuit alternating layers of and gates where the fanin of the top gate is . Such a circuit computes a polynomial of the form
[TABLE]
where are the fanins of the gates at the second level. Define . A circuit is called simple if . The polynomial computed by a circuit has the same form as in (1) with added restriction that the degree of every is at most . As can have at most irreducible factors, we can factor while incurring a multiplicative factor of in . Hence, the polynomial computed by a circuit is of the form
[TABLE]
where gcd() is a product of polynomials of degree at most and are irreducible. Such a circuit is said to be homogenous if all are homogenous of the same degree (and therefore are also homogenous).
2 Results
To state the result we first need to introduce some notions from incidence geometry.
Sylvester-Gallai type problems
A well-known theorem in incidence geometry called the Sylvester-Gallai (SG) theorem states that : if there are distinct points on the real plane such that, for every pair of distinct points, the line through them also contains a third point, then they all lie on the same line. Over several decades, various variants of this result have been proved and are in general called Sylvester-Gallai type problems. Informally, in such problems, one is presented with a set of objects (points, hyperplanes, etc.) with a lot of “local” dependencies (e.g. two points are collinear with a third) and the goal is to translate these local restrictions to a global bound (usually on the dimension of the space spanned by the objects). Recently, in an impressive work by Barak et al.[3], a robust variant of the SG theorem was proved which among other things says that, even if for every point, the above stated restriction holds for a constant fraction of other points, one can still bound the dimension of the vector space spanned by the point set in by a constant. Few other lines of study for the SG type problems include
- •
replacing lines by higher dimensional vector spaces (initiated by Hansen),
- •
having multiple sets of (colored) points (initiated by Motzkin-Rabin),
- •
robust/fractional versions of the above (initiated by Barak et al.).
For an introduction to the SG theorem and its variants see the survey by Borwein-Moser [4]. One interesting feature of [3] is that the robust variant of SG theorem was motivated by a problem in theoretical computer science, in particular the study of (linear) Locally Correctable Codes. A common feature of all these variants is that they only consider flats/vector spaces/linear varieties. Ankit Gupta and the author propose a new line of SG theorems for non-linear polynomials. These problems arise very naturally in our approach for devising PIT algorithms for circuits.
The SG theorem can be restated in terms of polynomials as follows: let be distinct homogenous linear polynomials in s.t. for every pair of distinct , there is a distinct s.t. belongs to the ideal . Then dimension of the vector space spanned by all is at most .
The dimension of the vector space spanned by a set of linear polynomials is a special case of the general concept of transcendence degree of a set of polynomials . Polynomials are called algebraically independent if there is no non-zero polynomial such that . The transcendence degree is the maximal number of algebraically independent polynomials in the set.
Definition 1**.**
A simple homogenous circuit such that
[TABLE]
as stated in Equation (1) is SG if for every and
for every
the ideal contains .
Our motivation behind terming such circuits as SG comes from Dvir-Shpilka’s idea of using variants of the SG theorem for bounding the dimension of the vector space spanned by the linear forms occurring (at the third layer) in such circuits in the case the bottom fanin is at most , i.e., it is a circuit. They also conjectured that, if has characteristic [math] then, this dimension is bounded by a function of only . Indeed later, Kayal-Saraf [15] used a colored higher-dimensional variant of the SG theorem to prove this conjecture for . In spirit of Dvir-Shpilka [6] we conjecture that in such SG- circuits the transcendence degree of the set of is bounded by a function of , .
Conjecture 1**.**
Let be a circuit of the form (3). If is SG then for some function .
For the case this conjecture reduces to the case by the irreducibility of vector spaces and was first proved over in [15]. We are now ready to state our first result for PIT.
Theorem 1**.**
Given white-box access to a of degree , the identity test for can be decided deterministically in time for constant and if is not SG. Moreover, if Conjecture 1 holds then the same is true even if is SG.
Remark*.*
In [11] Ankit Gupta gives another definition of SG-circuit (he uses radical ideals instead of usual ideals). Our approach is in some sense better: we obtain a similar result as in [11] under a weaker conjecture.
Our second result is a proof of Conjecture 1 in a special case—Theorem 7 in Section 5. Also we obtain a full deradomization of PIT for some subclass of —Theorem 8 in Section 6.
3 Case -circuits
Here we present our idea of derandomization for -circuits, i.e., polynomials of the form , where every is a product of linear homogeneous polynomials
We can assume w.l.og. that , and are pairwise coprime. Indeed, if, say, then either and we can devide all by , or if does not divide then is not identiacally zero. If then and hence . Can we verify the last belonging effectively? The answer is “yes”. First, note that contains iff there exists such that because the ideal is prime. Now note that we can easily verified whether for every in polynomial time.
So, we can verify that contains for every and . Similar for and . Assume that we have verified all this and does not find contradictions with zero indentity of . Does this means that this polynomial is zero? No! A conter-example is , , .
However, the following result shows that in this case the dimension spanned by is at most . Hence, it is easy to determine the identity of the circuit by Schwartz-Zippel lemma.
Theorem 2**.**
If is a finite collection of two or more non-empty disjoint finite sets in an affine or in a projective complex space such that spans a subspace of at least dimension , then there exists a line cutting precisely two of the sets.
In fact the proof of Theorem 2 is closely follows the proof of Edelstein-Kelly theorem in [7]. We just use the following result of Kelly instead of Sylvester-Gallai theorem.
Theorem 3** ([16]).**
If a finite set of points in an affine or in a projective complex space is not a subset of a plane, then there exists a line in that space containing precisely two of the points.
Proof of Theorem 2.
First note that a pencil of lines in an affine or a projective -space, not all in the same -dimensional plane must contain a pair of lines such that the plane defined by these lines contains none of the other lines. This follows at once if we consider a section of the pencil by a -dimensional plane and appeal to Theorem 3 in the -dimensional plane of the section. We call this fact Motzkin’s observation since he observed it for in [17].
We now choose a pair of points and of where and are from different . The points of define a pencil of -dimensional planes with line as axis. A section of this pencil by a properly chosen -space defines a pencil of lines in that -space not all in a plane. (Indeed, since points of do not belongs to any -space there exist points such that the vectors , , , , are linearly independent. The -space is suitable for us.) By the Motzkin’s observation, two of the lines of this pencil define a -plane free of any of the other lines of the pencil. This plane together with the points and spans a -space such that the points of in this -space are on precisely two -planes of the original pencil of -planes. Each of these planes contains at least one point of .
Now it is easy to check that if a collection of two or more finite non-empty and disjoint sets in a -dimensional space lie on two planes and not on one, then there is a line intersecting precisely two of the sets. Indeed, denote these planes as and . If there exist two points from from different sets then the lines that connect these points is what we want. Else we consider any line that connects some point from and or . ∎
4 General case -circuits
Now we will try to use the same idea for general -circuits. To simplify notation we consider -circuits. So, we consider the circuits of the form , where is a product of linear or quadratic (irredicuble) homogenuos polynomials . We can assume that , and are pairwise coprime by the same reasons as before. Again, we want to verify whether . However, it is not as simple as in the previous section. Membership of does not mean that there exists such that . We use the following analogue of this statement.
Theorem 4** ([12]).**
Let be homogenous polynomials of degree at most .
Assume that .
Then there exist , where such that the polynomial .
The proof of this theorem was given by Hailong Dao at MathOverflow [12]. We present it here for the convenience of the reader.
Proof.
The point is that many invariants of the ideal can be bounded depending only on and :
Theorem 5** ([8, Proposition 4.6], [10], [9], [13]).**
There exists a primary decomposition of such that each of the is -primary and the number of generators of as well as degrees and itself are bounded by some function of and . 2. 2.
If is -primary then the minimal such that is upper bounded by some function from and .
By the first item of this theorem the problem reduces to the case when is -primary. By the second item there is such that , and this number is also bounded by the degrees and number of generators of . Remove all the that is not in . The product of the rest is still in because is a primary ideal. If there are at most elements remaining, we are done. If not, then choose of them, the product is in . ∎
By this theorem it is simple to recognize membership of in by a polynomial time-bounded algorithm that proves the first part of Theorem 1. The second part of this theorem follows from the following result.
Theorem 6** ([5]).**
Let be an -variate circuit. Let be -sparse, -degree, -variate polynomials with trdeg . Suppose we have oracle access to the -variate -degree circuit There is a blackbox time test to check over .
Proof of Theorem 1.
We claim that there exists an algorithm verifying that a given -circuit is SG. Indeed, let be a circuit of the form (3). We need to verify that belongs to ideal for every and for every (note that there are only such conditions for constant ). By Theorem 4 belongs to iff there exists such that where . So there are only such conditions for constant and . One such condition can be verifiyed in polynomial time (here it is crucial that all these polynomials are homogeneous). Indeed, a homogeneous polynomial of degree belongs to , where are homogeneous polynomial of degree if and only if there exists homogeneous polynomials of degree such that . Hence, to verify that we need to solve a system of linear equations.
Now assume we are given a SG -circuit (if a circuit is not SG then it is not identically zero). If Conjecture 1 holds then the trdeg of this circuit is constant. Then by Theorem 6 there exists a polynomial (in and ) algorithm solving PIT for this circuit. ∎
5 Proof of Conjecture 1 in a special case
We do not know the correctness of Conjecture 1 even for circuits. For this reason we consider a simple subclass of such circuits. Namely, we consider circuits with the following property: all ideals for different and and for quadratic , are prime. Also, we need that not all quadratic polynomials have the same index .
Theorem 7**.**
Conjecture 1 holds for such circuits.
Proof.
Denote the set of quadratic polynomials as . First, we prove that even the dimension of is bounded by a constant. Indeed, a quadratic polynomial belongs to where , iff is a linear combination of and . Besides, every such ideal where and must contain a quadratic polynomial where since the ideal is prime. Hence is at most by Theorem 2. Here, it is important that is prime and not all quadratic polynomials have the same index .
Consider an ideal of the form where and are linear. Recall, that this ideal is prime. Denote by the set of all such that there exists with such that the ideal contains some quadratic with .
Lemma 1**.**
The dimension of is at most .
Proof of Lemma 1.
A quadratic homogeneous polynomial over is irreducible iff . Here, is the rank of as a quadratic form. Indeed, if then it is obvious that is not irreducible. To prove that in other cases is irreducible it is enough to show that the polynomial is irreducible and this is folklor. So, all elements of have rank at least . 2. 2.
Denote by the subset of all elements of such that there exist , , and with s. t. . Of course the dimension of is at most as the dimension of . 3. 3.
Consider some , and such that contains . This means that the intersection of quadric with line is a quadric with rank at most . Therefore, . Combining this result with the first item we conclude that for every . 4. 4.
Consider the largest linear independent subset in . Denote this set as . We will show that . This give us what we want. 5. 5.
Add new such that is a basis of the linear form from . Consider the (symmetric) matrices of all quadratics from in the dual basis of . 6. 6.
The rank of every is equal to . Hence, there exist numbers of rows such that other rows are linearly depend from these in every matrix . The same is true for columns since these matrices are symmetric. 7. 7.
For every the exists such that is a quadratic form of rank . Hence, for every there exists a matrix such that matrix obtained from by deleting the th row and the th column has rank . But from 6, it follows that there are at most such numbers . Therefore .
∎
Add to the set the polynomials that are linear combinations of . Lemma 1 shows that the dimension of is not greater than . We need to prove that the dimension of the span of the remaning linear polynomials is also bounded by a constant. Denote the set of such polynomials by . The elements of have the following property. If and with then there exist such that and is a linear combination of and . Note that we can not say that if and then there exists that is a linear combination of and , so we can not apply Theorem 2 directly. However the idea of the proof of Theorem 2 works.
We claim that dim. Together with dim this implis that trdeg of all polynomials is less than (this proves the theorem).
Assume that dim. Devide in three sets , and in a natural way (in accordance with indexes of ). As in the proof of Theorem 2, take and . Again we consider the pencil of -dimensional planes with line as axis. Since dim, there exist such that , , and are linear independent and there are no points from in subspace . As in the proof of Theorem 2 we can conclude that there exist points , such that in the 3-space plane generated by , , and all points from belong to two -spaces and .
If and are from different then we get a contradict (there are no another points from at line ). Otherwise, all points in 3-space belong to one . Then we get a contradiction considering line or . ∎
6 Derandomization of PIT for some subclass of circuits
In Theorem 7 we have the strange condition that not all quadratic polynomials have the same index . To cover this case we present an algorithm solving PIT for such circuits.
More precisely, we consider -circuits of the form , where and are products of homogenous linear polynomials and is a product of homogeneous quadratic and linear polynomials.
Theorem 8**.**
There exists a polynomial-time algorithm solving PIT for such circuits.
Proof.
Let for (here are linear polynomials ) and (here are irredicable quadratic and are linear polynomials). We assume that (otherwise we can just use results of Section 3).
We can assume that . Then implies . Since is a product of linear polynomials, must be factorized. Hence (see the proof of Lemma 1), the rank of . The polynomial must be factorized for all linear polynomials from and (otherwise ). This implies that the dimension of linear forms spanned by polynomials from and is at most .
In other words and depends only on variables (after linear changing or variables). If depends another variables, then a given circuit is not identically zero. Otherwise, trdeg of all and is not greater than . Hence, by Theorem 6 there exists a polynomial-time algorithm for such circuits.
∎
Acknowledgments
I would like to thank Hailong Dao for useful discussions and Bruno Bauwens for help in writing this paper.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Manindra Agrawal, Chandan Saha, Ramprasad Saptharishi, and Nitin Saxena. Jacobian hits circuits: hitting-sets, lower bounds for depth- d 𝑑 d occur- k 𝑘 k formulas & depth- 3 3 3 transcendence degree- k 𝑘 k circuits. In Proceedings of ACM Symposium on Theory of Computing (STOC), pages 599–614, 2012.
- 2[2] Manindra Agrawal and V. Vinay. Arithmetic circuits: A chasm at depth four. In Proceedings of IEEE Foundations of Computer Science (FOCS), pages 67–75, 2008.
- 3[3] Boaz Barak, Zeev Dvir, Avi Wigderson, and Amir Yehudayoff. Fractional sylvester–gallai theorems. Proceedings of the National Academy of Sciences , 110(48):19213–19219, 2013.
- 4[4] Peter Borwein and William OJ Moser. A survey of sylvester’s problem and its generalizations. Aequationes Mathematicae , 40(1):111–135, 1990.
- 5[5] Malte Beecken, Johannes Mittmann, and Nitin Saxena. Algebraic independence and blackbox identity testing. Information and Computation , 222:2–19, 2013.
- 6[6] Zeev Dvir and Amir Shpilka. Locally decodable codes with 2 queries and polynomial identity testing for depth 3 circuits. SIAM Journal on Computing , 36(5):1404–1434, 2006.
- 7[7] M. Edelstein and L. M. Kelly, Bisecants of finite collections of sets in linear space , Canadanian Journal of Mathematics, 18:375–380, 1966, https://cms.math.ca/10.4153/CJM-1966-039-2
- 8[8] Daniel Erman, Steven V Sam and Andrew Snowden, Generalizations of Stillman’s conjecture via twisted commutative algebras https://arxiv.org/abs/1804.09807
