$\mathsf{QMA}$ Lower Bounds for Approximate Counting
William Kretschmer

TL;DR
This paper establishes a lower bound on the query complexity of quantum Merlin-Arthur protocols for approximate counting, resolving an open problem and introducing Laurent polynomial techniques.
Contribution
It introduces a new Laurent polynomial method to derive quantum lower bounds for approximate counting problems, connecting query complexity with complexity class separations.
Findings
Proves a query complexity lower bound for QMA protocols in approximate counting.
Constructs an oracle separating SBP and QMA, resolving an open problem.
Demonstrates the utility of Laurent polynomials in quantum complexity lower bounds.
Abstract
We prove a query complexity lower bound for protocols that solve approximate counting: estimating the size of a set given a membership oracle. This gives rise to an oracle such that , resolving an open problem of Aaronson [2]. Our proof uses the polynomial method to derive a lower bound for the query complexity of the of two approximate counting instances. We use Laurent polynomials as a tool in our proof, showing that the "Laurent polynomial method" can be useful even for problems involving ordinary polynomials.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComplexity and Algorithms in Graphs · Quantum Computing Algorithms and Architecture · Markov Chains and Monte Carlo Methods
Lower Bounds for Approximate Counting
William Kretschmer University of Texas at Austin. Email: [email protected]. Supported by a Simons Investigator award.
Abstract
We prove a query complexity lower bound for protocols that solve approximate counting: estimating the size of a set given a membership oracle. This gives rise to an oracle such that , resolving an open problem of Aaronson [2]. Our proof uses the polynomial method to derive a lower bound for the query complexity of the of two approximate counting instances. We use Laurent polynomials as a tool in our proof, showing that the “Laurent polynomial method” can be useful even for problems involving ordinary polynomials.
1 Introduction
Among counting complexity classes, the complexity class captures approximate counting: estimating a function within a constant multiplicative factor. Despite having a definition in terms of counting complexity, is known to lie between two interactive proof classes. In particular, Bohler et. al. [4], who defined , showed that . Thus, under plausible derandomization assumptions [10], one would have .
In this work, we study the relation between and . The containment would follow trivially if collapses to , but it is unclear whether quantum Merlin makes proving this containment any easier. In the relativized world, Aaronson [2] recently asked whether there might exist an oracle relative to which . He noted that exhibiting such an oracle is equivalent to ruling out a black box protocol for approximate counting. We formally define the approximate counting problem as follows:
Problem 1**.**
The approximate counting problem is: given a membership oracle for a set promised that either (“no” instance) or (“yes” instance), determine which of these is the case.
More generally, one can consider the problem of distinguishing or where is an arbitrary constant, or may even depend on and . However, we restrict our attention to fixed because precisely captures approximate counting in the case where is the set of accepting paths of a nondeterministic polynomial-time Turing machine (and so is a function), is an function, and . Thus, an - oracle separation would follow if for some function , any protocol for requires either a -size witness, or else queries.
To prove such a lower bound, we study the query complexity of in the context of the complexity class , a quantum analogue of first defined by Kuperberg [8]. is in some sense the smallest “natural” complexity class that contains both and . Indeed, just as for any oracle , so is for any oracle .
Note that one cannot hope to prove a nontrivial query complexity lower bound for approximate counting, as the query complexity of is for any and . Instead, we use the observation that is not obviously closed under intersection111There even exists an oracle relative to which is not closed under intersection [7], and ’s closure or non-closure under intersection in the unrelativized world remains an open problem.. In this light, we consider the analogous intersection problem wherein we are given a pair of sets and asked to determine whether both sets have size at least , or whether one of the sets has size at most 222As a technicality, we typically assume that both sets satisfy the promise, though strictly speaking only the smaller set needs to satisfy the promise on a “no” instance of .. Because is closed under intersection, a protocol for that receives a witness of size and makes queries implies (via in-place amplification) the existance of an algorithm for that makes queries.
Our main result is that no such algorithm exists. Specifically, we show that any algorithm for requires queries. We also modify this argument to show that queries are necessary when . This in turn shows that any protocol for that receives a witness of size and makes queries must satisfy (or when ). Our proof uses the celebrated polynomial method of Beals et. al. [3]: for an algorithm that makes queries, we construct a bivariate polynomial of degree at most that equals the probability that the algorithm accepts on a random instance where and are of fixed size. We then show that if the algorithm is an algorithm that correctly solves , then any such polynomial must have large degree.
In our view, the proof of this degree lower bound (Theorem 11) is of independent mathematical interest. At a high level, from this polynomial , we take a parametric curve through the plane to construct a univariate Laurent polynomial of the same degree333A Laurent polynomial can contain both positive and negative integer powers of . Formally, we can write where and are ordinary polynomials. We follow the convention that the degree of a Laurent polynomial is . This is for consistency with the definition of degree for multivariate polynomials, as in the polynomial (i.e. viewing and as separate indeterminates).. Crucially, we leverage the symmetries of the problem to view this Laurent polynomial as an ordinary univariate polynomial of the same degree. Finally, we appeal to classical results in approximation theory to argue that this univariate polynomial must have large degree. We find this application of Laurent polynomials surprising, particularly because the recent result of Aaronson on the query complexity of approximate counting in the QSamples+queries model also used Laurent polynomials, albeit for an entirely different reason [2]. For Aaronson’s result, Laurent polynomials are fundamentally necessary just to describe the acceptance probability of the algorithm, while in our case ordinary polynomials suffice. This suggests that the “Laurent polynomial method” may prove to be useful even for problems involving ordinary polynomials.
2 Preliminaries
Though and can be defined in terms of counting complexity functions (as above), for our purposes it is easier to work with the following equivalent definitions (see Böhler et. al. [4]):
Definition 2**.**
The complexity class consists of the languages for which there exists a probabilistic polynomial time algorithm and a polynomial with the following properties:
If , then . 2. 2.
If , then .
The complexity class is defined analogously, wherein the classical algorithm is replaced with a quantum algorithm.
A classical (respectively, quantum) algorithm that satisfies the above promise for a particular language will be referred to as an (respectively, ) algorithm throughout this paper. Using this definition, a tight query complexity relation between protocols and algorithms follows from the procedure of Marriott and Watrous [9], which shows that one can exponentially improve the soundness and completeness errors of a protocol without increasing the witness size (see Aaronson [1] for a proof of the following lemma):
Lemma 3** (Guessing lemma).**
Suppose is a verifier for some problem and that makes queries to an oracle , receives an -qubit witness, and has soundness and completeness errors . Then there is an algorithm for the same problem that receives no witness and makes queries.
Because we study oracle intersection problems, it is often convenient to think of an algorithm as having access to two oracles, wherein the first bit in the oracle register selects the choice of oracle. As a consequence, we need a slight generalization of a now well-established fact in quantum complexity: that the acceptance probability of a quantum algorithm with an oracle can be expressed as a polynomial in the bits of the oracle string.
Lemma 4** (Symmetrization with two oracles).**
Suppose is a quantum algorithm that makes queries to a pair of oracles . Then there exists a bivariate real polynomial of degree at most such that:
[TABLE]
for all .
Proof.
We can equivalently view the oracles as strings in such that the algorithm makes queries to a single oracle which is the concatenation of the two oracles. Then, Lemma 4.2 of Beals et. al. [3] tells us that there exists a real polynomial of degree at most such that for any that is a string of variables. We then apply the symmetrization lemma of Minsky and Papert [11] to symmetrize , first with respect to , then with respect to :
[TABLE]
[TABLE]
∎
We now state some useful facts from approximation theory that will be useful in our proofs. We start with the Markov brothers’ inequality:
Lemma 5** (Markov).**
Let be a real polynomial of degree , and suppose that:
[TABLE]
Then for all , the derivative satisfies:
[TABLE]
This lemma has a useful consequence:
Corollary 6**.**
Let be a real polynomial of degree , and suppose that for all integers . If , then .
Proof.
Without loss of generality, we may scale by some constant and choose so that is the maximum absolute value of on . By the mean value theorem, there exists some such that . Applying the previous lemma, we find that:
[TABLE]
∎
Put another way, if a polynomial is bounded at all integers and has degree , then the polynomial satisfies a marginally weaker bound on all of . We might wonder whether we can still assume some nontrivial bound when is not so much smaller than . Indeed we can:
Lemma 7** (Coppersmith and Rivlin [6]).**
Let be a real polynomial of degree , and suppose that for all integers . Then there exist constants that do not depend on or such that for all , we have:
[TABLE]
We will also use a bound as stated by Paturi [12] that bounds a polynomial in terms of its degree and a bound on a nearby interval:
Lemma 8**.**
Let be a real polynomial of degree , and suppose that for all . Then for all with , we have:
[TABLE]
Setting and performing some computation gives rise to the following:
Corollary 9**.**
Let be a real polynomial of degree , and suppose that for all . If , then .
Finally, we state a useful fact about Laurent polynomials:
Lemma 10** (Symmetric Laurent polynomials).**
Let be a real Laurent polynomial of degree that satisfies . Then there exists a real polynomial of degree such that .
Proof.
implies that the coefficients of the and terms are equal for all , as otherwise would not equal the zero polynomial. Thus, we may write for some coefficients . So, it suffices to show that can be expressed as a polynomial in for all .
We prove by induction on . The case corresponds to constant polynomials. For , by the binomial theorem, observe that where is a degree real Laurent polynomial satisfying . By the induction assumption, can be expressed as a polynomial in , so we have is expressed as a polynomial in . ∎
3 Main Result
3.1 Lower Bound for
Our results hinge on the following theorem, which uses Laurent polynomials to prove a degree lower bound for bivariate polynomials that satisfy a particular set of bounds at points in the plane:
Theorem 11**.**
Let and be integers with . Let and be disjoint rectangles in the plane, and let . Let be a real polynomial of degree with the following properties:
. 2. 2.
* for all .*
Then .
We remark that gets this name because it looks like the letter “L”, albeit with the bottom left corner missing (see Figure 1, shaded regions). The proof idea is as follows. First, we argue that either , or else satisfies a marginally weaker bound on the rectangle by applying the Markov brothers’ inequality (via Corollary 6) to horizontal and vertical lines through . In the latter case, we show that taking an appropriate curve that passes through and the point gives rise to a univariate Laurent polynomial of degree . We use Lemma 10 for symmetric Laurent polynomials to reinterpret this as an ordinary polynomial of degree . We then show that is bounded on a large interval and grows quickly outside that interval, which implies (by Corollary 9) that has degree .
Proof of Theorem 11.
We assume that , as otherwise and the theorem holds trivially.
Let be an integer, and consider a horizontal line segment that passes through (see Figure 1, dotted horizontal lines). The restriction of to gives rise to a univariate polynomial of degree . By the assumed bounds on at lattice points in , for all integers . By the assumption , the interval has length at least . So, we may apply Corollary 6 to to conclude that either , or else for all .
Now, we use the bounds along the horizontal integer lines through to get bounds along vertical lines. Let (not necessarily an integer), and consider a vertical line segment that passes through . The restriction of to gives rise to a univariate polynomial of degree . The intersection of with the ’s gives a bound for all integers . So, we may apply Corollary 6 to to conclude that either , or else for all . Because every point in the rectangle lies on some , we conclude that for all .
Observe that if satisfies the statement of the theorem, then so does . This is because the constraints in the statement of the theorem are symmetric in and (in particular, because and are mirror images of one another along the line ; see Figure 1). As a result, we may assume without loss of generality that is symmetric, i.e. . Else, we may replace by because the set of polynomials that satisfy the inequalities in the statement of the theorem are closed under convex combinations.
Consider the parametric curve as it passes through (see Figure 1). We can view the restriction of to this curve as a Laurent polynomial of degree . The bound of on all of implies that when and that (see Figure 1). Moreover, the condition that is symmetric implies that .
By Lemma 10 for symmetric Laurent polynomials, can be viewed as a degree polynomial . Under the transformation , satisfies for and . Note that the length of the interval is because . By an appropriate affine transformation of , we can conclude from Corollary 9 with that . ∎
Theorem 11 implies an query complexity lower bound for :
Theorem 12**.**
Let be an algorithm for that makes queries to membership oracles and . Then .
Proof.
Since is an algorithm, we may suppose that accepts with probability at least on a “yes” instance and with probability at most on a “no” instance. Using Lemma 4, take to be the polynomial of degree at most that satisfies:
[TABLE]
Define . The conditions on the acceptance probability of for all that satisfy the promise imply that satisfies these corresponding conditions:
for all . 2. 2.
for all .
In particular, the polynomial satisfies the (weaker) conditions of Theorem 11, from which it follows that . ∎
We remark that even though we could assume over a large region, Theorem 11 only needed at a single point: . We view this as expressing the intuition that the acceptance probability of an algorithm “should” be increasing in and .
3.2 (Non)-Tightness of Lower Bound
In this section, we compare our query complexity lower bound for to known upper bounds. We find a gap between these bounds, particularly when is much larger than . This motivates an approach to improving our lower bounds for large . In Theorem 13, we prove that this approach indeed gives a better lower bound.
The best upper bound we know of for query complexity is , so our bound is at least tight when . The upper bound follows from the algorithm of Brassard, Høyer, and Tapp [5]. The upper bound is in fact an upper bound with the following algorithmic interpretation: first, guess items randomly from each of and . Then, verify using the membership oracle that the first items all belong to and that the latter items all belong to , accepting if and only if this is the case. This accepts with nonzero probability if and only if and .
Can the gap between the lower and upper bounds be improved? On the upper bound side, it is tempting to combine Grover search or Brassard-Høyer-Tapp approximate counting with the classical verification to get an algorithm, but this fails in general because both algorithms always have some nonzero chance of accepting when the number of marked items is nonzero. This suggests that perhaps the lower bound is not tight, at least when .
Looking for improvements on the lower bound side, careful observation reveals that the main bottleneck in the proof of Theorem 11 is the bound on the growth of polynomials bounded at equally spaced points (Corollary 6), which breaks down completely when the polynomial has degree . One might observe that we used Corollary 6 to bound on all of , even though we really just need a bound on at the points .
In fact, this leads to an approach for improving the lower bound, which we now describe. At a high level, we might hope to bound on by observing that the curve approaches the line as grows large. When is large enough, we can still conclude a bound on for using Corollary 6, and intuitively should be close to as . This intuition indeed works, and allows us to conclude an lower bound when . Our strategy for proving this improved lower bound is to show that if , then there exists some that depends only on such that whenever and . Then, the curve lies in this region whenever . It follows that the polynomial as in the proof of Theorem 11 satisfies for all and . So long as satisfies , the length of this interval is . This gives a contradiction: an appropriate affine transformation of satisfies the statement of Corollary 9 with but has degree . We conclude that .
Theorem 13**.**
Let , , , , and satisfy the statement of Theorem 11. If , then .
Proof.
Similar to the proof of Theorem 11, we first bound on horizontal lines through , but we can assume a better lower bound because is now assumed to be large. Exactly as before, we let be an integer, and we consider a horizontal line segment that passes through . The restriction of to gives rise to a univariate polynomial of degree . By the assumed bounds on at lattice points in , for all integers . But now, we can assume , and so Corollary 6 implies that either , or else for all .
This time, instead of using Corollary 6 to bound on vertical lines through , we start with the bound of Coppersmith and Rivlin (Lemma 7). As before, we let (not necessarily an integer), and we consider a vertical line segment that passes through . The restriction of to gives rise to a univariate polynomial of degree . The intersection of with the ’s gives a bound for all integers .
Suppose for a contradiction that . Then Lemma 7 implies that for all . From the Markov brothers’ inequality (Lemma 5), we can assume that the derivative satisfies for all . Because , then by basic calculus, there exists such that for all . In particular, whenever and .
Recall that it sufficed to show , or equivalently to get a contradiction from the assumption . Because , this follows from the assumption that . We conclude that . ∎
3.3 Lower Bound for
We now prove two results about complexity that follow from the lower bound of Theorem 12:
Corollary 14**.**
There exists an oracle and a pair of languages such that:
** 2. 2.
. 3. 3.
.
Proof.
For an arbitrary function and , define . Define the unary language . Observe that as long as satisfies the promise or for all , then . Intuitively, the oracles that satisfy this promise encode a pair of instances and for every where and .
Theorem 12 tells us that an algorithm that makes queries fails to solve on some pair that satisfies the promise. Thus, one can construct an such that and , by choosing so as to diagonalize against all algorithms.
Because is closed under intersection for any oracle , and because for any oracle , it must be the case that either or . ∎
We remark that this gives an alternative construction of an oracle relative to which is not closed under intersection. To our knowledge, this is the first that uses the polynomial method directly.
Using the guessing lemma (Lemma 3), we can also place an explicit lower bound on the complexity of :
Corollary 15**.**
Let be verifier for the with soundness and completeness errors . Suppose receives a witness of length and makes queries to a set membership oracle . Then .
Proof.
Running a constant number of times with fresh witnesses to reduce the soundness and completeness errors, one obtains a verifier with soundness and completeness errors that receives an -length witness and makes queries. Repeating twice with two oracles and computing the , one obtains a verifier for with soundness and completeness errors that receives an -length witness and makes queries. Applying the guessing lemma (Lemma 3) to , there exists an algorithm for that makes queries. Theorem 12 tells us that . ∎
Alternatively, one can conclude that . Furthermore, when , one can instead conclude that and therefore using Theorem 13 in place of Theorem 11 in the proof of Theorem 12.
4 Discussion and Open Problems
The lower bound for is not optimal in general: when , there is no protocol for that receives a constant size witness and makes a constant number of queries for large . Fundamentally, this shows that lower bounds cannot give optimal lower bounds. However, our bounds themselves are not tight: can one improve the gap between the lower bound and upper bound for the query complexity of ? From Theorem 13, we know that the complexity must eventually reach (at least when is exponentially large), so it seems reasonable to conjecture that the lower bound is not tight even for smaller values of . On the other hand, we have also not made a serious attempt to improve the trivial -query algorithm using Grover search (or similar techniques). Thus, it appears entirely possible that neither bound is tight, perhaps depending on .
At a deeper level, we would like to know if there is any meaningful connection between our use of Laurent polynomials and their use by Aaronson [2] in studying the QSamples+queries model. One way we might hope to establish such a connection is to extend our proof to an lower bound in the QSamples+queries model by proving an analogue of Theorem 11 for Laurent polynomials. We remark that the argument in Theorem 11 that turns a symmetric bivariate polynomial into a univariate Laurent polynomial works just as well if is a symmetric bivariate Laurent polynomial. Thus, essentially all that is needed is an analogue of Corollary 6 for Laurent polynomials bounded on a set of equally spaced points444A priori, it might appear that Theorem 11 also breaks down for large : as grows, the curve approaches , where any Laurent polynomial with negative degree terms is clearly unbounded. However, the part of the lower bound really only applies when , so for the ranges of that we care about, it is sufficient to look at over which ..
5 Acknowledgements
I would like to thank Thomas Watson for suggesting the intersection approach to proving an - oracle separation. I am also grateful to Scott Aaronson who supported this research, introduced me to this particular problem, and provided valuable guidance. I would also like to thank Robin Kothari, Justin Thaler, and Patrick Rall for their helpful feedback on this writing.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Scott Aaronson “Impossibility of Succinct Quantum Proofs for Collision-freeness” In Quantum Info. Comput. 12.1-2 Paramus, NJ: Rinton Press, Incorporated, 2012, pp. 21–28 URL: http://dl.acm.org/citation.cfm?id=2231036.2231039
- 2[2] Scott Aaronson “Quantum Lower Bound for Approximate Counting Via Laurent Polynomials”, 2018 URL: https://arxiv.org/abs/1808.02420
- 3[3] Robert Beals et al. “Quantum Lower Bounds by Polynomials” In J. ACM 48.4 ACM, 2001, pp. 778–797 DOI: 10.1145/502090.502097 · doi ↗
- 4[4] Elmar Böhler, Christian Glaßer and Daniel Meister “Error-bounded probabilistic computations between MA and AM” In Journal of Computer and System Sciences 72.6 , 2006, pp. 1043 –1076 DOI: 10.1016/j.jcss.2006.05.001 · doi ↗
- 5[5] Gilles Brassard, Peter Høyer and Alain Tapp “Quantum Counting” In Proceedings of the 25th International Colloquium on Automata, Languages and Programming , ICALP ’98 Berlin, Heidelberg: Springer-Verlag, 1998, pp. 820–831 URL: http://dl.acm.org/citation.cfm?id=646252.686013
- 6[6] Don Coppersmith and T. J. Rivlin “The Growth of Polynomials Bounded at Equally Spaced Points” In SIAM J. Math. Anal. 23.4 Philadelphia, PA, USA: Society for Industrial Applied Mathematics, 1992, pp. 970–983 DOI: 10.1137/0523054 · doi ↗
- 7[7] Mika Göös et al. “Rectangles Are Nonnegative Juntas” In Proceedings of the Forty-seventh Annual ACM Symposium on Theory of Computing , STOC ’15 Portland, Oregon, USA: ACM, 2015, pp. 257–266 DOI: 10.1145/2746539.2746596 · doi ↗
- 8[8] Greg Kuperberg “How Hard Is It to Approximate the Jones Polynomial?” In Theory of Computing 11.6 Theory of Computing, 2015, pp. 183–219 DOI: 10.4086/toc.2015.v 011a 006 · doi ↗
