
TL;DR
This paper establishes a spectral bound on hypergraph discrepancy using the maximum spectral value of a specific matrix, providing both theoretical insights and a polynomial-time coloring algorithm.
Contribution
Introduces a spectral bound on hypergraph discrepancy based on the maximum spectral value, along with an efficient coloring algorithm.
Findings
Discrepancy is bounded by $O(\sqrt{t} + \lambda)$ for $t$-regular hypergraphs.
Random $t$-regular hypergraphs have discrepancy $O(\sqrt{t})$ with high probability.
Provides a polynomial-time algorithm for hypergraph coloring with discrepancy guarantees.
Abstract
Let be a -regular hypergraph on vertices and edges. Let be the incidence matrix of and let us denote . We show that the discrepancy of is . As a corollary, this gives us that for every , the discrepancy of a random -regular hypergraph with vertices and edges is almost surely as grows. The proof also gives a polynomial time algorithm that takes a hypergraph as input and outputs a coloring with the above guarantee.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
A spectral bound on hypergraph discrepancy
Aditya Potukuchi Department of Computer Science, Rutgers University. [email protected]. Research supported in part by NSF grant CCF-1514164
Abstract
Let be a -regular hypergraph on vertices and edges. Let be the incidence matrix of and let us denote . We show that the discrepancy of is . As a corollary, this gives us that for every , the discrepancy of a random -regular hypergraph with vertices and edges is almost surely as grows. The proof also gives a polynomial time algorithm that takes a hypergraph as input and outputs a coloring with the above guarantee.
1 Introduction
The main aim of this paper is to give a spectral condition that is sufficient for the discrepancy of a regular hypergraph to be small. This is proved via the partial coloring approach while using some combinatorial properties of the hypergraph that are given by this spectral condition. This immediately implies, via an old proof technique of Kahn and Szemerédi, that for every , the discrepancy of a random -regular hypergraph on vertices and edges is almost surely . Previously, a result of this form was proved by Ezra and Lovett [EL15] who show that the discrepancy of a random -regular hypergraph on vertices and edges is almost surely as grows. More recently, Bansal and Meka [BM19] showed that for random -regular hypergraphs on vertices and edges, the discrepancy is almost surely provided . To state our result formally, we make some definitions.
Let be a hypergraph, with as the set of vertices, and as the set of (hyper)edges. Let , be the set of colorings of , and for , and , denote . The discrepancy of , denoted by is defined as:
[TABLE]
We call a hypergraph -regular if every vertex is present in exactly hyperedges. These will be the main focus of this paper. For a hypergraph , let be the incidence matrix of , i.e., has rows indexed by , columns indexed by , and entries are if and [math] otherwise. We will use to denote the Euclidean norm throughout the paper. Our main result is the following:
Theorem 1.1**.**
Let be a -regular hypergraph on vertices and edges with as its incidence and let . Then
[TABLE]
Moreover, there is an time algorithm that takes the hypergraph as input and outputs the coloring with the above guarantee.
1.1 Background
The study of hypergraph discrepancy, which seems to have been first defined in a paper of Beck [Bec81], has led to some very interesting results with diverse applications (see, for example [Mat99], [Cha00]). One of the most interesting open problems in discrepancy theory is what is commonly known as the Beck-Fiala conjecture, regarding the discrepancy of general -regular hypergraphs.
Conjecture 1.2** (Beck-Fiala conjecture).**
For a -regular hypergraph , we have
[TABLE]
Although this conjecture is usually stated for bounded degree hypergraphs (as opposed to regular ones), this is not really an issue. One can always add hyperedges containing just a single vertex and make it regular, which increases the discrepancy of the original hypergraph by at most one. Beck and Fiala [BF81] also proved that for any -regular hypergraph ,
[TABLE]
This is more commonly known as the Beck-Fiala theorem. Essentially the same proof can be done a bit more carefully to get a bound of (see [BH97]). Given Conjecture 1.2, it is perhaps surprising that the best upper bound, due to Bukh [Buk16], is “stuck at” for large enough .
It is possible that one of the reasons that the discrepancy upper bounds are so far away from the conjectured bound (assuming it’s true) is our inability to handle many ‘large’ hyperedges. Indeed, if one is offered the restriction that each hyperedge is also of size (regular and ‘almost uniform’), then a folklore argument using the Lovász Local Lemma shows that the discrepancy is bounded by . The proof of Theorem 1.1 also relies on being able to avoid dealing with large edges (which are few, if any, in number).
1.2 Discrepancy in random settings
Motivated by the long-standing open problem of bounding discrepancy of general -regular hypergraphs, Ezra and Lovett [EL15] initiated the study of discrepancy of random -regular hypergraphs. By random -regular hypergraph, we mean the hypergraph sampled by the following procedure: We fix vertices and (initially empty) hyperedges . Each vertex in chooses (distinct) hyperedges in uniformly and independently to be a part of. They showed that if , then the discrepancy of such a hypergraph is almost surely as grows. The proof idea is the following: First observe that most of the hyperedges have size . For the remaining large edges, one can delete one vertex from every hyperedge and make them pairwise disjoint. This allows one to apply a folklore Lovász Local Lemma based argument, but with a slight modification which makes sure that the large edges have discrepancy at most . More recently, Bansal and Meka [BM19] reduced the discrepancy bound to almost surely as long as for all and . A corollary of Theorem 1.1 states that one can get the bound of for every (not necessarily growing) as grows and . More formally,
Corollary 1.3**.**
There is an absolute constant such that the following holds: Let be a random -regular hypergraph on vertices and hyperedges where . Then,
[TABLE]
The theorem that implies Corollary 1.3 from Theorem 1.1 is the following:
Theorem 1.4**.**
Let be the incidence matrix of a random -regular set system on vertices, where , and edges. Then with probability at least ,
[TABLE]
A couple of remarks here: First, observe that it suffices to prove Theorem 1.4 for . Indeed, let and be random and random matrices (m ¿ n) respectively distributed by choosing random ’s in each column independently. Notice that the distribution of is exactly the same as that of the first columns of . Then, setting to be the matrix consisting of the first columns of , we observe that . Second, we point out that is just a limitation of the proof technique in [FKS89] (also see [BFSU98]) that we use to prove this theorem. Although we believe that Theorem 1.4 should hold for all , we do not make any attempt to verify this, especially since the result of Bansal and Meka [BM19] already takes care of the discrepancy of random hypergraphs in this case.
Although many variations of Theorem 1.4 are known and standard, one needs to verify it for our setting too. It should come as no surprise that the proof follows that of Kahn and Szemerédi’s 111[FKS89] is combination of two papers that prove the same result upto a constant factor: one by Friedman using the so-called trace method, and the other by Kahn and Szemerédi using a more combinatorial approach which is flexible enough to be easily adapted here. in [FKS89], which is postponed to the Appendix A.2.
1.3 The partial coloring approach
Most of the bounds and algorithms on hypergraph discrepancy proceed via a partial coloring approach. In general, a partial coloring approach [Bec81] works by coloring a fraction of the (still uncolored) vertices in each step, while ensuring that no edge has discrepancy more than the desired bound. Perhaps the most famous successful application of this is Spencer’s celebrated ‘six standard deviations’ result [Spe85], which gives a bound of for any hypergraph on vertices and edges. The original proof of Spencer was not algorithmic, i.e., it did not give an obvious way to take as input a hypergraph on vertices and edges, and efficiently output a coloring that achieves discrepancy . In fact, Alon and Spencer([AS00], ) suggested that such an algorithm is not possible. However, this was shown to be incorrect by Bansal [Ban10] who showed an efficient algorithm to do the same task. However, the analysis of this algorithm still relied on the (non-algorithmic) discrepancy bound of . Later, Lovett and Meka [LM15] gave a ‘truly constructive’ proof of the fact that the discrepancy is . This proof did not rely on any existing discrepancy bounds and the novel and simple analysis proved to be extremely influential. The proof of Theorem 1.1 will rely on a somewhat technical feature of the main partial coloring from this work. More recently, a result due to Rothvoss [Rot17] gives a simpler proof of the same bound, which is also constructive, and more general.
1.4 Proof sketch
The proof of Theorem 1.1 is proved via the aforementioned partial coloring approach. The main source of inspiration is a later paper of Spencer [Spe88], which computes the discrepancy of the projective plane (i.e., the hypergraph where the vertices are the points and the hyperedges are the lines of ) upto a constant factor. A more general bound was also obtained by Matoušek [Mat95], who upper bounds the discrepancy of set systems of bounded VC-dimension (note that the projective plane has VC-dimension ).
We also use the aforementioned result of Lovett and Meka [LM15] heavily, in particular, the partial coloring theorem. Informally, this says that one can ‘color’ roughtly an fraction of the hypergraph with real numbers in so that (1) at least half the vertices get colors or and (2) every edge has discrepancy . We now sketch the proof.
Consider the following ‘dream approach’ using partial coloring: In every step, one colors an fraction of vertices. Suppose that at the start, every edge has size and that each step of partial coloring colors exactly an fraction of the remaining uncolored vertices (i.e., these vertices are colored from ). Then the discrepancy of an edge is at most . Of course, this is too much to hope for, since some edges can potentially be large, and more importantly, there is no guarantee on how much of each edge gets colored in this partial coloring procedure.
This is precisely where the spectral condition on saves us. One can establish standard combinatorial ‘pseudorandomness’ properties of in terms of . In particular, if is small, then an fraction of take up an fraction of most edges. This means, intuitively, that in the partial coloring approach, if one colors an fraction of the vertices, then most of the edge sizes will have also reduced by an fraction. The partial coloring method of Lovett and Meka (and, curiously, none of the older ones) also allows one to color in such a way that edges can be made to have discrepancy zero in each step. This allows one to maintain that in every round of the partial coloring, the edges that don’t behave according to the ‘dream approach’, i.e., those that are too large (i.e., ) or don’t reduce by an fraction can be made to have discrepancy zero in the next step. Thus, most other edges reduce in size by an fraction. This lets one not have to deal with the discrepancy of these ‘bad’ edges until they become small.
2 Proof of Theorem 1.1
2.1 Preliminaries and notation
We will need the aforementioned partial coloring theorem due to Lovett and Meka:
Theorem 2.1** ([LM15]).**
Given a family of sets , a vector , positive real numbers such that , and a real number , there is a vector such that:
For all , .
- 2.
* for at least values of .*
Moreover, this vector can be found in time.
Lovett and Meka initially gave a randomized algorithm for the above. It has since been made deterministic [LRR17].
2.1.1 A technical remark:
The reason we use the Lovett-Meka partial coloring, as opposed to Beck’s partial coloring is not just the algorithmic aspect that the former offers, but also because it also offers the technical condition:
[TABLE]
This means one can set edges to have discrepancy [math]. To compare, we first state Beck’s partial coloring lemma (for reference, see [Mat99]):
Theorem 2.2** (Beck’s partial coloring lemma).**
Given a family of sets , and positive real numbers such that , where
[TABLE]
there is a vector such that:
For all , .
- 2.
* for at least values of .*
If one ignores the algorithmic aspect, Beck’s partial coloring, while assigning vertices to (instead of , thus making it a ‘partial coloring’ in the true sense) only guarantees that edges can be made to have discrepancy [math]. Although [LM15] did not really need this particular advantage, they do mention that this feature could potentially be useful elsewhere. This seemingly subtle advantage turns out to be crucial in the proof of Theorem 1.1, where we set edges (that will be called ‘bad’ and ‘dormant’ edges) to have discrepancy [math].
Henceforth, let and denote the vertices and edges of our hypergraph respectively. We will need a ‘pseudorandomness’ lemma that informally states that an fraction of vertices takes up around an fraction of most edges:
Lemma 2.3**.**
For any with where and a positive real number , there is a subset of size at most such that for every , we have , where .
Proof.
Consider a vector where for and otherwise. Clearly, and so
[TABLE]
On the other hand, , and so
[TABLE]
Putting (1) and (2) together, we get that there at most edges such that . ∎
Since this proof is via partial coloring, let us use to index the steps of the partial coloring. For a partial coloring , we call the set of vertices for which as uncolored. Let us use to denote the still uncolored vertices at step and for an edge , let us denote . In every step, we invoke Theorem 2.1 setting to get the partial coloring, so will have . Let 222In fact, we may assume w.l.o.g. that and so since in the other case, the Beck-Fiala Theorem gives us that the discrepancy is . However, this is not needed and the techniques here also handle this case with this minor change..
We call an edge dormant at step if . Let us call an edge bad in step if . Edges that are neither dormant not bad are called good. Finally, we say that is dead in step if .
Informally, the roles of these sets are as follows: In the partial coloring step , we ensure that an edge edges only get nonzero discrepancy if it is good, i.e., if is close to what is expected and is not too large. Even dead edges can be good or bad, and we will not distinguish them while coloring the vertices. However, in the analysis we will break the total discrepancy accumulated by into two parts: Before it is dead and after. The main point is to bound the discrepancy gained before it becomes dead. After it becomes dead, we simply bound the discrepancy incurred since by its remaining size, i.e., at most .
First, we make two easy observations:
Claim 2.4**.**
If , then at step , the number of dormant edges is at most .
Proof.
This is just Markov’s inequality, using the fact that the average edge size is . ∎
Claim 2.5**.**
If , then at step , the number of bad edges is at most .
Proof.
This is by setting and in Lemma 2.3. ∎
2.2 Partial coloring using Lemma 2.3
Proof of Theorem 1.1.
Setting , we proceed by partial coloring that colors exactly half the remaining uncolored vertices at each stage. For a step , suppose that . We will describe a partial coloring given by that colors half the vertices of .
For , let , and . Observe that the edges in for are either bad or dormant in steps . Also observe that for , Define constants as follows:
[TABLE]
Let and denote the bad and dormant edges respectively. We handle the edges in and separately. For edges in , we have:
[TABLE]
The second inequality above follows from Claim 2.4 and Claim 2.5. For the other case, we have
[TABLE]
Here we have used the fact that since the hypergraph is -regular, we have . Putting these together, we have
[TABLE]
Therefore, Theorem 2.1 guarantees that there is a fractional coloring such that
for at least half of .
- 2.
All the bad and dormant edges get discrepancy [math].
- 3.
A good and live edge gets discrepancy at most .
Finally, we pick an arbitrary subset of all the vertices such that of size exactly and round them to the nearest integer. It is easy to see that since every edge has size at most , this rounding, over all the steps of the partial coloring adds discrepancy of at most for every edge. This completes step of the partial coloring and we are left with uncolored vertices for the next step.
For an edge , let be a round where had incurred non-zero discrepancy and was not dead. Since only good edges incur nonzero discrepancy, . Since is also not dead at step , we must have that . This gives us that and therefore . So, if where , the total discrepancy incurred by at step without the rounding step is at most
[TABLE]
Here, we have used the fact that . If , the discrepancy incurred by at step without the rounding is at most
[TABLE]
Therefore, the discrepancy of an edge for until it becomes dead is at most
[TABLE]
Here we have used the fact that . Finally, rounding the color of every vertex to its nearest integer increases the discrepancy by at most . When the edge becomes dead, we simply bound its discrepancy by its size .
It remains to check that each of the stages of partial coloring can be done in time , and the constants take time to compute at each stage, thus establishing the algorithmic part. ∎
3 Conclusion
We have given an upper bound on -regular hypergraph discrepancy in terms of and a spectral property of the incidence matrix. However, when one restricts attention to random -regular hypergraphs, the bound is achieved only when . In the case where , one can replace in Theorem 1.1 by where
[TABLE]
and the proof would remain the same. This is because using the partial coloring theorem (Theorem 2.1), one may assign colors to all but at most vertices while maintaining that the discrepancy of every edge is [math]. However, when is a random regular hypergraph with vertices and edges, we need not have (in fact, the guess would be ). The problem is that Claim A.6 (In Appendix A.2) does not extend. However, in this regime, we believe that with high probability, the discrepancy is much lower than (in contrast to growing).
Recently, Franks and Saks [FS18] showed that for , the discrepancy is almost surely. Independently, Hoberg and Rothvoss [HR19] considered a different model of random hypergraphs with vertices and edges and each vertex-edge-incidence is an i.i.d. random variable. They show that if , the discrepancy is almost surely. Both [FS18] and [HR19] used similar Fourier analytic techniques inspired by [KLP12]. Moreover, it was an open question in [HR19] whether the hypergraph with i.i.d incidences where almost surely has discrepancy . This was shown to be true by the author [Pot18].
We argue that this is an interesting regime for random regular hypergraphs, as this kind of discrepancy bound is not implied by the Beck-Fiala conjecture. The case where , is of particular interest, since we believe there is a phase transition for constant discrepancy at this point. On the one hand, we do not know if the discrepancy bound given by Corollary 1.3 is the truth, and on the other hand, we do not know if random regular hypergraphs with, for example, almost surely has discrepancy . We conclude with a conjecture, building on an open problem (open problem ) in [FS18]:
Conjecture 3.1**.**
There is an absolute constant such that the following holds. Let be any integer and be a random -regular hypergraph on vertices and edges. Then with high probability,
[TABLE]
Acknowledgements
I would like to thank Jeff Kahn for suggesting the problem, Huseyin Acan and Cole Franks, and Shachar Lovett for the extremely helpful discussions, and the anonymous ICALP referees for the numerous comments on a previous version.
Appendix A Appendix
A.1 A martingale inequality
We will state a martingale inequality that we will use in the proof of Theorem 1.4. A sequence of random variables martingale with respect to another sequence of random variables such that for all , we have for some function , and .
A martingale is said to have the -bounded difference property if .
The variance of a martingale is the quantity:
[TABLE]
We get good large deviation inequalities for martingales with bounded differences and variances (see, for example, [CL06], Theorem 6.3 and Theorem 6.5). For a martingale with respect to , with the -bounded difference property and variance , we have
[TABLE]
A.2 Proof of Theorem 1.4
We shall now prove Theorem 1.4. Recall that we only need to prove the case where , As mentioned before, we adapt the proof technique of Kahn and Szemerédi for our random model (also see [BFSU98]). We have that the regularity is .
We shall prove that for every , and such that and , we have that . First, we ‘discretize’ our problem by restricting to belong to the -net
[TABLE]
and belonging to
[TABLE]
for a small enough constant .
Claim A.1** ([FKS89], Proposition 2.1)).**
If for every , and , we have that , then we have that for every such that , we have that .
Proof.
Let . We shall use the fact that there are , and such that , and . With this in mind, we have:
[TABLE]
Where . We note that each of the terms and , and are upper bounded by , and . Combining this, and using the fact that , we have
[TABLE]
∎
So now, will need to only union bound over . It is not hard to see that each of these has size at most for some absolute constant .
Indeed, we have:
[TABLE]
for some constant .
We split the pairs where , which we will call ‘large entries’ and write our quantity of interest:
[TABLE]
For the large entries: For a set of vertices and a set of edges , let us denote to be the number of vertex-edge incidences in and . Let us use .
Lemma A.2**.**
There is a constant such that, for every set of vertices and every set of hyperedges where , we have that with probability at least , and satisfy at least one of the following:
** 2. 2.
.
This lemma is sufficient to show that the large pairs do not contribute too much, as shown by the following lemma, which is the main part of the proof of Kahn and Szemerédi.
Lemma A.3** ([FKS89], Lemma 2.6, [BFSU98], Lemma 17).**
If the conditions given in Lemma A.2 are satisfied, then for all .
Notice that since we are bounding , which is much stronger than what we really need, it is okay to consider both and from .
Proof of Lemma A.2.
First, we observe that it is enough to consider , since otherwise, . Let denote the event that there is an of size and a of size which do not satisfy either of the conditions (with a fixd constant to be specified later) and . Before, we prove the lemma, let us make some observations, which (in hindsight) help us compute the probabilities much easier. Let be a set of vertices and be a collection of edges, such that .
The point here is that we basically want to evaluate the sum:
[TABLE]
The first observation is that every term in the second sum is small. Towards this, we have the straightforward claim.
Claim A.4**.**
For a set of vertices and edges and a set of possible incidences , we have that .
Proof.
W.L.O.G, let , and for , let . We have that:
[TABLE]
∎
Here, the first inequality uses the fact that . Therefore, we have:
[TABLE]
If and , this probability is at most . Thus
[TABLE]
It remains to deal with the sum . For these summands, we have that if and , then
[TABLE]
and so . The first inequality above comes from the observation that and so . Now, using that , we have that .
Therefore, we only need to evaluate the sum:
[TABLE]
We have used the fact that , and . Thus union bounding over many values of and , we have . ∎
For the small entries: Bounding the contribution from the small entries is much easier. The analysis given here is slightly different to the one given in [FKS89] and [BFSU98]. However, it does not make much of a difference, and is still, essentially, the same large deviation inequality. We will first compute the expected value of the quantity of interest using the following claim:
Claim A.5**.**
We have that:
[TABLE]
Proof.
Since , we have or
[TABLE]
To bound this, we note that
[TABLE]
which gives us what we want. ∎
Given Claim A.5 above, we can easily compute the expectation:
[TABLE]
Claim A.6**.**
We have that with high probability, .
Proof.
We set up a martingale and use the method of bounded variances. Let us write the quantity that we wish to estimate as
[TABLE]
We imagine being sampled one column at a time, and in each column, entries are sampled. For column , let us denote these by . Clearly, . Denote . For distinct , it is easy to see that we have the ‘Lipschitz property’:
[TABLE]
Therefore, we have a bounded difference property on as follows:
[TABLE]
We will use that the above quantity is bounded by since we only consider where . However, another way to upper bound the above is by using
[TABLE]
Using this, we now compute the variance of the martingale:
[TABLE]
Where the last inequality uses that . Therefore, the variance of the martingale is at most. This is because . Therefore, by the bounded variance martingale inequality (3), using :
[TABLE]
For a large enough constant , this lets us union bound over all , whose number can be bounded by .
∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[AS 00] Noga Alon and Joel H. Spencer. The probabilistic method, 2000.
- 2[Ban 10] Nikhil Bansal. Constructive algorithms for discrepancy minimization. In 51th Annual IEEE Symposium on Foundations of Computer Science, FOCS 2010, October 23-26, 2010, Las Vegas, Nevada, USA , pages 3–10, 2010.
- 3[Bec 81] József Beck. Roth’s estimate of the discrepancy of integer sequences is nearly sharp. Combinatorica , 1(4):319–325, 1981.
- 4[BF 81] József Beck and Tibor Fiala. ”integer-making” theorems. Discrete Applied Mathematics , 3(1):1–8, 1981.
- 5[BFSU 98] Andrei Z. Broder, Alan M. Frieze, Stephen Suen, and Eli Upfal. Optimal construction of edge-disjoint paths in random graphs. SIAM J. Comput. , 28(2):541–573, 1998.
- 6[BH 97] Debe Bednarchak and Martin Helm. A note on the beck-fiala theorem. Combinatorica , 17(1):147–149, Mar 1997.
- 7[BM 19] Nikhil Bansal and Raghu Meka. On the discrepancy of random low degree set systems. In Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2019, San Diego, California, USA, January 6-9, 2019 , pages 2557–2564, 2019.
- 8[Buk 16] Boris Bukh. An improvement of the beck-fiala theorem. Combinatorics, Probability and Computing , 25(3):380?398, 2016.
