Bounds on the Satisfiability Threshold for Power Law Distributed Random SAT
Tobias Friedrich, Anton Krohmer, Ralf Rothenberger, Thomas Sauerwald,, Andrew M. Sutton

TL;DR
This paper establishes bounds on the satisfiability threshold for random k-SAT instances with power law variable distributions, revealing a phase transition at a specific exponent value and extending understanding beyond uniform models.
Contribution
It introduces a rigorous analysis of random k-SAT with power law variable distributions, identifying a precise satisfiability threshold based on the distribution's exponent.
Findings
Threshold at (2k-1)/(k-1)
Instances are unsatisfiable w.h.p. below the threshold
Instances are satisfiable w.h.p. above the threshold
Abstract
Propositional satisfiability (SAT) is one of the most fundamental problems in computer science. The worst-case hardness of SAT lies at the core of computational complexity theory. The average-case analysis of SAT has triggered the development of sophisticated rigorous and non-rigorous techniques for analyzing random structures. Despite a long line of research and substantial progress, nearly all theoretical work on random SAT assumes a uniform distribution on the variables. In contrast, real-world instances often exhibit large fluctuations in variable occurrence. This can be modeled by a scale-free distribution of the variables, which results in distributions closer to industrial SAT instances. We study random k-SAT on n variables, clauses, and a power law distribution on the variable occurrences with exponent . We observe a satisfiability threshold atā¦
| power law distribution with exponentĀ |
uniform
dist. āāāāāā |
|||||||||
| 2.2 | 2.3 | 2.4 | 2.5 | 2.6 | 2.7 | 2.8 | 2.9 | |||
| 3 | 3.48 | 3.71 | 3.87 | 3.99 | 4.08 | 4.67 | ||||
| 4 | 7.87 | 8.42 | 8.78 | 9.04 | 9.23 | 9.37 | 10.23 | |||
| 5 | 16.27 | 17.75 | 18.64 | 19.21 | 19.61 | 19.90 | 20.11 | 21.33 | ||
| 7 | 67.21 | 75.74 | 79.81 | 82.09 | 83.49 | 84.42 | 85.07 | 85.54 | 87.88 | |
| 10 | 619.28 | 662.48 | 680.93 | 690.36 | 695.77 | 699.12 | 701.34 | 702.88 | 708.94 | |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Bounds on the Satisfiability Threshold for PowerĀ Law Distributed Random SAT
Tobias Friedrich
Hasso Plattner Institute, Potsdam, Germany
Anton Krohmer
Hasso Plattner Institute, Potsdam, Germany
Ralf Rothenberger
Hasso Plattner Institute, Potsdam, Germany
Thomas Sauerwald
University of Cambridge, Cambridge, United Kingdom
Andrew M. Sutton
Hasso Plattner Institute, Potsdam, Germany
Abstract
Propositional satisfiability (SAT) is one of the most fundamental problems in computer science. The worst-case hardness of SAT lies at the core of computational complexity theory. The average-case analysis of SAT has triggered the development of sophisticated rigorous and non-rigorous techniques for analyzing random structures.
Despite a long line of research and substantial progress, nearly all theoretical work on random SAT assumes a uniform distribution on the variables. In contrast, real-world instances often exhibit large fluctuations in variable occurrence. This can be modeled by a scale-free distribution of the variables, which results in distributions closer to industrial SAT instances.
We study random -SAT on Ā variables, Ā clauses, and a power law distribution on the variable occurrences with exponent . We observe a satisfiability threshold at . This threshold is tight in the sense that instances with for any constant are unsatisfiable with high probability (w.āh.āp.). For , the picture is reminiscent of the uniform case: instances are satisfiable w.āh.āp. Ā for sufficiently small constant clause-variable ratios ; they are unsatisfiable above a ratio that depends on .
1 Introduction
Satisfiability of propositional formulas (SAT) is one of the most researched problems in theoretical computer science. SAT is widely used to model practical problems such as bounded model checking, hardware and software verification, automated planning and scheduling, and circuit design. Even large industrial instances with millions of variables can often be solved very efficiently by modern SAT solvers. The structure of these industrial SAT instances appears to allow a much faster processing than the theoretical worst-case of this NP-complete problem. It is an open and widely discussed question which structural properties make a SAT instance easy to solve for modern SAT solvers.
Random SAT: For modeling typical inputs, we study random propositional formulas. In random satisfiability, we have a distribution over Boolean formulas in conjunctive normal form (CNF). The degree of a variable in a CNF formula is the number of disjunctive clauses in which that variable appears either positively or negatively. Two interesting properties of random models are its degree distribution and its satisfiability threshold. The degree distribution of a formulaĀ is the fraction of variables that occur more than times (negated or unnegated). A satisfiability threshold is a critical value around which the probability that a formula is satisfiable changes fromĀ [math] toĀ .
Uniform random SAT: In the classical uniform random model, the degree distribution is binomial. On uniform random -SAT, the satisfiability threshold conjectureĀ [1] asserts if is a formula drawn uniformly at random from the set of all -CNF formulas with variables and clauses, there exists a real number such that
[TABLE]
A well-known result of FriedgutĀ [22] establishes that the transition is sharp, even though its location is not known exactly for all values of (and may also depend on ). For , the critical threshold is Ā [14, 18, 23]. Recently, Coja-Oghlan and Panagiotou [16, 17] gave a sharp bound (up to lower order terms) with . Ding, Sly, and SunĀ [20] derive an exact representation of the threshold for all , where is a large enough constant. Explicit bounds also exist for low values of , e.g., Ā [24, 25, 19], and numerical estimates using the cavity method from statistical mechanicsĀ [29] suggest that .
Other random SAT models: In the regular random modelĀ [11], formulas are constructed at random, but the degree distribution is fixed: each literal appears exactly or times in the formula. Similarly, Bradonjic and PerkinsĀ [12] considered a random geometric -SAT model in which points are placed at random in . Each point corresponds to a unique literal, and clauses are formed by all -sets of literals that lie together within a ball of diameter . Again, this model has a binomial variable distribution.
Power law random SAT: Recently, there has been a paradigm shift when modeling real-world data. In many applications, it has been found that certain quantities do not cluster around a specific scale as suggested by a uniform distribution, but are rather inhomogeneousĀ [15, 30]. In particular, the degree distribution in complex networks often follows a power lawĀ [31]. This means that the fraction of vertices of degree is proportional to , where the constant depends on the network. To mathematically study the behavior of such networks, random graph models that generate a power law degree distribution have been proposedĀ [10, 27, 2, 32].
While there has been a large amount of research on power law random graphs in the past few yearsĀ [33], there is little previous work on power law SAT formulas. Nevertheless, the observation that quantities follow a power law in real-world data has also emerged in the context of SATĀ [11]. As all aforementioned random SAT models assume strongly concentrated degree distributions, it was conjectured that this property might be modeled well by random formulas with a power law degree distribution.
To address this conjecture, and to help close the gap between the structure of uniform random and industrial instances, Ansótegui, Bonet, and Levy [4] recently proposed a power-law random SAT model. This model has been studied experimentally [4, 5, 6, 7], and empirical investigations found that (1) indeed the constraint graphs of many families of industrial instances obey a power-law and (2) SAT solvers that are constructed to specialize on industrial instances perform better on power-law formulas than on uniform random formulas. To complement these experimental findings, we contribute with this paper the first theoretical results on this model.
Our results: We study random -SAT on variables and clauses. Each clause contains different, independently sampled variables. Each variable is chosen with non-uniform probability and negated with probability . A formal definition can be found in SectionĀ 2. We first study sufficient conditions under which the resulting -SAT instances are unsatisfiable. Assume a probability distributionĀ on the variables where is non-decreasing in . If the most frequent variables are sufficiently common, we prove in SectionĀ 3 the following statement: {restatable*}theoremstatethmunsat Let be a random -SAT formula with probability distributionĀ on the variables (c.f. DefinitionĀ 2.1), with and . If , then is w.āh.āp.Ā unsatisfiable.
Our focus are power law distributions with some exponentĀ . TheoremĀ 1 implies that power law random -SAT formulas with for an arbitrary constant are unsatisfiable with high probability111We say that an event holds w.āh.āp., if there exists a such that ., cf.Ā CorollaryĀ 3.1.
In SectionĀ 4 we show that something similar holds for the clause-variable ratio , i.e. power law random -SAT formulas with bigger than some constant are unsatisfiable with high probability. Although this already follows from basic observations, we derive a better bound on the value of the constant. {restatable*}theoremstatethmflip Let be a random -SAT formula with probability distributionĀ on the variables (c.f. DefinitionĀ 2.1), with and . With high probability, is unsatisfiable if
[TABLE]
In SectionĀ 5 we prove the following positive result, which complements our picture of the satisfiability landscape: {restatable*}theoremstatethmsat Let be a random -SAT formula whose variable probabilities follow a power law distribution (c.f. DefinitionĀ 2.2). If the power law exponent is for an arbitrary , is satisfiable with high probability if is a small enough constant.
Together our main theorems prove that random -SAT instances whose variables follow power law distributions do not only exhibit a phase transition for some clause-variable ratio , but also around the power law exponent . FigureĀ 1 contains an overview of our results. To prove these statements, we borrow tools developed for the uniform random SAT model. Note, however, that many of their common techniques like the differential equation method seem difficult to apply to non-uniform distributions; as removing a variable results in a more complex rescaling of the rest of the distribution. It is therefore crucial to perform careful operations on the formulas that leave the distribution of variables intact. To this end, we use techniques known from the analysis of power law random graphs.
Clause length: We focus on power law variable distributions but fix the length of every clause to . Power law models have also been proposed in which clause length is distributed by a power law as wellĀ [4, 5]. As long as there is a constant minimum clause length , our results can be extended to this case in the following way.
If the clause lengths are distributed as a power law, there will appear clauses of length , and all other clauses are of larger size. In that case, TheoremsĀ 1 andĀ 1 are directly applicable to the linear number of clauses with size (obtaining different hidden constants); and we have that the formula is satisfiable with high probability if and is a small enough constant. On the other hand, the formula is unsatisfiable with high probability, if . Consequently, the satisfiability of the formula does (asymptotically) not depend on the second power law.
2 Definition of the Model and Preliminaries
We analyze random -SAT on variables and clauses, where . The constant is called clause-variable ratio or constraint density. We denote by the Boolean variables. A clause is a disjunction of literals , where each literal assumes a (possibly negated) variable. Finally, a formula in conjunctive normal form is a conjunction of clauses . We conveniently interpret a clause both as a Boolean formula and as a set of literals. Following standard notation, we write to refer to the indicator of the variable corresponding to literal . We say that is satisfiable if there exists an assignment of variables such that the formula evaluates to .
Definition 2.1** (Random -SAT).**
Let be given, and consider any probability distribution on variables with . To construct a random SAT formula , we sample clauses independently at random. Each clause is sampled as follows:
Select variables independently at random from the distribution . Repeat until no variables coincide. 2. 2.
Negate each of the variables independently at random with probability .
Observe that by setting for all , we obtain again the uniform random SAT model. The probability to draw a specific clause is
[TABLE]
where denotes the set of cardinality- elements of the power set. The factor in the denominator comes from the different possibilities to negate variables. Note that is the probability of choosing a -clause that contains no variable more than once. To see that this probability is almost for most distributions, we apply the following result from [3].
Lemma 2.1** (Non-Uniform Birthday Paradox).**
Let be any probability distribution on items. Assume you sample items from . Let be the event that there is a collision, i.e.Ā that at least 2 of items are equal. Then,
[TABLE]
The probability that a sampled -clause thereby has collisions is at most ; so for and constant we obtain that the probability to draw a specific clause is
[TABLE]
Power law Distributions. In this paper, we are mostly concerned with distributions that follow a power law. To this end, we define two models: A general model to capture most power law distributions (which is harder to analyze), and a concrete model that gives us one instance of depending only on that can be used to compute precise leading constants. We use the general model to derive some asymptotic results; and the concrete model to compare with the uniform random SAT model and for the experiments.
Before we define these two models, let us establish the concept of a weight of a variableĀ . The weight gives us (roughly) the expected number of times the variable appears in the formula. That is,
[TABLE]
Thus, fixing the weights also fixes the probability distribution . It is important to distinguish between the initial distribution of variables and modified distributions that may arise as a result of stochastic considerations. For instance, the smallest-weight variable in a clause is clearly not distributed according to (except in -SAT). To avoid confusion, we identify a variable with its weight, as the weights stay fixed throughout the analysis. For convenience, we further assume w.āl.āo.āg. that the variables are ordered increasingly by weight, i.āe. for we have . Note that our definition of power law ensures that for , we have .
We are now ready to define the two models.
Definition 2.2** (General Power Law).**
Let the weights be given, and let be a weight selected uniformly at random. We say that follows a power law with exponent , if , , and for all it holds
[TABLE]
Whenever we need the explicit constants bounding the distribution function, we refer to them by as in
[TABLE]
We point out that DefinitionĀ 2.2 assumes a deterministic weight sequence; but it can be easily generalized to also support randomly generated weights.
For the concrete model, we define the weights as follows.
Definition 2.3** (Concrete Power Law).**
Given a power law exponent , we call the concrete power law sequence, if
[TABLE]
One can check that for these concrete weights, it holds , so in a sense, they are a canonical choice for producing a power law weight distribution.
To analyze power law distributions, we often make use of the following result of Bringmann, Keusch, and LenglerĀ [13, LemmaĀ B.1], which allows replacing sums by integrals.
Theorem 2.1** ([13]).**
Let be a continuously differentiable function, and let . Then, for any ,
[TABLE]
Using this theorem, the following corollary can be shown:
Corollary 2.1**.**
Let the variables be power law distributed with exponent , and define . Then, .
Proof.
Observe that . We apply TheoremĀ 2.1 to obtain
[TABLE]
In a similar fashion, one may show that . ā
Hence, and therefore . Finally, we denote by the random variable describing the weight of a SAT variable chosen according to a power law distribution , that is, , where denotes the indicator variable of the event. Note that this is not equivalent to , since there is a subtle difference in the two random processes: is a random variable drawn uniformly at random from , whereas is a random variable drawn from the same set, but with the non-uniform distribution . Hence, by CorollaryĀ 2.1,
[TABLE]
Using TheoremĀ 2.1, we can show that the probability to draw a certain clause is as given by EquationĀ (2.2) for DefinitionĀ 2.2 with exponent , since
[TABLE]
It remains to show that using a power law distribution in Definition 2.1 indeed results in a power law distribution of variable occurrences. Ansótegui et al. [5] provide a proof sketch for this fact, we prove it rigorously.
Theorem 2.2**.**
Let be a random -SAT formula that follows an arbitrary power law distribution with exponent (c.f. DefinitionĀ 2.2) and . Then, there are and , such that for all w.āh.āp. it holds that
[TABLE]
where is the number of variables that appear at least times in .
Proof.
Let be the number of appearances of or in . Observe that , since each variable can appear at most once in a clause. On the other hand, it holds , since this is the expected number of appearances of in a -SAT formula. Thus, since and by assumption, it holds that
[TABLE]
We first prove the statement for , where is some suitable constant. By applying Chernoff bounds, we can derive that w.āh.āp. all variables with appear fewer than times; and all variables with appear at least times. The requirement is needed so that the Chernoff bounds work, which might not be the case if is too close to or . Due to DefinitionĀ 2.2 and EquationĀ (2.7) this implies
[TABLE]
Now let us consider the case and let be random variables indicating if for . To show a lower bound on , we again look at variables with . For those it holds that
[TABLE]
again due to Chernoff Bounds. Also, by EquationĀ (2.7), it holds for variables with that . By the requirements on the weight distribution from DefinitionĀ 2.2 there are such variables. Therefore, it holds that
[TABLE]
for a suitable constant . Observe that if we condition on , i.āe. that appears at least times, this lowers the probability of all other variables to appear times, and vice versa. Thus, the random variables are negatively correlated and we may apply a Chernoff boundĀ [9, Theorem 1.16]. Since and , we obtain that w.āh.āp.
[TABLE]
To show an upper bound on we consider variables with of which there are due to DefinitionĀ 2.2. For these variables, by a Chernoff boundĀ [21] it holds that
[TABLE]
Now let be the number of variables with and . Thus, there exists a constant such that
[TABLE]
Due to negative association of the ās we can again use a Chernoff bound, yielding that w.āh.āp.,
[TABLE]
If is very small, for example , then we can use negative association to apply the Chernoff bound with to achieve EquationĀ (2.9) with high probability, since . Observe that . Furthermore, for variables with , we pessimistically assume . This gives us
[TABLE]
since for constant . ā
3 Small Power Law Exponents are Unsatisfiable
For small power law exponents, one can show that they result in formulas that are unsatisfiable (for large ) for all constant clause-variable ratios. The rationale behind this is that large variables with weight appear polynomially often together in a clause. For constant , they thus appear in all configurations (negated and non-negated), making the formula trivially unsatisfiable. TheoremĀ 1, already stated in the introduction, gives a sufficient condition on the variable distribution to make a random -SAT formula unsatisfiable. \statethmunsat
Proof.
Recall that is without loss of generality increasing in . Consider the largest variables . We call the event that clause consists of these variables. Then,
[TABLE]
Since each clause is drawn independently at random, we obtain by a Chernoff bound (see for example TheoremĀ 1.1 in [21]) that with high probability, the total number of clauses consisting of these variables is
[TABLE]
In other words, the number of clauses in which the largest variables appear together increases as a logarithm in . Since in each of these clauses, the literals appear negated or non-negated with constant probability , we have that all possible combinations of negated and non-negated literals appear in the formula with probability at least
[TABLE]
by the union bound. Since all combinations cannot be satisfied at once, the resulting formula is unsatisfiable. ā
By applying TheoremĀ 1 to a power law distribution on the variables, we obtain the following power law threshold for unsatisfiability.
Corollary 3.1**.**
Let be a random -SAT formula that follows an arbitrary power law distribution fulfilling DefinitionĀ 2.2. If the power law exponent is for an arbitrary , is unsatisfiable with high probability.
Proof.
Observe that from it follows for some constant . By setting we obtain that the largest variables all have weight Consequently, when ,
[TABLE]
and the statement follows from TheoremĀ 1. For the case where , one can show using TheoremĀ 2.1 that , and therefore . Again, the statement follows from TheoremĀ 1. ā
4 Large Clause-Variable Ratios are Unsatisfiable
It is a well-known result that random SAT on any probability distribution will result in unsatisfiable formulas if the clause-variable ratio is high. This follows from the probabilistic method: The expected number of assignments that satisfy a formula is . This is independent from the variable distribution as long as each variable is negated with probability . Hence, if the clause-variable ratio exceeds , the resulting formula will be unsatisfiable with high probability. This constant is rather large, however: In the case of this yields an upper bound on the clause-variable ratio of . For the concrete power law distribution in DefinitionĀ 2.3, the true threshold is much smaller. In fact, it appears to be below the satisfiability threshold for uniform random SAT.
Let us restate the main result, which will be proven with the Single Flip Method [26]. \statethmflipThe following is a corollary from this theorem:
Corollary 4.1**.**
Let be a random -SAT formula that follows DefinitionĀ 2.1 with , and . With high probability, is unsatisfiable if
[TABLE]
Proof.
We can upper-bound the left-hand side of the inequality as follows
[TABLE]
by applying the inequality of arithmetic and geometric means. Since is upper-bounding a probability, we can assume it to be at most . It now holds that
[TABLE]
since implies . By plugging this into the inequality from before and applying the inequality of arithmetic and geometric means again, we get
[TABLE]
For this is roughly
[TABLE]
Interestingly, the above corollary gives the same inequality as the Single-Flip Method for uniform random SATĀ [26]. This shows that the uniform distribution resembles a worst-case for this method; and all other distributions can only improve this bound.
If follows a power law distribution as in DefinitionĀ 2.3, we can derive the following theorem, which gives an upper bound independent of .
Theorem 4.1**.**
Let be a random -SAT formula with and that follows a power law distribution fulfilling DefinitionĀ 2.3. Let further be any constant. If the power law exponent is , then is w.āh.āp.Ā unsatisfiable if
[TABLE]
Proof.
We apply TheoremĀ 1. If follows a power law distribution as in DefinitionĀ 2.3, we can further simplify to
[TABLE]
using the inequality which holds for all . We upper bound the probabilities by choosing an integer and dividing the set of variables into buckets of equal size. For and we can estimate
[TABLE]
The last bucket is simply bounded by in the overall product. W.l.o.g. we assume that there are exactly variables in each bucket, as we could split the factor for into appropriate parts which both obey the upper bound on for bucket and respectively. We can now upper-bound by
[TABLE]
We are now interested in what happens to the expression in the exponent when tends to infinity. First, for . Second, by TheoremĀ 2.1 we have that whenever and whenever . Finally, for every constant we have that is also constant. Using we can thus simplify
[TABLE]
Plugging this into our inequality we get
[TABLE]
This establishes TheoremĀ 4.1. ā
The bound from this Theorem improves as . As this expression is rather terse, we also numerically determine in TableĀ 1 the smallest constant such that the formula is unsatisfiable. We compare these values to the upper bounds for uniform random SAT obtained from the Single-Flip Method.
In the remainder of this section, we show TheoremĀ 1 and TheoremĀ 4.1.
Definition 4.1** (Single-Flip Property).**
For a random formula a truth assignment has the single-flip property iff satisfies and every assignment obtained from by flipping exactly one zero to one does not satisfy .
Let be the number of truth assignments with the single-flip property for . As argued in [26], such an assignment exists if is satisfiable. From Markovās Inequality, we thus know
In the following, we derive a bound on . By LemmaĀ 2.1, the probability of choosing a clause is at most
[TABLE]
To bound the number of assignments with the single-flip property, we use the following result.
Lemma 4.1** ([26]).**
The expected number of assignments with the single-flip property is
[TABLE]
Proof.
Note that for a certain truth assignment , the probability of choosing a clause which is not satisfied by is . Therefore, the probability that is a satisfying assignment for is exactly . ā
We next bound the probability that a satisfying assignment has the single-flip property.
Lemma 4.2**.**
For a satisfying assignment it holds that
[TABLE]
Proof.
For a satisfying assignment to have the single-flip property, all assignments obtained by flipping a bit of must not satisfy . To fulfill this property for , we have to choose at least one clause which contains and other variables with appropriate signs so that does not satisfy the clause. Let denote the event that a clause is satisfied by , but not by . Then,
[TABLE]
since . The probability of choosing a clause not satisfied by under the condition that is satisfying is then
[TABLE]
as the probability of choosing a clause which is satisfied by any assignment is exactly . For a fixed assignment we conclude
[TABLE]
It remains to find the joint probability that all single-flipped assignments for with are not satisfying. We show this using a correlation inequality by Farr [28]. The sets of clauses which are not satisfied by the ās are pairwise disjoint as each clause in the set for has to contain , whereas each clause in the set for () can not contain . In the context of the correlation inequality from [28] we set , , iff the -th clause is satisfied by , but not by , and the āincreasingā collection of non-empty subsets of . The application of the Theorem then directly yields
[TABLE]
Combining LemmasĀ 4.1 andĀ 4.2 we get that the expected number of assignments with single-flip property is at most
[TABLE]
This establishes TheoremĀ 1.
5 Conditions for Satisfiability
In this section, we provide a complementary result to TheoremsĀ 1 andĀ 4.1 proving that if and the clause-variable ratio does not exceed some small constant, then a random -SAT formula with exponent is satisfiable with high probability. Let us first restate the main result: \statethmsatWe show this statement by constructing an algorithm that satisfies w.āh.āp.Ā if the clause-variable ratio is small. AlgorithmĀ 1 contains a formal description. The main idea is to shrink all clauses to size by selecting the literals with smallest weight in each clause; and then running any well-known (polynomial time) 2-SAT algorithm (e.āg.Ā [8]).
In the following, we seek to establish that AlgorithmĀ 1 will find a satisfying assignment (for small constraint densities) with high probability. To this end, we first analyze the probability distribution of a clause after it has been shrunk.
Lemma 5.1**.**
Let be the selected literals of an arbitrary clause in AlgorithmĀ 1. Then,
[TABLE]
Proof.
W.āl.āo.āg., we assume that . Then, by the definition of AlgorithmĀ 1. For the event to happen, all other literals in the clause must be of larger weight. By EquationsĀ (2.2) andĀ (2.6),
[TABLE]
The last statement holds since . ā
Having derived a bound on the probability distribution of a shrunk clause, it is possible to compute the probability that the resulting -SAT formula is satisfiable. We use that the clauses are sampled independently. To avoid confusion, we write and , whenever we talk about the shrunk formula and clauses. To upper bound the probability of not being satisfiable, we look at so-called bi-cycles in .
Definition 5.1**.**
A bi-cycle of length is a sequence of clauses of the form
[TABLE]
where are literals of distinct variables and .
Chvatal and ReedĀ [14, TheoremĀ 3] show that if the formula is unsatisfiable, it must contain a bi-cycle. Consequently, by upper bounding the probability that a bi-cycle appears, we immediately obtain an upper bound on the probability that and henceforth is unsatisfiable.
Theorem 5.1** ([14]).**
Let be any -SAT formula. If contains no bi-cycle, it is satisfiable.
Before we are able to prove the main Theorem, we need the following auxiliary Lemma.
Lemma 5.2**.**
Let for some . For all , there is a constant with
[TABLE]
Proof.
We begin by observing that the term on the left side of the equation is obviously monotone in : If (), then increasing (decreasing) increases the sum. Thus, instead of considering the true distribution function , we may consider the upper (lower) bound on , see EquationĀ (2.4). For the sake of brevity, we consider the distribution , where is chosen to be either if , or otherwise.
To estimate this sum, we arrange the elements of increasingly by weight, such that . This gives us
[TABLE]
We are now inductively estimating these sums, beginning with the innermost. Recall that . Let be a large enough constant. We establish the following induction hypothesis:
[TABLE]
Now we apply TheoremĀ 2.1 to prove the induction basis. For , we have
[TABLE]
as desired, since .
Now suppose the induction hypothesis holds for . For we get
[TABLE]
To bound the sum, we distinguish two cases. If , then
[TABLE]
For the integration, we need to make sure that the special case does not occur. By rearranging, one can see that this is only true for , however, our weights begin at .
We now bound the error term that appears from the integration limit . Note that we only need to consider the case where , otherwise the error term is smaller than and may simply be omitted.
Observe from EquationĀ (5.1) that . Further, by EquationĀ (2.4) we have that . Similarly,
[TABLE]
therefore . Therefore, we have
[TABLE]
Recall that we are in the case where the error term is positive; and that the exponent is negative. Substituting the above inequality, we obtain
[TABLE]
By inspecting the exponent , we observe that it is of order . In particular, once is a large enough constant, the exponent becomes negative. Therefore, we may conclude that
[TABLE]
where the constant is not dependent on the iteration . Thus, as was chosen large enough,
[TABLE]
Plugging this into inequalityĀ (5.1) proves the induction step.
Choosing and setting yields
[TABLE]
Since , we can choose an appropriate constant such that the statement holds. ā
We are now able to show TheoremĀ 1. As discussed above, we do this by upper bounding the probability that a bi-cycle appears in . To this end, we calculate the expected number of bi-cycles in , observe that it is , and apply Markovās inequality. This yields that w.āh.āp., and thus are satisfiable.
Proof of TheoremĀ 1.
We calculate the expected number of bi-cycles in . First, we fix a set of variables to appear in a bi-cycle. Let denote the random variable counting how many times a specific bi-cycle with the variables from appears in . Then
[TABLE]
The factor counts the possible positions of inĀ . By LemmaĀ 5.1,
[TABLE]
for some suitable constant . Now let denote the random variable counting how many times any bi-cycle with the variables from appears in . There are permutations of the variables; and combinations of literals on variables. Similarly, literals and have possible sign combinations. Thus,
[TABLE]
To estimate the sum, we upper bound for all sets up to a certain size , which we will determine later. We set and define as
[TABLE]
Now let denote the random variable counting the number of bi-cycles that appear in .
[TABLE]
Since by our assumption , we can apply LemmaĀ 5.2. Using , we obtain that the right-hand side is at most
[TABLE]
for some suitable constant . Since is a small enough constant we thus have . If , we are finished, since then
[TABLE]
Otherwise, if , we choose which ensures for all . For , equationĀ (5.6) sums up to at most
[TABLE]
where we substituted and . Since , the exponent is negative, and we thus have
[TABLE]
which proves the Theorem by Markovās inequality. ā
6 Discussion of the Results
In this work, we have shown that with high probability, a power law random -SAT formula is satisfiable, if and the clause-variable ratio is not too large; and that it is unsatisfiable if , or if the clause-variable ratio is too large. Here, we give a few observations following these results.
First, as explained in Section 1 our results translate directly to the model where clause lengths are power law distributed. This observation might help to explain a phenomenon that arose in [5]: The authors experimentally observed that a random-sat formula with double power law distribution (both variables and clause lengths are drawn from a power law) can be solved extremely fast by MiniSAT. Although the formula was of length , MiniSAT already gave an answer after seconds! Using our results, we are now able to provide a potential explanation for this phenomenon: Disregarding the double power law distribution, the smallest clause length occurring in their generated formulas is one. Thus, there will be clauses of length one and by TheoremĀ 1 the formula is likely unsatisfiable.
Second, we observe a sharp threshold in the sense of FriedgutĀ [22] (for small constraint densities ) for at the point . In contrast, it is unclear whether such a sharp threshold exists (and can be analytically derived) for fixed but variable . Considering however, that decades of research were dedicated to the same question in the uniform caseāan arguably simpler modelāit is unlikely that we obtain a satisfying answer any time soon; at least for all . As in the uniform model, however, it might be more tractable to get sharp thresholds for .
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Achlioptas et al. [2011] D. Achlioptas, A. Coja-Oghlan, and F. Ricci-Tersenghi. On the solution-space geometry of random constraint satisfaction problems. Random Structures & Algorithms , 38(3):251ā268, 2011.
- 2Aiello et al. [2001] W. Aiello, F. Chung, and L. Lu. A random graph model for power law graphs. Experimental Mathematics , 10(1):53ā66, 2001.
- 3Alistarh et al. [2015] D. Alistarh, T. Sauerwald, and M. VojnoviÄ. Lock-free algorithms under stochastic schedulers. In 34th Symp. Principles of Distributed Computing (PODC) , pages 251ā260, 2015.
- 4Ansótegui et al. [2009 a] C. Ansótegui, M. L. Bonet, and J. Levy. On the structure of industrial SAT instances. In 15th Intl. Conf. Principles and Practice of Constraint Programming (CP) , pages 127ā141, 2009 a.
- 5Ansótegui et al. [2009 b] C. Ansótegui, M. L. Bonet, and J. Levy. Towards industrial-like random SAT instances. In 21st Intl. Joint Conf. Artificial Intelligence (IJCAI) , pages 387ā392, 2009 b.
- 6Ansótegui et al. [2014] C. Ansótegui, M. L. Bonet, J. GirĆ”ldez-Cru, and J. Levy. The fractal dimension of SAT formulas. In 7th Intl. Joint Conf. Automated Reasoning (IJCAR) , pages 107ā121, 2014.
- 7Ansótegui et al. [2015] C. Ansótegui, M. L. Bonet, J. GirĆ”ldez-Cru, and J. Levy. On the classification of industrial SAT families. In 18th Intl. Conf. of the Catalan Association for Artificial Intelligence (CCIA) , pages 163ā172, 2015.
- 8Aspvall et al. [1979] B. Aspvall, M. F. Plass, and R. E. Tarjan. A linear-time algorithm for testing the truth of certain quantified boolean formulas. Information Processing Letters , 8(3):121ā123, 1979.
