An Atypical Survey of Typical-Case Heuristic Algorithms
Lane A. Hemaspaandra, Ryan Williams

TL;DR
This paper reviews theoretical limits and practical explanations of heuristic algorithms' effectiveness on NP-hard problems, highlighting the balance between heuristic success and complexity-theoretic constraints.
Contribution
It provides a comprehensive survey of classical and recent results explaining the success and limitations of heuristics for NP-hard problems.
Findings
Heuristic algorithms are limited by complexity class separations.
Deterministic heuristics can achieve high correctness under plausible assumptions.
Theory helps explain heuristics' practical effectiveness on NP-hard problems.
Abstract
Heuristic approaches often do so well that they seem to pretty much always give the right answer. How close can heuristic algorithms get to always giving the right answer, without inducing seismic complexity-theoretic consequences? This article first discusses how a series of results by Berman, Buhrman, Hartmanis, Homer, Longpr\'{e}, Ogiwara, Sch\"{o}ening, and Watanabe, from the early 1970s through the early 1990s, explicitly or implicitly limited how well heuristic algorithms can do on NP-hard problems. In particular, many desirable levels of heuristic success cannot be obtained unless severe, highly unlikely complexity class collapses occur. Second, we survey work initiated by Goldreich and Wigderson, who showed how under plausible assumptions deterministic heuristics for randomized computation can achieve a very high frequency of correctness. Finally, we consider formal ways in…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComplexity and Algorithms in Graphs · Constraint Satisfaction and Optimization · Advanced Graph Theory Research
