Experimental performance of graph neural networks on random instances of max-cut

TL;DR

This paper evaluates the effectiveness of Graph Neural Networks in solving the max-cut problem on random regular graphs, comparing their performance with classical SDP and extremal optimization methods.

Contribution

It demonstrates that GNNs can achieve performance comparable to SDP relaxations on a fundamental combinatorial problem, providing new insights into machine learning approaches for optimization.

Findings

GNNs attain similar performance to Goemans-Williamson SDP.

Extremal optimization outperforms both GNNs and SDP.

Performance improves with larger and sparser graphs.

Abstract

This note explores the applicability of unsupervised machine learning techniques towards hard optimization problems on random inputs. In particular we consider Graph Neural Networks (GNNs) -- a class of neural networks designed to learn functions on graphs -- and we apply them to the max-cut problem on random regular graphs. We focus on the max-cut problem on random regular graphs because it is a fundamental problem that has been widely studied. In particular, even though there is no known explicit solution to compare the output of our algorithm to, we can leverage the known asymptotics of the optimal max-cut value in order to evaluate the performance of the GNNs. In order to put the performance of the GNNs in context, we compare it with the classical semidefinite relaxation approach by Goemans and Williamson~(SDP), and with extremal optimization, which is a local optimization heuristic from the statistical physics literature. The numerical results we obtain indicate that, surprisingly, Graph Neural Networks attain comparable performance to the Goemans and Williamson SDP. We also observe that extremal optimization consistently outperforms the other two methods. Furthermore, the performances of the three methods present similar patterns, that is, for sparser, and for larger graphs, the size of the found cuts are closer to the asymptotic optimal max-cut value.