Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimization

TL;DR

This paper demonstrates that a machine learning-enhanced Monte Carlo algorithm can outperform classical methods in solving complex combinatorial optimization problems, specifically in finding minimum energy configurations in 3D Ising spin glasses.

Contribution

The authors introduce a Global Annealing Monte Carlo algorithm that integrates machine learning for global moves, showing it surpasses traditional methods in robustness and performance without hyperparameter tuning.

Findings

Global Annealing outperforms Simulated Annealing in benchmarks.

The method is more robust than Population Annealing across problem sizes.

Local moves are essential for achieving optimal performance.

Abstract

Combinatorial optimization problems are central to both practical applications and the development of optimization methods. While classical and quantum algorithms have been refined over decades, machine learning--assisted approaches are comparatively recent and have not yet consistently outperformed simple, state-of-the-art classical methods. Here, we focus on a class of Quadratic Unconstrained Binary Optimization (QUBO) problems, specifically the challenge of finding minimum energy configurations in three-dimensional Ising spin glasses. We use a Global Annealing Monte Carlo algorithm that integrates standard local moves with global moves proposed via machine learning. We show that local moves play a crucial role in achieving optimal performance. Benchmarking against Simulated Annealing and Population Annealing, we demonstrate that Global Annealing not only surpasses the performance of Simulated Annealing but also exhibits greater robustness than Population Annealing, maintaining effectiveness across problem hardness and system size without hyperparameter tuning. These results provide clear and robust evidence that a machine learning--assisted optimization method can exceed the capabilities of classical state-of-the-art techniques in a combinatorial optimization setting.