TL;DR
This paper introduces EoH-S, a method that uses large language models to evolve a set of complementary heuristics for automated heuristic design, significantly improving performance across diverse problem instances.
Contribution
It proposes a novel formulation for generating heuristic sets with LLMs and introduces EoH-S, which effectively evolves high-quality, complementary heuristics for diverse problem instances.
Findings
EoH-S outperforms existing methods on three AHD tasks.
Achieves up to 60% performance improvements.
Demonstrates effectiveness across various sizes and distributions.
Abstract
Automated Heuristic Design (AHD) using Large Language Models (LLMs) has achieved notable success in recent years. Despite the effectiveness of existing approaches, they only design a single heuristic to serve all problem instances, often inducing poor generalization across different distributions or settings. To address this issue, we propose Automated Heuristic Set Design (AHSD), a new formulation for LLM-driven AHD. The aim of AHSD is to automatically generate a small-sized complementary heuristic set to serve diverse problem instances, such that each problem instance could be optimized by at least one heuristic in this set. We show that the objective function of AHSD is monotone and supermodular. Then, we propose Evolution of Heuristic Set (EoH-S) to apply the AHSD formulation for LLM-driven AHD. With two novel mechanisms of complementary population management and complementary-aware…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
