Online Operator Design in Evolutionary Optimization for Flexible Job Shop Scheduling via Large Language Models

TL;DR

This paper introduces LLM4EO, a novel framework that uses Large Language Models to dynamically design and adapt operators in evolutionary algorithms, significantly improving their efficiency and effectiveness in flexible job shop scheduling.

Contribution

The work presents a new paradigm leveraging LLMs for online operator design and meta-evolution in EAs, enabling sustained adaptive optimization during evolution.

Findings

LLM4EO accelerates population evolution in scheduling problems.

LLM4EO outperforms traditional tailored evolutionary algorithms.

The framework demonstrates effective knowledge transfer and adaptive operator optimization.

Abstract

Customized static operator design has enabled widespread application of Evolutionary Algorithms (EAs), but their search effectiveness often deteriorates as evolutionary progresses. Dynamic operator configuration approaches attempt to alleviate this issue, but they typically rely on predefined operator structures and localized parameter control, lacking sustained adaptive optimization throughout evolution. To overcome these limitations, this work leverages Large Language Models (LLMs) to perceive evolutionary dynamics and enable operator-level meta-evolution. The proposed framework, LLMs for online operator design in Evolutionary Optimization, named LLM4EO, comprises three components: knowledge-transfer-based operator design, evolution perception and analysis, and adaptive operator evolution. Firstly, operators are initialized by leveraging LLMs to distill and transfer knowledge from well-established operators. Then, search behaviors and potential limitations of operators are analyzed by integrating fitness performance with evolutionary features, accompanied by suggestions for improvement. Upon stagnation of population evolution, an LLM-driven meta-operator dynamically optimizes gene selection of operators by prompt-guided improvement strategies. This approach achieves co-evolution of solutions and operators within a unified optimization framework, introducing a novel paradigm for enhancing the efficiency and adaptability of EAs. Finally, extensive experiments on multiple benchmarks of flexible job shop scheduling problem demonstrate that LLM4EO accelerates population evolution and outperforms tailored EAs.