Evolving the Structure of Evolution Strategies
Sander van Rijn, Hao Wang, Matthijs van Leeuwen, Thomas B\"ack

TL;DR
This paper introduces a modular framework for evolving the structure of evolution strategies, enabling the automatic discovery of effective algorithm configurations tailored to specific optimization problems.
Contribution
It presents a novel modular approach to generate and optimize evolution strategies using a self-adaptive genetic algorithm, outperforming existing CMA-ES variants.
Findings
Evolved ES structures outperform classical CMA-ES variants.
The modular framework effectively explores a large configuration space.
Results are consistent across different problem types and dimensions.
Abstract
Various variants of the well known Covariance Matrix Adaptation Evolution Strategy (CMA-ES) have been proposed recently, which improve the empirical performance of the original algorithm by structural modifications. However, in practice it is often unclear which variation is best suited to the specific optimization problem at hand. As one approach to tackle this issue, algorithmic mechanisms attached to CMA-ES variants are considered and extracted as functional \emph{modules}, allowing for combinations of them. This leads to a configuration space over ES structures, which enables the exploration of algorithm structures and paves the way toward novel algorithm generation. Specifically, eleven modules are incorporated in this framework with two or three alternative configurations for each module, resulting in algorithms. A self-adaptive Genetic Algorithm (GA) is used to…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
