Cascading CMA-ES Instances for Generating Input-diverse Solution Batches
Maria Laura Santoni, Christoph D\"urr, Carola Doerr, Mike Preuss, Elena Raponi

TL;DR
This paper introduces CMA-ES-DS, a novel method for generating diverse, high-quality solution batches in optimization problems by cascading tabu regions across parallel CMA-ES runs, outperforming existing approaches.
Contribution
The paper proposes a new cascading CMA-ES approach that effectively balances solution diversity and quality, addressing limitations of current algorithms in fixed-distance solution generation.
Findings
CMA-ES-DS outperforms random sampling and standard CMA-ES in generating diverse solution batches.
The method effectively maintains a minimum distance between solutions while optimizing for quality.
Empirical results demonstrate superior performance in diverse, high-quality solution generation.
Abstract
Rather than obtaining a single good solution for a given optimization problem, users often seek alternative design choices, because the best-found solution may perform poorly with respect to additional objectives or constraints that are difficult to capture into the modeling process. Aiming for batches of diverse solutions of high quality is often desirable, as it provides flexibility to accommodate post-hoc user preferences. At the same time, it is crucial that the quality of the best solution found is not compromised. One particular problem setting balancing high quality and diversity is fixing the required minimum distance between solutions while simultaneously obtaining the best possible fitness. Recent work by Santoni et al. [arXiv 2024] revealed that this setting is not well addressed by state-of-the-art algorithms, performing in par or worse than pure random sampling.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsExperimental Learning in Engineering
