Bridging the Gap Between Theory and Practice: Benchmarking Transfer Evolutionary Optimization

TL;DR

This paper introduces a new benchmark suite for Transfer Evolutionary Optimization, focusing on real-world relevant problems characterized by volume, variety, and velocity, to better evaluate and develop practical algorithms.

Contribution

It pioneers a practical benchmark suite for TrEO that incorporates real-world problem aspects, addressing limitations of synthetic benchmarks and aiding future algorithm development.

Findings

Existing benchmarks lack real-world relevance.

The new suite covers diverse problem dimensions.

It enables comprehensive evaluation of TrEO algorithms.

Abstract

In recent years, the field of Transfer Evolutionary Optimization (TrEO) has witnessed substantial growth, fueled by the realization of its profound impact on solving complex problems. Numerous algorithms have emerged to address the challenges posed by transferring knowledge between tasks. However, the recently highlighted ``no free lunch theorem'' in transfer optimization clarifies that no single algorithm reigns supreme across diverse problem types. This paper addresses this conundrum by adopting a benchmarking approach to evaluate the performance of various TrEO algorithms in realistic scenarios. Despite the growing methodological focus on transfer optimization, existing benchmark problems often fall short due to inadequate design, predominantly featuring synthetic problems that lack real-world relevance. This paper pioneers a practical TrEO benchmark suite, integrating problems from the literature categorized based on the three essential aspects of Big Source Task-Instances: volume, variety, and velocity. Our primary objective is to provide a comprehensive analysis of existing TrEO algorithms and pave the way for the development of new approaches to tackle practical challenges. By introducing realistic benchmarks that embody the three dimensions of volume, variety, and velocity, we aim to foster a deeper understanding of algorithmic performance in the face of diverse and complex transfer scenarios. This benchmark suite is poised to serve as a valuable resource for researchers, facilitating the refinement and advancement of TrEO algorithms in the pursuit of solving real-world problems.