Integrating Sample Inheritance into Bayesian Optimization for Evolutionary Robotics

TL;DR

This paper enhances evolutionary robotics by integrating sample inheritance with Bayesian optimization, improving controller learning efficiency and robustness across generations, especially under limited learning budgets.

Contribution

It introduces and evaluates two sample inheritance methods within Bayesian optimization for robot controller evolution, demonstrating their effectiveness in low-budget scenarios.

Findings

Reevaluation inheritance outperforms prior-based inheritance.

Inheritance benefits are greater for similar parent-offspring morphologies.

More challenging environments lead to more stable walking gaits.

Abstract

In evolutionary robotics, robot morphologies are designed automatically using evolutionary algorithms. This creates a body-brain optimization problem, where both morphology and control must be optimized together. A common approach is to include controller optimization for each morphology, but starting from scratch for every new body may require a high controller learning budget. We address this by using Bayesian optimization for controller optimization, exploiting its sample efficiency and strong exploration capabilities, and using sample inheritance as a form of Lamarckian inheritance. Under a deliberately low controller learning budget for each morphology, we investigate two types of sample inheritance: (1) transferring all the parent's samples to the offspring to be used as prior without evaluating them, and (2) reevaluating the parent's best samples on the offspring. Both are compared to a baseline without inheritance. Our results show that reevaluation performs best, with prior-based inheritance also outperforming no inheritance. Analysis reveals that while the learning budget is too low for a single morphology, generational inheritance compensates for this by accumulating learned adaptations across generations. Furthermore, inheritance mainly benefits offspring morphologies that are similar to their parents. Finally, we demonstrate the critical role of the environment, with more challenging environments resulting in more stable walking gaits. Our findings highlight that inheritance mechanisms can boost performance in evolutionary robotics without needing large learning budgets, offering an efficient path toward more capable robot design.