MTRBO: Multiple trust-region based Bayesian optimization

TL;DR

MTRBO introduces a trust-region based Bayesian optimization approach that adaptively balances exploration and exploitation, improving efficiency and solution quality in high-dimensional black-box optimization tasks.

Contribution

The paper proposes a novel multiple trust-region Bayesian optimization method with proven convergence, outperforming existing algorithms on benchmark functions and real-world portfolio optimization.

Findings

Outperforms state-of-the-art trust-region BO algorithms on benchmark tests.

Achieves higher solution quality within limited sampling budgets.

Successfully applied to real-world portfolio optimization.

Abstract

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the objective function, and low sampling budget. To overcome these issues, this work proposes a multiple trust region-based Bayesian optimization technique(MTRBO). A trust region is a localized region within which an optimization model is trusted to approximate the objective function accurately. Assuming a Gaussian process (GP) as a prior belief about the objective function and based on the posterior mean and variance functions, the method adaptively exploits near the promising current solution inside a trust region. Also explores the most uncertain region in the search space inside another trust region. The theoretical global convergence property of the proposed method is established. Then the work is benchmarked against other state-of-the-art trust-region-based Bayesian optimization algorithms, demonstrating superior performance on a variety of non-convex and high-dimensional test functions. The proposed method outperforms others in terms of solution quality within the sampling budget (the number of function evaluations). The proposed method is applied to the portfolio optimization problem to verify its applicability in real-world scenarios.