Mixed variable structural optimization using mixed variable system Monte Carlo tree search formulation

TL;DR

This paper introduces MVSMCTS, a reinforcement learning-based optimization method for mixed variable structural problems, demonstrating efficiency and stability in practical engineering applications.

Contribution

The paper presents a novel mixed variable Monte Carlo tree search framework with update and acceleration techniques for structural optimization.

Findings

Effective in mixed variable structural optimization

Stable and efficient convergence to optimal solutions

Applicable to practical engineering problems

Abstract

A novel method called mixed variable system Monte Carlo tree search (MVSMCTS) formulation is presented for optimization problems considering various types of variables with single and mixed continuous-discrete system. This method utilizes a reinforcement learning algorithm with improved Monte Carlo tree search (IMCTS) formulation. For sizing and shape optimization of truss structures, the design variables are the cross-sectional areas of the members and the nodal coordinates of the joints. MVSMCTS incorporates update process and accelerating technique for continuous variable and combined scheme for single and mixed system. Update process indicates that once a solution is determined by MCTS with automatic mesh generation in continuous space, it is used as the initial solution for next search tree. The search region should be expanded from the mid-point, which is the design variable for initial state. Accelerating technique is developed by decreasing the range of search region and the width of search tree based on the number of meshes during update process. Combined scheme means that various types of variables are coupled in only one search tree. Through several examples, it is demonstrated that this framework is suitable for mixed variable structural optimization. Moreover, the agent can find optimal solution in a reasonable time, stably generates an optimal design, and is applicable for practical engineering problems.