DRLinSPH: An open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems

TL;DR

DRLinSPH is an open-source platform integrating deep reinforcement learning with SPH-based simulation to optimize fluid-structure interactions, demonstrated on diverse complex scenarios with promising results.

Contribution

This work introduces DRLinSPH, combining SPHinXsys and Tianshou for parallel DRL training in FSI problems, a novel integration for enhanced simulation and control.

Findings

Successfully applied to four FSI scenarios

Demonstrated accuracy, stability, and scalability

Potential to advance industrial FSI solutions

Abstract

Fluid-structure interaction (FSI) problems are characterized by strong nonlinearities arising from complex interactions between fluids and structures. These pose significant challenges for traditional control strategies in optimizing structural motion, often leading to suboptimal performance. In contrast, deep reinforcement learning (DRL), through agent interactions within numerical simulation environments and the approximation of control policies using deep neural networks (DNNs), has shown considerable promise in addressing high-dimensional FSI problems. Additionally, smoothed particle hydrodynamics (SPH) offers a flexible and efficient computational approach for modeling large deformations, fractures, and complex interface movements inherent in FSI, outperforming traditional grid-based methods. In this work, we present DRLinSPH, an open-source Python platform that integrates the SPH-based numerical environment provided by the open-source software SPHinXsys with the mature DRL platform Tianshou to enable parallel training for FSI problems. DRLinSPH has been successfully applied to four FSI scenarios: sloshing suppression using rigid and elastic baffles, optimization of wave energy capture through an oscillating wave surge converter (OWSC), and muscle-driven fish swimming in vortices. The results demonstrate the platform's accuracy, stability, and scalability, highlighting its potential to advance industrial solutions for complex FSI challenges.