A Python Extension for the Massively Parallel Multiphysics Simulation Framework waLBerla

TL;DR

This paper introduces a Python extension for the waLBerla HPC simulation framework, enhancing usability, automation, and real-time analysis capabilities for large-scale fluid simulations on complex geometries.

Contribution

The paper presents a novel Python interface for waLBerla that improves configuration, evaluation, and integration with other Python tools, surpassing previous text-file-based methods.

Findings

Python interface simplifies simulation setup and analysis

Performance remains high with Python integration

Enhanced flexibility and automation in simulation workflows

Abstract

We present a Python extension to the massively parallel HPC simulation toolkit waLBerla. waLBerla is a framework for stencil based algorithms operating on block-structured grids, with the main application field being fluid simulations in complex geometries using the lattice Boltzmann method. Careful performance engineering results in excellent node performance and good scalability to over 400,000 cores. To increase the usability and flexibility of the framework, a Python interface was developed. Python extensions are used at all stages of the simulation pipeline: They simplify and automate scenario setup, evaluation, and plotting. We show how our Python interface outperforms the existing text-file-based configuration mechanism, providing features like automatic nondimensionalization of physical quantities and handling of complex parameter dependencies. Furthermore, Python is used to process and evaluate results while the simulation is running, leading to smaller output files and the possibility to adjust parameters dependent on the current simulation state. C++ data structures are exported such that a seamless interfacing to other numerical Python libraries is possible. The expressive power of Python and the performance of C++ make development of efficient code with low time effort possible.