Modern, Efficient, and Differentiable Transport Equation Models using JAX: Applications to Population Balance Equations

TL;DR

This paper presents a modern, efficient, and fully differentiable transport equation solver using JAX, significantly accelerating population balance equation simulations and enabling scalable integration with neural networks for physics discovery.

Contribution

It introduces a JAX-based implementation of PBE models that is both highly efficient and differentiable, facilitating faster simulations and scalable neural network integration.

Findings

Achieves up to 300x speedup over traditional software.

Demonstrates 40x faster differentiability for large models.

Enables scalable physics discovery through neural network integration.

Abstract

Population balance equation (PBE) models have potential to automate many engineering processes with far-reaching implications. In the pharmaceutical sector, crystallization model-based design can contribute to shortening excessive drug development timelines. Even so, two major barriers, typical of most transport equations, not just PBEs, have limited this potential. Notably, the time taken to compute a solution to these models with representative accuracy is frequently limiting. Likewise, the model construction process is often tedious and wastes valuable time, owing to the reliance on human expertise to guess constituent models from empirical data. Hybrid models promise to overcome both barriers through tight integration of neural networks with physical PBE models. Towards eliminating experimental guesswork, hybrid models facilitate determining physical relationships from data, also known as 'discovering physics'. Here, we aim to prepare for planned Scientific Machine Learning (SciML) integration through a contemporary implementation of an existing PBE algorithm, one with computational efficiency and differentiability at the forefront. To accomplish this, we utilized JAX, a cutting-edge library for accelerated computing. We showcase the speed benefits of this modern take on PBE modelling by benchmarking our solver to others we prepared using older, more widespread software. Primarily among these software tools is the ubiquitous NumPy, where we show JAX achieves up to 300x relative acceleration in PBE simulations. Our solver is also fully differentiable, which we demonstrate is the only feasible option for integrating learnable data-driven models at scale. We show that differentiability can be 40x faster for optimizing larger models than conventional approaches, which represents the key to neural network integration for physics discovery in later work.