GANs and Closures: Micro-Macro Consistency in Multiscale Modeling

TL;DR

This paper introduces a novel framework combining physics-based sampling methods with machine learning generative adversarial networks to improve multiscale sampling of complex stochastic systems, enhancing efficiency and scalability.

Contribution

It proposes coupling conditional GANs with physics-based sampling to better sample multiscale stochastic differential equations, leveraging learned low-dimensional descriptors.

Findings

Coupled cGANs and physics-based sampling improve multiscale system sampling.

The approach enhances sampling efficiency for complex systems.

Promising results for systems with increasing complexity.

Abstract

Sampling the phase space of molecular systems -- and, more generally, of complex systems effectively modeled by stochastic differential equations -- is a crucial modeling step in many fields, from protein folding to materials discovery. These problems are often multiscale in nature: they can be described in terms of low-dimensional effective free energy surfaces parametrized by a small number of "slow" reaction coordinates; the remaining "fast" degrees of freedom populate an equilibrium measure on the reaction coordinate values. Sampling procedures for such problems are used to estimate effective free energy differences as well as ensemble averages with respect to the conditional equilibrium distributions; these latter averages lead to closures for effective reduced dynamic models. Over the years, enhanced sampling techniques coupled with molecular simulation have been developed. An intriguing analogy arises with the field of Machine Learning (ML), where Generative Adversarial Networks can produce high dimensional samples from low dimensional probability distributions. This sample generation returns plausible high dimensional space realizations of a model state, from information about its low-dimensional representation. In this work, we present an approach that couples physics-based simulations and biasing methods for sampling conditional distributions with ML-based conditional generative adversarial networks for the same task. The "coarse descriptors" on which we condition the fine scale realizations can either be known a priori, or learned through nonlinear dimensionality reduction. We suggest that this may bring out the best features of both approaches: we demonstrate that a framework that couples cGANs with physics-based enhanced sampling techniques can improve multiscale SDE dynamical systems sampling, and even shows promise for systems of increasing complexity.