Turbulence teaches equivariance to neural networks

TL;DR

This paper shows that turbulence's rotational symmetry can be leveraged to improve neural network generalization by embedding these symmetries, effectively acting as implicit data augmentation.

Contribution

It demonstrates how turbulence's inherent rotational structure can embed symmetries into learned mappings, enhancing neural network generalization across flow conditions.

Findings

Isotropic datasets improve symmetry embedding and generalization.

Respecting Navier-Stokes symmetries enhances model transferability.

Turbulence acts as implicit data augmentation through its rotational structure.

Abstract

We investigate how the rotational nature of turbulence affects learned mappings between quantities governed by the Navier-Stokes equations. By varying the degree of anisotropy in a turbulence dataset, we explore how statistical symmetry affects these mappings. To do this, we train super-resolution models at different wall-normal locations in a channel flow, where anisotropy varies naturally, and test their generalization. By evaluating the learned mappings on new coordinate frames and new flow conditions, we find that coordinate-frame generalization is a key part of the generalization problem. Turbulent flows naturally present a wide range of local orientations, so respecting the symmetries of the Navier-Stokes equations improves generalization to new flows. Importantly, turbulence's rotational structure can embed these symmetries into learned mappings -- an effect that strengthens with isotropy and dataset size. This is because a more isotropic dataset samples a wider range of orientations, more fully covering the rotational symmetries of the Navier-Stokes equations. The dependence on isotropy means equivariance error is also scale-dependent, consistent with Kolmogorov's hypothesis. Therefore, turbulence provides its own data augmentation (we term this implicit data augmentation). We expect this effect to apply broadly to learned mappings between tensorial flow quantities, making it relevant to most machine learning applications in turbulence.