Emergent universal long-range structure in random-organizing systems

TL;DR

This paper reveals universal long-range order in diverse noisy systems, linking noise correlations to hyperuniformity and connecting stochastic gradient descent to long-range structure formation.

Contribution

It uncovers universal long-range behavior across different systems and develops a hydrodynamic theory explaining noise-induced hyperuniformity.

Findings

Universal suppression of long-range density fluctuations observed in all systems

Connection established between stochastic gradient descent and long-range order emergence

Hydrodynamic theory accurately models the observed phenomena

Abstract

Self-organization through noisy interactions is ubiquitous across physics, mathematics, and machine learning, yet how long-range structure emerges from local noisy dynamics remains poorly understood. Here, we investigate three paradigmatic random-organizing particle systems drawn from distinct domains: models from soft matter physics (random organization, biased random organization) and machine learning (stochastic gradient descent), each characterized by distinct sources of noise. We discover universal long-range behavior across all systems, namely the suppression of long-range density fluctuations, governed solely by the noise correlation between particles. Furthermore, we establish a connection between the emergence of long-range order and the tendency of stochastic gradient descent to favor flat minima -- a phenomenon widely observed in machine learning. To rationalize these findings, we develop a fluctuating hydrodynamic theory that quantitatively captures all observations. Our study resolves long-standing questions about the microscopic origin of noise-induced hyperuniformity, uncovers striking parallels between stochastic gradient descent dynamics on particle system energy landscapes and neural network loss landscapes, and should have wide-ranging applications -- from the self-assembly of hyperuniform materials to ecological population dynamics and the design of generalizable learning algorithms.