Unsupervised multi-scale diagnostics

TL;DR

The paper introduces mrCOSTS, an unsupervised hierarchical algorithm for diagnosing coherent multi-scale patterns in complex data, enabling better analysis of phenomena like climate, neural signals, and wind patterns without prior training.

Contribution

It presents a novel, unsupervised multi-resolution method based on Dynamic Mode Decomposition for analyzing multi-scale data hierarchically and automatically.

Findings

Successfully applied to climate, neural, and wind data sets.

Revealed complex multi-scale dynamics previously difficult to analyze.

Extracted new patterns of activity embedded in the data.

Abstract

The unsupervised and principled diagnosis of multi-scale data is a fundamental obstacle in modern scientific problems from, for instance, weather and climate prediction, neurology, epidemiology, and turbulence. Multi-scale data is characterized by a combination of processes acting along multiple dimensions simultaneously, spatiotemporal scales across orders of magnitude, non-stationarity, and/or invariances such as translation and rotation. Existing methods are not well-suited to multi-scale data, usually requiring supervised strategies such as human intervention, extensive tuning, or selection of ideal time periods. We present the multi-resolution Coherent Spatio-Temporal Scale Separation (mrCOSTS), a hierarchical and automated algorithm for the diagnosis of coherent patterns or modes in multi-scale data. mrCOSTS is a variant of Dynamic Mode Decomposition which decomposes data into bands of spatial patterns with shared time dynamics, thereby providing a robust method for analyzing multi-scale data. It requires no training but instead takes advantage of the hierarchical nature of multi-scale systems. We demonstrate mrCOSTS using complex multi-scale data sets that are canonically difficult to analyze: 1) climate patterns of sea surface temperature, 2) electrophysiological observations of neural signals of the motor cortex, and 3) horizontal wind in the mountain boundary layer. With mrCOSTS, we trivially retrieve complex dynamics that were previously difficult to resolve while additionally extracting hitherto unknown patterns of activity embedded in the dynamics, allowing for advancing the understanding of these fields of study. This method is an important advancement for addressing the multi-scale data which characterize many of the grand challenges in science and engineering.