SVD-based Causal Emergence for Gaussian Iterative Systems

TL;DR

This paper introduces a SVD-based framework for quantifying causal emergence in Gaussian iterative systems, enabling analysis of continuous-state systems with noise, validated through numerical simulations.

Contribution

It extends causal emergence analysis to Gaussian systems using SVD of inverse covariance matrices, bypassing coarse-graining limitations of previous methods.

Findings

SVD-based CE correlates positively with EI-based CE.

Provides precise coarse-graining strategies from singular value spectra.

Applicable to various Gaussian noise systems and neural network models.

Abstract

Causal emergence (CE) based on effective information (EI) demonstrates that macro-states can exhibit stronger causal effects than micro-states in dynamics. However, the identification of CE and the maximization of EI both rely on coarse-graining strategies, which is a key challenge. A recently proposed CE framework based on approximate dynamical reversibility, utilizing singular value decomposition (SVD), is independent of coarse-graining. Still, it is limited to transition probability matrices (TPM) in discrete states. To address this, this article proposes a novel CE quantification framework for Gaussian iterative systems (GIS), based on approximate dynamical reversibility derived from the SVD of inverse covariance matrices in forward and backward dynamics. The positive correlation between SVD-based and EI-based CE, along with the equivalence condition, is given analytically. After that, we provide precise coarse-graining strategies directly from singular value spectra and orthogonal matrices. This new framework can be applied to any dynamical system with continuous states and Gaussian noise, such as auto-regressive growth models, Markov-Gaussian systems, and even SIR modeling using neural networks (NN). Numerical simulations on typical cases validate our theory and offer a new approach to studying the CE phenomenon, emphasizing noise and covariance over dynamical functions in both known models and machine learning.