Characterizing Neural Manifolds' Properties and Curvatures using Normalizing Flows

TL;DR

This paper introduces a novel method using Normalizing Flows to characterize the geometry and statistical properties of neural activity manifolds, capturing complex, state-dependent curvature and non-Gaussian correlations.

Contribution

The study presents a new framework employing Normalizing Flows to analyze neural manifolds, overcoming Gaussian and flatness assumptions of traditional methods, and providing interpretable geometric and statistical characterizations.

Findings

Neural manifolds are curved and state-dependent.

Complex non-Gaussian correlations exist among neurons.

The method effectively captures non-linear neural interactions.

Abstract

Neuronal activity is found to lie on low-dimensional manifolds embedded within the high-dimensional neuron space. Variants of principal component analysis are frequently employed to assess these manifolds. These methods are, however, limited by assuming a Gaussian data distribution and a flat manifold. In this study, we introduce a method designed to satisfy three core objectives: (1) extract coordinated activity across neurons, described either statistically as correlations or geometrically as manifolds; (2) identify a small number of latent variables capturing these structures; and (3) offer an analytical and interpretable framework characterizing statistical properties by a characteristic function and describing manifold geometry through a collection of charts. To this end, we employ Normalizing Flows (NFs), which learn an underlying probability distribution of data by an invertible mapping between data and latent space. Their simplicity and ability to compute exact likelihoods distinguish them from other generative networks. We adjust the NF's training objective to distinguish between relevant (in manifold) and noise dimensions (out of manifold). Additionally, we find that different behavioral states align with the components of the latent Gaussian mixture model, enabling their treatment as distinct curved manifolds. Subsequently, we approximate the network for each mixture component with a quadratic mapping, allowing us to characterize both neural manifold curvature and non-Gaussian correlations among recording channels. Applying the method to recordings in macaque visual cortex, we demonstrate that state-dependent manifolds are curved and exhibit complex statistical dependencies. Our approach thus enables an expressive description of neural population activity, uncovering non-linear interactions among groups of neurons.