The illusory simplicity of the feedforward pass: evidence for the dynamical nature of stimulus encoding along the primate ventral stream

TL;DR

This study reveals that primate visual processing involves dynamic, temporally evolving neural patterns that encode information beyond static spatial responses, challenging the traditional feedforward model.

Contribution

It provides evidence that early visual processing is a spatiotemporally evolving process with rich temporal dynamics, not just a simple feedforward pass.

Findings

Temporal and semantic variation in information transfer within 100ms.

Neural dynamics carry categorical information beyond spatial encoding.

Early visual processing involves evolving neural patterns, not static responses.

Abstract

In studying primate vision, a large body of work focuses on the first feedforward sweep. During this initial time window, information is thought to pass through ventral stream regions in a stage-like fashion in an effort to extract high-level information from the retinal input. Consequently, electrophysiological analyses commonly focus on spatial response patterns, either by averaging data in time, or by applying decoders in a temporally local fashion. By analysing data recorded simultaneously across multiple arrays placed along the macaque ventral stream, we here show that this prior approach may be missing key aspects of information encoding. First, time-resolved, multivariate analyses of information transfer between V4 and IT reveal temporally and semantically varied information content as being exchanged within the first 100ms of processing. Second, by employing recurrent neural network (RNN) decoding techniques that extend across the temporal domain, we demonstrate that the neural pattern dynamics themselves carry categorical information far beyond the spatially encoded information available at any given time point. These findings challenge the prevailing view of a single, stage-like feedforward process and suggest that even the earliest parts of visual processing are better characterised as a spatiotemporally evolving process that encodes information in its dynamics rather than purely spatial response patterns.