NeuroVolve: Evolving Visual Stimuli toward Programmable Neural Objectives

TL;DR

NeuroVolve is a novel generative framework that synthesizes images guided by neural objectives, enabling exploration of brain region interactions and personalized neural representations during complex visual processing.

Contribution

It introduces a brain-guided image synthesis method that allows programmable activation of neural regions, revealing their interactions and preferences in naturalistic vision.

Findings

Successfully recovers known regional selectivity.

Synthesizes scenes satisfying multi-region constraints.

Captures subject-specific neural preferences.

Abstract

What visual information is encoded in individual brain regions, and how do distributed patterns combine to create their neural representations? Prior work has used generative models to replicate known category selectivity in isolated regions (e.g., faces in FFA), but these approaches offer limited insight into how regions interact during complex, naturalistic vision. We introduce NeuroVolve, a generative framework that provides brain-guided image synthesis via optimization of a neural objective function in the embedding space of a pretrained vision-language model. Images are generated under the guidance of a programmable neural objective, i.e., activating or deactivating single regions or multiple regions together. NeuroVolve is validated by recovering known selectivity for individual brain regions, while expanding to synthesize coherent scenes that satisfy complex, multi-region constraints. By tracking optimization steps, it reveals semantic trajectories through embedding space, unifying brain-guided image editing and preferred stimulus generation in a single process. We show that NeuroVolve can generate both low-level and semantic feature-specific stimuli for single ROIs, as well as stimuli aligned to curated neural objectives. These include co-activation and decorrelation between regions, exposing cooperative and antagonistic tuning relationships. Notably, the framework captures subject-specific preferences, supporting personalized brain-driven synthesis and offering interpretable constraints for mapping, analyzing, and probing neural representations of visual information.