# Three-dimensional scene boundary representations for wall orientation and distance are represented distinctly in the human visual cortex

## TL;DR

The study shows how the human brain processes spatial layout by encoding distance before orientation in the visual cortex.

## Contribution

The study reveals a hierarchical encoding of spatial layout features in the human visual cortex during scene perception.

## Key findings

- Relative distance is encoded in the early visual cortex during early processing.
- Orientation is represented in scene-selective higher visual areas during later processing.
- Navigation-related tasks enhance orientation coding in the early visual cortex.

## Abstract

Human spatial navigation relies on the brain’s ability to visually represent the 3D layout of the environment. To understand how the brain encodes the layout information, it is crucial to identify the key features of environmental layout and how they are processed in the human brain. The vector coding principle, which highlight the role of boundary distance and orientation, provides a theoretical framework supported by physiological evidence from rodents. In this study, we developed a reconstruction approach to quantitatively estimate 3D layout information from natural indoor scene images. This approach enabled analyses of fMRI data from the large-scale Natural Scenes Dataset (NSD) using vector-based models of 3D layout. To validate the NSD-based results and examine task-related dynamics, we further conducted fMRI and MEG experiments with navigation-related and non-navigational tasks. Controlling for low-, mid-, and high-level visual and semantic features of natural indoor scenes, we found a spatiotemporal dissociation between boundary distance and orientation representations in the human brain. Relative distance was encoded in the early visual cortex during early processing in a task-invariant manner, whereas orientation was represented in scene-selective higher visual areas during later processing and was modulated by navigation-related tasks. Importantly, task modulation manifested as enhanced orientation coding in early visual cortex, potentially reflecting top-down feedback and short-term maintenance mechanisms. Together, these findings provide a novel perspective on how the human brain represents navigation-relevant information about the immediate surrounding environment, advancing our understanding of the neural mechanisms that link perception to action in spatial navigation.

How does the brain encode the features of environmental structure while viewing a three-dimensional scene? This study shows that the human visual cortex hierarchically encodes nearby boundaries, revealing a distance-before-orientation principle of spatial layout processing.