CogStereo: Neural Stereo Matching with Implicit Spatial Cognition Embedding

TL;DR

CogStereo introduces a novel neural stereo matching framework that embeds implicit spatial cognition, enabling robust, zero-shot generalization and structurally coherent disparity estimation across diverse datasets.

Contribution

It proposes a cognition-guided refinement mechanism that improves zero-shot generalization in stereo matching without dataset-specific priors.

Findings

Achieves state-of-the-art results on multiple benchmarks.

Demonstrates superior cross-domain generalization.

Ensures structurally coherent disparity estimation.

Abstract

Deep stereo matching has advanced significantly on benchmark datasets through fine-tuning but falls short of the zero-shot generalization seen in foundation models in other vision tasks. We introduce CogStereo, a novel framework that addresses challenging regions, such as occlusions or weak textures, without relying on dataset-specific priors. CogStereo embeds implicit spatial cognition into the refinement process by using monocular depth features as priors, capturing holistic scene understanding beyond local correspondences. This approach ensures structurally coherent disparity estimation, even in areas where geometry alone is inadequate. CogStereo employs a dual-conditional refinement mechanism that combines pixel-wise uncertainty with cognition-guided features for consistent global correction of mismatches. Extensive experiments on Scene Flow, KITTI, Middlebury, ETH3D, EuRoc, and real-world demonstrate that CogStereo not only achieves state-of-the-art results but also excels in cross-domain generalization, shifting stereo vision towards a cognition-driven approach.