Schr\"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation

TL;DR

Schr"odinger's Navigator introduces a belief-aware framework that reasons over multiple imagined 3D futures to improve zero-shot object navigation in complex, uncertain environments, outperforming existing methods in simulation and real-world tests.

Contribution

The paper presents a novel framework that explicitly reasons over multiple trajectory-conditioned imagined 3D scene futures for robust zero-shot navigation.

Findings

Outperforms strong ZSON baselines in simulation and real-world tests.

Achieves more robust self-localization and object localization.

Enhances safe navigation under occlusions and hazards.

Abstract

Zero-shot object navigation (ZSON) requires robots to locate target objects in unseen environments without task-specific fine-tuning or pre-built maps, a capability crucial for service and household robotics. Existing methods perform well in simulation but struggle in realistic, cluttered environments where heavy occlusions and latent hazards make large portions of the scene unobserved. These approaches typically act on a single inferred scene, making them prone to overcommitment and unsafe behavior under uncertainty. To address these challenges, we propose Schr\"odinger's Navigator, a belief-aware framework that explicitly reasons over multiple trajectory-conditioned imagined 3D futures at inference time. A trajectory-conditioned 3D world model generates hypothetical observations along candidate paths, maintaining a superposition of plausible scene realizations. An adaptive, occluder-aware trajectory sampling strategy focuses imagination on uncertain regions, while a Future-Aware Value Map (FAVM) aggregates imagined futures to guide robust, proactive action selection. Evaluations in simulation and on a physical Go2 quadruped robot demonstrate that Schr\"odinger's Navigator outperforms strong ZSON baselines, achieving more robust self-localization, object localization, and safe navigation under severe occlusions and latent hazards. These results highlight the effectiveness of reasoning over imagined 3D futures as a scalable and generalizable strategy for zero-shot navigation in uncertain real-world environments.