Light Cones For Vision: Simple Causal Priors For Visual Hierarchy
Manglam Kartik, Neel Tushar Shah

TL;DR
This paper introduces Lorentzian geometry-based causal priors for vision models, significantly improving hierarchical object detection by encoding temporal causality with minimal parameters.
Contribution
The paper proposes Worldline Slot Attention using Lorentzian worldlines to model hierarchical objects, demonstrating superior performance over Euclidean and hyperbolic models.
Findings
Lorentzian worldlines outperform Euclidean models by 6x in accuracy.
Causal structure encoding is essential for hierarchical object discovery.
Achieves high accuracy with only 11K parameters.
Abstract
Standard vision models treat objects as independent points in Euclidean space, unable to capture hierarchical structure like parts within wholes. We introduce Worldline Slot Attention, which models objects as persistent trajectories through spacetime worldlines, where each object has multiple slots at different hierarchy levels sharing the same spatial position but differing in temporal coordinates. This architecture consistently fails without geometric structure: Euclidean worldlines achieve 0.078 level accuracy, below random chance (0.33), while Lorentzian worldlines achieve 0.479-0.661 across three datasets: a 6x improvement replicated over 20+ independent runs. Lorentzian geometry also outperforms hyperbolic embeddings showing visual hierarchies require causal structure (temporal dependency) rather than tree structure (radial branching). Our results demonstrate that hierarchical…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Multimodal Machine Learning Applications · Advanced Vision and Imaging
