Changes in Real Time: Online Scene Change Detection with Multi-View Fusion
Chamuditha Jayanga Galappaththige, Jason Lai, Lloyd Windrim, Donald Dansereau, Niko S\"underhauf, Dimity Miller

TL;DR
This paper introduces a novel online scene change detection method that is pose-agnostic, label-free, and multi-view consistent, achieving real-time performance and surpassing state-of-the-art offline methods on complex datasets.
Contribution
The paper presents the first online SCD approach with multi-view fusion, self-supervised loss, and fast pose estimation, significantly improving accuracy and efficiency.
Findings
Operates at over 10 FPS with state-of-the-art accuracy.
Outperforms existing online and offline methods on real-world datasets.
Ensures multi-view consistency and pose-agnostic change detection.
Abstract
Online Scene Change Detection (SCD) is an extremely challenging problem that requires an agent to detect relevant changes on the fly while observing the scene from unconstrained viewpoints. Existing online SCD methods are significantly less accurate than offline approaches. We present the first online SCD approach that is pose-agnostic, label-free, and ensures multi-view consistency, while operating at over 10 FPS and achieving new state-of-the-art performance, surpassing even the best offline approaches. Our method introduces a new self-supervised fusion loss to infer scene changes from multiple cues and observations, PnP-based fast pose estimation against the reference scene, and a fast change-guided update strategy for the 3D Gaussian Splatting scene representation. Extensive experiments on complex real-world datasets demonstrate that our approach outperforms both online and offline…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Vision and Imaging · Robotics and Sensor-Based Localization · Advanced Image and Video Retrieval Techniques
