Simultaneous Detection and Removal of Dynamic Objects in Multi-view Images

TL;DR

This paper introduces a novel algorithm that detects and removes dynamic objects from multi-view images captured with a hand-held camera, replacing them with static occluded regions to produce artifact-free scenes.

Contribution

It is the first method to simultaneously detect and remove dynamic objects in multi-view images, improving scene consistency and visual quality.

Findings

Achieves artifact-free removal of dynamic objects in real-world scenes.

Effectively detects dynamic regions at pixel level during multi-view image processing.

Demonstrates superior performance over existing methods in multi-view dynamic object removal.

Abstract

Consider a set of images of a scene consisting of moving objects captured using a hand-held camera. In this work, we propose an algorithm which takes this set of multi-view images as input, detects the dynamic objects present in the scene, and replaces them with the static regions which are being occluded by them. The proposed algorithm scans the reference image in the row-major order at the pixel level and classifies each pixel as static or dynamic. During the scan, when a pixel is classified as dynamic, the proposed algorithm replaces that pixel value with the corresponding pixel value of the static region which is being occluded by that dynamic region. We show that we achieve artifact-free removal of dynamic objects in multi-view images of several real-world scenes. To the best of our knowledge, we propose the first method which simultaneously detects and removes the dynamic objects present in multi-view images.