Video Propagation Networks
Varun Jampani, Raghudeep Gadde, Peter V. Gehler

TL;DR
This paper introduces a Video Propagation Network that efficiently propagates structured information through video frames, improving performance on segmentation tasks and color propagation without accessing future frames.
Contribution
The paper presents a novel adaptive video propagation method combining temporal and spatial networks, enabling online processing and improved segmentation accuracy.
Findings
Outperforms previous task-specific methods in video segmentation
Demonstrates effective color propagation in grayscale videos
Offers favorable runtime for real-time applications
Abstract
We propose a technique that propagates information forward through video data. The method is conceptually simple and can be applied to tasks that require the propagation of structured information, such as semantic labels, based on video content. We propose a 'Video Propagation Network' that processes video frames in an adaptive manner. The model is applied online: it propagates information forward without the need to access future frames. In particular we combine two components, a temporal bilateral network for dense and video adaptive filtering, followed by a spatial network to refine features and increased flexibility. We present experiments on video object segmentation and semantic video segmentation and show increased performance comparing to the best previous task-specific methods, while having favorable runtime. Additionally we demonstrate our approach on an example regression…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage Enhancement Techniques · Advanced Image and Video Retrieval Techniques · Visual Attention and Saliency Detection
