One-Trimap Video Matting
Hongje Seong, Seoung Wug Oh, Brian Price, Euntai Kim and, Joon-Young Lee

TL;DR
This paper introduces OTVM, a novel video matting network that uses only one user-annotated trimap and jointly models trimap propagation and alpha prediction to improve temporal stability and outperform existing methods.
Contribution
The paper proposes a new end-to-end trainable network that jointly models trimap propagation and alpha prediction for robust video matting with a single trimap.
Findings
Outperforms state-of-the-art on Deep Video Matting and VideoMatting108 benchmarks.
Achieves significant MSE reduction of over 56%.
Enhances temporal stability of trimap propagation.
Abstract
Recent studies made great progress in video matting by extending the success of trimap-based image matting to the video domain. In this paper, we push this task toward a more practical setting and propose One-Trimap Video Matting network (OTVM) that performs video matting robustly using only one user-annotated trimap. A key of OTVM is the joint modeling of trimap propagation and alpha prediction. Starting from baseline trimap propagation and alpha prediction networks, our OTVM combines the two networks with an alpha-trimap refinement module to facilitate information flow. We also present an end-to-end training strategy to take full advantage of the joint model. Our joint modeling greatly improves the temporal stability of trimap propagation compared to the previous decoupled methods. We evaluate our model on two latest video matting benchmarks, Deep Video Matting and VideoMatting108,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage Enhancement Techniques · Image and Signal Denoising Methods · Advanced Image Processing Techniques
