Compressed-Domain-Aware Online Video Super-Resolution
Yuhang Wang, Hai Li, Shujuan Hou, Zhetao Dong, Xiaoyao Yang

TL;DR
This paper introduces CDA-VSR, a novel online video super-resolution method that leverages compressed-domain information to improve efficiency and accuracy, achieving real-time performance and surpassing state-of-the-art results.
Contribution
The paper proposes a compressed-domain-aware network with motion-vector-guided alignment, residual map fusion, and frame-type-aware reconstruction for efficient online VSR.
Findings
Outperforms state-of-the-art methods on REDS4 dataset
Achieves over double the inference speed of previous methods
Improves PSNR by up to 0.13 dB
Abstract
In bandwidth-limited online video streaming, videos are usually downsampled and compressed. Although recent online video super-resolution (online VSR) approaches achieve promising results, they are still compute-intensive and fall short of real-time processing at higher resolutions, due to complex motion estimation for alignment and redundant processing of consecutive frames. To address these issues, we propose a compressed-domain-aware network (CDA-VSR) for online VSR, which utilizes compressed-domain information, including motion vectors, residual maps, and frame types to balance quality and efficiency. Specifically, we propose a motion-vector-guided deformable alignment module that uses motion vectors for coarse warping and learns only local residual offsets for fine-tuned adjustments, thereby maintaining accuracy while reducing computation. Then, we utilize a residual map gated…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Image Processing Techniques · Advanced Vision and Imaging · Video Coding and Compression Technologies
