FCA2: Frame Compression-Aware Autoencoder for Modular and Fast Compressed Video Super-Resolution

TL;DR

FCA2 introduces a compression-aware autoencoder that significantly speeds up compressed video super-resolution by reducing computational complexity while maintaining or improving performance, addressing key bottlenecks in current methods.

Contribution

The paper presents a novel, scalable, and modular autoencoder architecture that leverages structural similarities to improve efficiency and effectiveness in compressed video super-resolution.

Findings

Achieves state-of-the-art or better performance compared to existing models.

Reduces inference time significantly while maintaining high quality.

Demonstrates strong adaptability across different VSR frameworks.

Abstract

State-of-the-art (SOTA) compressed video super-resolution (CVSR) models face persistent challenges, including prolonged inference time, complex training pipelines, and reliance on auxiliary information. As video frame rates continue to increase, the diminishing inter-frame differences further expose the limitations of traditional frame-to-frame information exploitation methods, which are inadequate for addressing current video super-resolution (VSR) demands. To overcome these challenges, we propose an efficient and scalable solution inspired by the structural and statistical similarities between hyperspectral images (HSI) and video data. Our approach introduces a compression-driven dimensionality reduction strategy that reduces computational complexity, accelerates inference, and enhances the extraction of temporal information across frames. The proposed modular architecture is designed for seamless integration with existing VSR frameworks, ensuring strong adaptability and transferability across diverse applications. Experimental results demonstrate that our method achieves performance on par with, or surpassing, the current SOTA models, while significantly reducing inference time. By addressing key bottlenecks in CVSR, our work offers a practical and efficient pathway for advancing VSR technology. Our code will be publicly available at https://github.com/handsomewzy/FCA2.