CubeFormer: A Simple yet Effective Baseline for Lightweight Image Super-Resolution
Jikai Wang, Huan Zheng, Jianbing Shen

TL;DR
CubeFormer introduces a novel 3D attention mechanism and sampling strategies to significantly improve lightweight image super-resolution, achieving state-of-the-art results with enhanced feature diversity and detail recovery.
Contribution
The paper proposes CubeFormer, a simple baseline that enhances feature diversity using cube attention and transformer blocks for improved lightweight super-resolution.
Findings
Achieves state-of-the-art performance on SR benchmarks.
Enhances feature diversity and detail recovery.
Introduces cube attention and intra/inter-cube transformer blocks.
Abstract
Lightweight image super-resolution (SR) methods aim at increasing the resolution and restoring the details of an image using a lightweight neural network. However, current lightweight SR methods still suffer from inferior performance and unpleasant details. Our analysis reveals that these methods are hindered by constrained feature diversity, which adversely impacts feature representation and detail recovery. To respond this issue, we propose a simple yet effective baseline called CubeFormer, designed to enhance feature richness by completing holistic information aggregation. To be specific, we introduce cube attention, which expands 2D attention to 3D space, facilitating exhaustive information interactions, further encouraging comprehensive information extraction and promoting feature variety. In addition, we inject block and grid sampling strategies to construct intra-cube transformer…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCCD and CMOS Imaging Sensors · Satellite Image Processing and Photogrammetry · Advanced Vision and Imaging
MethodsSoftmax · Attention Is All You Need
