Dense residual Transformer for image denoising
Chao Yao, Shuo Jin, Meiqin Liu, Xiaojuan Ban

TL;DR
This paper introduces DenSformer, a Transformer-based neural network for image denoising that effectively captures local and global features, outperforming existing methods on synthetic and real noisy images.
Contribution
The paper presents a novel Transformer-based architecture, DenSformer, with dense skip connections and specialized modules for improved image denoising performance.
Findings
DenSformer outperforms state-of-the-art methods on synthetic noise data.
DenSformer achieves superior results on real noise data.
The model effectively captures local and global features for denoising.
Abstract
Image denoising is an important low-level computer vision task, which aims to reconstruct a noise-free and high-quality image from a noisy image. With the development of deep learning, convolutional neural network (CNN) has been gradually applied and achieved great success in image denoising, image compression, image enhancement, etc. Recently, Transformer has been a hot technique, which is widely used to tackle computer vision tasks. However, few Transformer-based methods have been proposed for low-level vision tasks. In this paper, we proposed an image denoising network structure based on Transformer, which is named DenSformer. DenSformer consists of three modules, including a preprocessing module, a local-global feature extraction module, and a reconstruction module. Specifically, the local-global feature extraction module consists of several Sformer groups, each of which has several…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage and Signal Denoising Methods · Photoacoustic and Ultrasonic Imaging · Image Processing Techniques and Applications
MethodsMulti-Head Attention · Attention Is All You Need · Linear Layer · Dropout · Adam · Byte Pair Encoding · Residual Connection · Label Smoothing · Position-Wise Feed-Forward Layer · Absolute Position Encodings
