Pixel Adaptive Filtering Units
Filippos Kokkinos, Ioannis Marras, Matteo Maggioni, Gregory Slabaugh,, Stefanos Zafeiriou

TL;DR
The paper introduces PAFU, a differentiable, content-adaptive filtering unit that replaces standard convolutions, enabling spatially varying processing for improved performance in various vision tasks.
Contribution
It proposes a novel Pixel Adaptive Filtering Unit with a learnable kernel selection mechanism for content-based spatial adaptation in neural networks.
Findings
PAFU enhances performance across multiple vision tasks.
The method is suitable for real-time applications.
Extensive experiments validate the effectiveness of content-adaptive filtering.
Abstract
State-of-the-art methods for computer vision rely heavily on the translation equivariance and spatial sharing properties of convolutional layers without explicitly taking into consideration the input content. Modern techniques employ deep sophisticated architectures in order to circumvent this issue. In this work, we propose a Pixel Adaptive Filtering Unit (PAFU) which introduces a differentiable kernel selection mechanism paired with a discrete, learnable and decorrelated group of kernels to allow for content-based spatial adaptation. First, we demonstrate the applicability of the technique in applications where runtime is of importance. Next, we employ PAFU in deep neural networks as a replacement of standard convolutional layers to enhance the original architectures with spatially varying computations to achieve considerable performance improvements. Finally, diverse and extensive…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage Enhancement Techniques · Image and Signal Denoising Methods · Advanced Image Processing Techniques
