Fix your downsampling ASAP! Be natively more robust via Aliasing and Spectral Artifact free Pooling
Julia Grabinski, Steffen Jung, Janis Keuper, Margret Keuper

TL;DR
This paper introduces a frequency domain-based downsampling method called ASAP that eliminates aliasing and spectral artifacts in CNNs, leading to more robust models without sacrificing accuracy.
Contribution
It proposes a novel alias-free downsampling technique, ASAP, that improves CNN robustness by addressing spectral artifacts in the frequency domain.
Findings
Enhanced robustness against corruptions and adversarial attacks
Maintains comparable accuracy to baseline models
Effective across multiple CNN architectures and datasets
Abstract
Convolutional Neural Networks (CNNs) are successful in various computer vision tasks. From an image and signal processing point of view, this success is counter-intuitive, as the inherent spatial pyramid design of most CNNs is apparently violating basic signal processing laws, i.e. the Sampling Theorem in their downsampling operations. This issue has been broadly neglected until recent work in the context of adversarial attacks and distribution shifts showed that there is a strong correlation between the vulnerability of CNNs and aliasing artifacts induced by bandlimit-violating downsampling. As a remedy, we propose an alias-free downsampling operation in the frequency domain, denoted Frequency Low Cut Pooling (FLC Pooling) which we further extend to Aliasing and Sinc Artifact-free Pooling (ASAP). ASAP is alias-free and removes further artifacts from sinc-interpolation. Our experimental…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdversarial Robustness in Machine Learning · Anomaly Detection Techniques and Applications · Advanced Neural Network Applications
