Adversarial Imaging Pipelines
Buu Phan, Fahim Mannan, Felix Heide

TL;DR
This paper introduces a novel adversarial attack method targeting specific camera image processing pipelines, revealing how ISP transformations can be exploited to deceive neural network classifiers with high success rates.
Contribution
It develops a differentiable multi-task optimization approach to craft adversarial patterns that target specific camera ISPs, accounting for the entire image processing pipeline.
Findings
Achieves 92% fooling rate on automotive hardware ISPs.
Demonstrates 90% fooling rate with physical optics attacks.
Reveals vulnerability of camera-specific image processing pipelines.
Abstract
Adversarial attacks play an essential role in understanding deep neural network predictions and improving their robustness. Existing attack methods aim to deceive convolutional neural network (CNN)-based classifiers by manipulating RGB images that are fed directly to the classifiers. However, these approaches typically neglect the influence of the camera optics and image processing pipeline (ISP) that produce the network inputs. ISPs transform RAW measurements to RGB images and traditionally are assumed to preserve adversarial patterns. However, these low-level pipelines can, in fact, destroy, introduce or amplify adversarial patterns that can deceive a downstream detector. As a result, optimized patterns can become adversarial for the classifier after being transformed by a certain camera ISP and optic but not for others. In this work, we examine and develop such an attack that…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
