Hard Work Does Not Always Pay Off: Poisoning Attacks on Neural Architecture Search
Zachary Coalson, Huazheng Wang, Qingyun Wu, Sanghyun Hong

TL;DR
This paper evaluates the robustness of neural architecture search (NAS) methods against data poisoning attacks, revealing varying levels of vulnerability and robustness among different NAS algorithms on benchmark datasets.
Contribution
The study introduces a systematic poisoning framework to assess NAS robustness and compares multiple NAS algorithms under data poisoning, highlighting their vulnerabilities and robustness factors.
Findings
Training-based NAS algorithms are least robust due to data reliance.
Training-free NAS approaches are most robust but less accurate.
NAS can still improve accuracy with out-of-distribution data under attack.
Abstract
We study the robustness of data-centric methods to find neural network architectures, known as neural architecture search (NAS), against data poisoning. To audit this robustness, we design a poisoning framework that enables the systematic evaluation of the ability of NAS to produce architectures under data corruption. Our framework examines four off-the-shelf NAS algorithms, representing different approaches to architecture discovery, against four data poisoning attacks, including one we tailor specifically for NAS. In our evaluation with the CIFAR-10 and CIFAR-100 benchmarks, we show that NAS is \emph{seemingly} robust to data poisoning, showing marginal accuracy drops even under large poisoning budgets. However, we demonstrate that when considering NAS algorithms designed to achieve a few percentage points of accuracy gain, this expected improvement can be substantially diminished…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdversarial Robustness in Machine Learning · Anomaly Detection Techniques and Applications
