Cross-Model Transferability of Adversarial Patches in Real-time Segmentation for Autonomous Driving

TL;DR

This paper introduces a realistic adversarial patch attack for semantic segmentation in autonomous driving, analyzing its transferability across different model architectures including CNNs and Vision Transformers, revealing architecture-dependent vulnerabilities.

Contribution

The study proposes a novel EOT-based adversarial patch attack tailored for real-time segmentation and provides a comprehensive cross-model transferability analysis across CNN and Transformer models.

Findings

High transferability of attacks on unseen images within the same model

Minimal transferability of attacks across different model architectures

Patch attacks have localized effects on CNNs but broader impact on ViTs

Abstract

Adversarial attacks pose a significant threat to deep learning models, particularly in safety-critical applications like healthcare and autonomous driving. Recently, patch based attacks have demonstrated effectiveness in real-time inference scenarios owing to their 'drag and drop' nature. Following this idea for Semantic Segmentation (SS), here we propose a novel Expectation Over Transformation (EOT) based adversarial patch attack that is more realistic for autonomous vehicles. To effectively train this attack we also propose a 'simplified' loss function that is easy to analyze and implement. Using this attack as our basis, we investigate whether adversarial patches once optimized on a specific SS model, can fool other models or architectures. We conduct a comprehensive cross-model transferability analysis of adversarial patches trained on SOTA Convolutional Neural Network (CNN) models such PIDNet-S, PIDNet-M and PIDNet-L, among others. Additionally, we also include the Segformer model to study transferability to Vision Transformers (ViTs). All of our analysis is conducted on the widely used Cityscapes dataset. Our study reveals key insights into how model architectures (CNN vs CNN or CNN vs. Transformer-based) influence attack susceptibility. In particular, we conclude that although the transferability (effectiveness) of attacks on unseen images of any dimension is really high, the attacks trained against one particular model are minimally effective on other models. And this was found to be true for both ViT and CNN based models. Additionally our results also indicate that for CNN-based models, the repercussions of patch attacks are local, unlike ViTs. Per-class analysis reveals that simple-classes like 'sky' suffer less misclassification than others. The code for the project is available at: https://github.com/p-shekhar/adversarial-patch-transferability