3D Gaussian Splatting Driven Multi-View Robust Physical Adversarial Camouflage Generation

TL;DR

This paper introduces PGA, a 3D Gaussian Splatting-based framework for generating robust physical adversarial camouflage that is effective across multiple viewpoints and environments, overcoming limitations of prior methods.

Contribution

The paper proposes a novel 3D Gaussian Splatting-based framework for rapid, multi-view robust physical adversarial camouflage generation with photo-realistic rendering.

Findings

PGA achieves higher adversarial effectiveness across diverse viewpoints.

The method enhances robustness by preventing Gaussian occlusion and optimizing background adjustments.

Experiments demonstrate PGA's superiority over previous approaches in physical attack scenarios.

Abstract

Physical adversarial attack methods expose the vulnerabilities of deep neural networks and pose a significant threat to safety-critical scenarios such as autonomous driving. Camouflage-based physical attack is a more promising approach compared to the patch-based attack, offering stronger adversarial effectiveness in complex physical environments. However, most prior work relies on mesh priors of the target object and virtual environments constructed by simulators, which are time-consuming to obtain and inevitably differ from the real world. Moreover, due to the limitations of the backgrounds in training images, previous methods often fail to produce multi-view robust adversarial camouflage and tend to fall into sub-optimal solutions. Due to these reasons, prior work lacks adversarial effectiveness and robustness across diverse viewpoints and physical environments. We propose a physical attack framework based on 3D Gaussian Splatting (3DGS), named PGA, which provides rapid and precise reconstruction with few images, along with photo-realistic rendering capabilities. Our framework further enhances cross-view robustness and adversarial effectiveness by preventing mutual and self-occlusion among Gaussians and employing a min-max optimization approach that adjusts the imaging background of each viewpoint, helping the algorithm filter out non-robust adversarial features. Extensive experiments validate the effectiveness and superiority of PGA. Our code is available at:https://github.com/TRLou/PGA.