Toward Robust and Accurate Adversarial Camouflage Generation against Vehicle Detectors

TL;DR

This paper introduces RAUCA, a neural rendering-based method for creating robust adversarial camouflage for vehicles that remains effective across different weather conditions and environments.

Contribution

The paper proposes E2E-NRP, a novel neural renderer that accurately models environmental factors, and integrates multi-weather data to improve camouflage robustness against vehicle detectors.

Findings

RAUCA outperforms existing methods in simulation and real-world tests.

E2E-NRP effectively captures environmental characteristics during rendering.

Camouflage remains effective across diverse weather conditions.

Abstract

Adversarial camouflage is a widely used physical attack against vehicle detectors for its superiority in multi-view attack performance. One promising approach involves using differentiable neural renderers to facilitate adversarial camouflage optimization through gradient back-propagation. However, existing methods often struggle to capture environmental characteristics during the rendering process or produce adversarial textures that can precisely map to the target vehicle. Moreover, these approaches neglect diverse weather conditions, reducing the efficacy of generated camouflage across varying weather scenarios. To tackle these challenges, we propose a robust and accurate camouflage generation method, namely RAUCA. The core of RAUCA is a novel neural rendering component, End-to-End Neural Renderer Plus (E2E-NRP), which can accurately optimize and project vehicle textures and render images with environmental characteristics such as lighting and weather. In addition, we integrate a multi-weather dataset for camouflage generation, leveraging the E2E-NRP to enhance the attack robustness. Experimental results on six popular object detectors show that RAUCA-final outperforms existing methods in both simulation and real-world settings.