Knowledge-Guided Adversarial Training for Infrared Object Detection via Thermal Radiation Modeling

TL;DR

This paper introduces a novel knowledge-guided adversarial training method that incorporates infrared physical laws to improve the robustness of infrared object detection against adversarial attacks and corruptions.

Contribution

It models thermal radiation relations based on gray value rank order and embeds this knowledge into adversarial training for the first time in infrared detection.

Findings

Enhanced robustness against adversarial attacks.

Improved accuracy on infrared datasets.

Effective across multiple models and scenarios.

Abstract

In complex environments, infrared object detection exhibits broad applicability and stability across diverse scenarios. However, infrared object detection is vulnerable to both common corruptions and adversarial examples, leading to potential security risks. To improve the robustness of infrared object detection, current methods mostly adopt a data-driven ideology, which only superficially drives the network to fit the training data without specifically considering the unique characteristics of infrared images, resulting in limited robustness. In this paper, we revisit infrared physical knowledge and find that relative thermal radiation relations between different classes can be regarded as a reliable knowledge source under the complex scenarios of adversarial examples and common corruptions. Thus, we theoretically model thermal radiation relations based on the rank order of gray values for different classes, and further quantify the stability of various inter-class thermal radiation relations. Based on the above theoretical framework, we propose Knowledge-Guided Adversarial Training (KGAT) for infrared object detection, in which infrared physical knowledge is embedded into the adversarial training process, and the predicted results are optimized to be consistent with the actual physical laws. Extensive experiments on three infrared datasets and six mainstream infrared object detection models demonstrate that KGAT effectively enhances both clean accuracy and robustness against adversarial attacks and common corruptions.