A Data Efficiency Study of Synthetic Fog for Object Detection Using the Clear2Fog Pipeline

TL;DR

This paper introduces Clear2Fog, a physics-based fog simulation pipeline that enhances training data diversity for autonomous vehicle object detection, improving robustness and transferability in foggy conditions.

Contribution

The authors develop a novel, realistic fog simulation method and demonstrate its effectiveness in improving model robustness and transfer learning for autonomous vehicle perception.

Findings

Models trained on mixed-density fog datasets outperform fixed-density datasets.

Fine-tuning with increased learning rate improves real-world fog detection performance.

Synthetic fog datasets enhance model robustness and transferability in adverse weather.

Abstract

Object detection in adverse weather is critical for the safety of autonomous vehicles; however, the scarcity of labelled, real-world foggy data remains a significant bottleneck. In this paper, we propose Clear2Fog (C2F), an end-to-end, physics-based pipeline that simulates fog on clear-weather datasets while ensuring sensor-level consistency across camera and LiDAR. By using monocular depth estimation and a novel atmospheric light estimation method, C2F overcomes structural artifacts and chromatic biases common in existing techniques. A human perceptual study confirms C2F's physical realism, with the generated images being preferred 92.95% of the time over an established method. Utilising a training set of 270,000 images from the Waymo Open Dataset, we conduct an extensive data efficiency study to investigate how environmental diversity influences model robustness. Our findings reveal that models trained on mixed-density fog datasets at 75% scale outperform those trained on fixed-density datasets at 100% scale. Furthermore, we investigate the sim-to-real transfer by fine-tuning pre-trained models on real-world foggy data. We demonstrate that a tenfold increase over the default fine-tuning learning rate successfully overcomes negative transfer from synthetic biases, resulting in a 1.67 mAP improvement over real-only baselines. The C2F pipeline provides a scalable framework for enhancing the reliability of autonomous systems in adverse weather and demonstrates the potential of diverse synthetic datasets for efficient model training.