ICPR 2024 Competition on Safe Segmentation of Drive Scenes in Unstructured Traffic and Adverse Weather Conditions

TL;DR

The ICPR 2024 Competition evaluated semantic segmentation models for autonomous driving in challenging weather and traffic conditions, emphasizing safety through a novel metric and setting new benchmarks in the field.

Contribution

Introduction of a comprehensive benchmark dataset and a safety-focused metric to evaluate and improve segmentation models for autonomous driving in adverse conditions.

Findings

Models demonstrated improved safety-aware segmentation performance.

The Safe mIoU metric effectively penalized unsafe predictions.

The competition set new standards for robustness in unstructured traffic environments.

Abstract

The ICPR 2024 Competition on Safe Segmentation of Drive Scenes in Unstructured Traffic and Adverse Weather Conditions served as a rigorous platform to evaluate and benchmark state-of-the-art semantic segmentation models under challenging conditions for autonomous driving. Over several months, participants were provided with the IDD-AW dataset, consisting of 5000 high-quality RGB-NIR image pairs, each annotated at the pixel level and captured under adverse weather conditions such as rain, fog, low light, and snow. A key aspect of the competition was the use and improvement of the Safe mean Intersection over Union (Safe mIoU) metric, designed to penalize unsafe incorrect predictions that could be overlooked by traditional mIoU. This innovative metric emphasized the importance of safety in developing autonomous driving systems. The competition showed significant advancements in the field, with participants demonstrating models that excelled in semantic segmentation and prioritized safety and robustness in unstructured and adverse conditions. The results of the competition set new benchmarks in the domain, highlighting the critical role of safety in deploying autonomous vehicles in real-world scenarios. The contributions from this competition are expected to drive further innovation in autonomous driving technology, addressing the critical challenges of operating in diverse and unpredictable environments.