ICONIC-444: A 3.1-Million-Image Dataset for OOD Detection Research

TL;DR

ICONIC-444 is a large-scale industrial image dataset with over 3.1 million images across 444 classes, designed to facilitate research in out-of-distribution detection for real-world computer vision tasks.

Contribution

The paper introduces ICONIC-444, a new extensive dataset tailored for OOD detection, with defined tasks and baseline results, filling a critical gap in existing resources.

Findings

Provides a large, diverse dataset for OOD detection research.

Defines four benchmark tasks for evaluating OOD detection methods.

Offers baseline results for 22 state-of-the-art OOD detection algorithms.

Abstract

Current progress in out-of-distribution (OOD) detection is limited by the lack of large, high-quality datasets with clearly defined OOD categories across varying difficulty levels (near- to far-OOD) that support both fine- and coarse-grained computer vision tasks. To address this limitation, we introduce ICONIC-444 (Image Classification and OOD Detection with Numerous Intricate Complexities), a specialized large-scale industrial image dataset containing over 3.1 million RGB images spanning 444 classes tailored for OOD detection research. Captured with a prototype industrial sorting machine, ICONIC-444 closely mimics real-world tasks. It complements existing datasets by offering structured, diverse data suited for rigorous OOD evaluation across a spectrum of task complexities. We define four reference tasks within ICONIC-444 to benchmark and advance OOD detection research and provide baseline results for 22 state-of-the-art post-hoc OOD detection methods.