InspecSafe-V1: A Multimodal Benchmark for Safety Assessment in Industrial Inspection Scenarios

TL;DR

InspecSafe-V1 is a comprehensive multimodal dataset from real industrial inspections, enabling advanced safety assessment and scene understanding for AI systems in complex industrial environments.

Contribution

It introduces the first multimodal benchmark dataset for industrial safety assessment, covering diverse real-world scenarios with detailed annotations and multiple sensing modalities.

Findings

Provides pixel-level object annotations for safety-critical objects.

Includes seven synchronized sensing modalities for multimodal analysis.

Supports development of robust safety assessment models in industrial settings.

Abstract

With the rapid development of industrial intelligence and unmanned inspection, reliable perception and safety assessment for AI systems in complex and dynamic industrial sites has become a key bottleneck for deploying predictive maintenance and autonomous inspection. Most public datasets remain limited by simulated data sources, single-modality sensing, or the absence of fine-grained object-level annotations, which prevents robust scene understanding and multimodal safety reasoning for industrial foundation models. To address these limitations, InspecSafe-V1 is released as the first multimodal benchmark dataset for industrial inspection safety assessment that is collected from routine operations of real inspection robots in real-world environments. InspecSafe-V1 covers five representative industrial scenarios, including tunnels, power facilities, sintering equipment, oil and gas petrochemical plants, and coal conveyor trestles. The dataset is constructed from 41 wheeled and rail-mounted inspection robots operating at 2,239 valid inspection sites, yielding 5,013 inspection instances. For each instance, pixel-level segmentation annotations are provided for key objects in visible-spectrum images. In addition, a semantic scene description and a corresponding safety level label are provided according to practical inspection tasks. Seven synchronized sensing modalities are further included, including infrared video, audio, depth point clouds, radar point clouds, gas measurements, temperature, and humidity, to support multimodal anomaly recognition, cross-modal fusion, and comprehensive safety assessment in industrial environments.