Addressing Camera Sensors Faults in Vision-Based Navigation: Simulation and Dataset Development

TL;DR

This paper develops a simulation framework and dataset of faulty camera images to improve AI-based fault detection in vision-based navigation systems for space exploration missions.

Contribution

It introduces a systematic analysis of camera sensor faults and creates a synthetic dataset for training and testing AI fault detection methods in space navigation.

Findings

Characterized various camera sensor faults and their effects.

Developed a simulation framework for fault injection.

Provided a dataset for AI training and evaluation.

Abstract

The increasing importance of Vision-Based Navigation (VBN) algorithms in space missions raises numerous challenges in ensuring their reliability and operational robustness. Sensor faults can lead to inaccurate outputs from navigation algorithms or even complete data processing faults, potentially compromising mission objectives. Artificial Intelligence (AI) offers a powerful solution for detecting such faults, overcoming many of the limitations associated with traditional fault detection methods. However, the primary obstacle to the adoption of AI in this context is the lack of sufficient and representative datasets containing faulty image data. This study addresses these challenges by focusing on an interplanetary exploration mission scenario. A comprehensive analysis of potential fault cases in camera sensors used within the VBN pipeline is presented. The causes and effects of these faults are systematically characterized, including their impact on image quality and navigation algorithm performance, as well as commonly employed mitigation strategies. To support this analysis, a simulation framework is introduced to recreate faulty conditions in synthetically generated images, enabling a systematic and controlled reproduction of faulty data. The resulting dataset of fault-injected images provides a valuable tool for training and testing AI-based fault detection algorithms. The final link to the dataset will be added after an embargo period. For peer-reviewers, this private link is available.