Anomaly Detection by Effectively Leveraging Synthetic Images

TL;DR

This paper presents a novel framework that combines text-guided image translation and image retrieval to generate high-quality synthetic defect images, improving anomaly detection in industrial manufacturing with reduced data collection costs.

Contribution

It introduces a two-stage training strategy leveraging synthetic images from rule-based and generative models, enhancing anomaly detection performance efficiently.

Findings

Improved detection accuracy on MVTec AD dataset

Effective synthetic image generation with image retrieval filtering

Cost reduction in data collection process

Abstract

Anomaly detection plays a vital role in industrial manufacturing. Due to the scarcity of real defect images, unsupervised approaches that rely solely on normal images have been extensively studied. Recently, diffusion-based generative models brought attention to training data synthesis as an alternative solution. In this work, we focus on a strategy to effectively leverage synthetic images to maximize the anomaly detection performance. Previous synthesis strategies are broadly categorized into two groups, presenting a clear trade-off. Rule-based synthesis, such as injecting noise or pasting patches, is cost-effective but often fails to produce realistic defect images. On the other hand, generative model-based synthesis can create high-quality defect images but requires substantial cost. To address this problem, we propose a novel framework that leverages a pre-trained text-guided image-to-image translation model and image retrieval model to efficiently generate synthetic defect images. Specifically, the image retrieval model assesses the similarity of the generated images to real normal images and filters out irrelevant outputs, thereby enhancing the quality and relevance of the generated defect images. To effectively leverage synthetic images, we also introduce a two stage training strategy. In this strategy, the model is first pre-trained on a large volume of images from rule-based synthesis and then fine-tuned on a smaller set of high-quality images. This method significantly reduces the cost for data collection while improving the anomaly detection performance. Experiments on the MVTec AD dataset demonstrate the effectiveness of our approach.