A Novel Approach to Industrial Defect Generation through Blended Latent Diffusion Model with Online Adaptation

TL;DR

This paper presents a novel latent diffusion-based data augmentation method with online adaptation to generate high-quality defective samples, significantly improving industrial anomaly detection performance on the MVTec AD dataset.

Contribution

It introduces a blended latent diffusion model with feature editing and online decoder adaptation for defect sample generation, enhancing anomaly detection accuracy.

Findings

Achieved up to 3.1% improvement in AD metrics on MVTec AD dataset.

Generated diverse and high-quality defective samples for training.

Enhanced AD performance with augmented data using the proposed method.

Abstract

Effectively addressing the challenge of industrial Anomaly Detection (AD) necessitates an ample supply of defective samples, a constraint often hindered by their scarcity in industrial contexts. This paper introduces a novel algorithm designed to augment defective samples, thereby enhancing AD performance. The proposed method tailors the blended latent diffusion model for defect sample generation, employing a diffusion model to generate defective samples in the latent space. A feature editing process, controlled by a ``trimap" mask and text prompts, refines the generated samples. The image generation inference process is structured into three stages: a free diffusion stage, an editing diffusion stage, and an online decoder adaptation stage. This sophisticated inference strategy yields high-quality synthetic defective samples with diverse pattern variations, leading to significantly improved AD accuracies based on the augmented training set. Specifically, on the widely recognized MVTec AD dataset, the proposed method elevates the state-of-the-art (SOTA) performance of AD with augmented data by 1.5%, 1.9%, and 3.1% for AD metrics AP, IAP, and IAP90, respectively. The implementation code of this work can be found at the GitHub repository https://github.com/GrandpaXun242/AdaBLDM.git