SEM-CLIP: Precise Few-Shot Learning for Nanoscale Defect Detection in Scanning Electron Microscope Image

TL;DR

SEM-CLIP is a novel few-shot learning method that adapts CLIP for precise defect detection and segmentation in SEM images, significantly reducing data requirements in semiconductor manufacturing.

Contribution

This paper introduces SEM-CLIP, a customized CLIP-based approach that leverages domain-specific prompts and feature engineering for nanoscale defect analysis in SEM images.

Findings

Achieves high accuracy in defect classification with minimal data

Effectively segments defects in complex SEM backgrounds

Reduces annotation effort in semiconductor defect detection

Abstract

In the field of integrated circuit manufacturing, the detection and classification of nanoscale wafer defects are critical for subsequent root cause analysis and yield enhancement. The complex background patterns observed in scanning electron microscope (SEM) images and the diverse textures of the defects pose significant challenges. Traditional methods usually suffer from insufficient data, labels, and poor transferability. In this paper, we propose a novel few-shot learning approach, SEM-CLIP, for accurate defect classification and segmentation. SEM-CLIP customizes the Contrastive Language-Image Pretraining (CLIP) model to better focus on defect areas and minimize background distractions, thereby enhancing segmentation accuracy. We employ text prompts enriched with domain knowledge as prior information to assist in precise analysis. Additionally, our approach incorporates feature engineering with textual guidance to categorize defects more effectively. SEM-CLIP requires little annotated data, substantially reducing labor demands in the semiconductor industry. Extensive experimental validation demonstrates that our model achieves impressive classification and segmentation results under few-shot learning scenarios.