Semiconductor SEM Image Defect Classification Using Supervised and Semi-Supervised Learning with Vision Transformers

• URL: http://arxiv.org/abs/2506.03345v1
• Date: Tue, 03 Jun 2025 19:34:54 GMT
• Title: Semiconductor SEM Image Defect Classification Using Supervised and Semi-Supervised Learning with Vision Transformers
• Authors: Chien-Fu, Huang, Katherine Sieg, Leonid Karlinksy, Nash Flores, Rebekah Sheraw, Xin Zhang,
• Abstract summary: This work proposes application of vision transformer (ViT) neural networks for automatic defect classification (ADC) of scanning electron microscope (SEM) images of wafer defects.<n>We studied 11 defect types from over 7400 total images and investigated the potential of transfer learning of DinoV2 and semi-supervised learning for improved classification accuracy and efficient computation.
• Score: 31.64631761575222
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Controlling defects in semiconductor processes is important for maintaining yield, improving production cost, and preventing time-dependent critical component failures. Electron beam-based imaging has been used as a tool to survey wafers in the line and inspect for defects. However, manual classification of images for these nano-scale defects is limited by time, labor constraints, and human biases. In recent years, deep learning computer vision algorithms have shown to be effective solutions for image-based inspection applications in industry. This work proposes application of vision transformer (ViT) neural networks for automatic defect classification (ADC) of scanning electron microscope (SEM) images of wafer defects. We evaluated our proposed methods on 300mm wafer semiconductor defect data from our fab in IBM Albany. We studied 11 defect types from over 7400 total images and investigated the potential of transfer learning of DinoV2 and semi-supervised learning for improved classification accuracy and efficient computation. We were able to achieve classification accuracies of over 90% with less than 15 images per defect class. Our work demonstrates the potential to apply the proposed framework for a platform agnostic in-house classification tool with faster turnaround time and flexibility.

Related papers

• SEM-CLIP: Precise Few-Shot Learning for Nanoscale Defect Detection in Scanning Electron Microscope Image [27.17821452832534]
  We propose a novel few-shot learning approach, SEM-CLIP, for accurate defect classification and segmentation.<n>We employ text prompts enriched with domain knowledge as prior information to assist in precise analysis.<n> SEM-CLIP requires little annotated data, substantially reducing labor demands in the semiconductor industry.
  arXiv  Detail & Related papers  (2025-02-15T14:06:48Z)
• Utilizing Generative Adversarial Networks for Image Data Augmentation and Classification of Semiconductor Wafer Dicing Induced Defects [0.21990652930491852]
  In semiconductor manufacturing, the wafer dicing process is central yet vulnerable to defects that significantly impair yield. Deep neural networks are the current state of the art in (semi-)automated visual inspection. We explore the application of generative adversarial networks (GAN) for image data augmentation and classification of semiconductor wafer dicing induced defects.
  arXiv  Detail & Related papers  (2024-07-24T20:44:16Z)
• Wafer Map Defect Patterns Semi-Supervised Classification Using Latent Vector Representation [8.400553138721044]
  The demand for defect detection during integrated circuit fabrication stages is becoming increasingly critical. Traditional wafer map defect pattern detection methods involve manual inspection using electron microscopes. We propose a model capable of automatically detecting defects as an alternative to manual operations.
  arXiv  Detail & Related papers  (2023-10-06T08:23:36Z)
• CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation [73.02218479926469]
  We propose a transformer network with multi-stage CNN feature injection for surface defect segmentation. CINFormer presents a simple yet effective feature integration mechanism that injects the multi-level CNN features of the input image into different stages of the transformer network in the encoder. In addition, CINFormer presents a Top-K self-attention module to focus on tokens with more important information about the defects.
  arXiv  Detail & Related papers  (2023-09-22T06:12:02Z)
• Classification robustness to common optical aberrations [64.08840063305313]
  This paper proposes OpticsBench, a benchmark for investigating robustness to realistic, practically relevant optical blur effects. Experiments on ImageNet show that for a variety of different pre-trained DNNs, the performance varies strongly compared to disk-shaped kernels. We show on ImageNet-100 with OpticsAugment that can be increased by using optical kernels as data augmentation.
  arXiv  Detail & Related papers  (2023-08-29T08:36:00Z)
• Automated Semiconductor Defect Inspection in Scanning Electron Microscope Images: a Systematic Review [4.493547775253646]
  Machine learning algorithms can be trained to accurately classify and locate defects in semiconductor samples. Convolutional neural networks have proved to be particularly useful in this regard. This systematic review provides a comprehensive overview of the state of automated semiconductor defect inspection on SEM images.
  arXiv  Detail & Related papers  (2023-08-16T13:59:43Z)
• Defect Classification in Additive Manufacturing Using CNN-Based Vision Processing [76.72662577101988]
  This paper examines two scenarios: first, using convolutional neural networks (CNNs) to accurately classify defects in an image dataset from AM and second, applying active learning techniques to the developed classification model. This allows the construction of a human-in-the-loop mechanism to reduce the size of the data required to train and generate training data.
  arXiv  Detail & Related papers  (2023-07-14T14:36:58Z)
• Building Flyweight FLIM-based CNNs with Adaptive Decoding for Object Detection [40.97322222472642]
  This work presents a method to build a Convolutional Neural Network (CNN) layer by layer for object detection from user-drawn markers. We address the detection of Schistosomiasis mansoni eggs in microscopy images of fecal samples, and the detection of ships in satellite images. Our CNN weighs thousands of times less than SOTA object detectors, being suitable for CPU execution and showing superior or equivalent performance to three methods in five measures.
  arXiv  Detail & Related papers  (2023-06-26T16:48:20Z)
• Seamless Iterative Semi-Supervised Correction of Imperfect Labels in Microscopy Images [57.42492501915773]
  In-vitro tests are an alternative to animal testing for the toxicity of medical devices. Human fatigue plays a role in error making, making the use of deep learning appealing. We propose Seamless Iterative Semi-Supervised correction of Imperfect labels (SISSI) Our method successfully provides an adaptive early learning correction technique for object detection.
  arXiv  Detail & Related papers  (2022-08-05T18:52:20Z)
• Cognitive Visual Inspection Service for LCD Manufacturing Industry [80.63336968475889]
  This paper discloses a novel visual inspection system for liquid crystal display (LCD), which is currently a dominant type in the FPD industry. System is based on two cornerstones: robust/high-performance defect recognition model and cognitive visual inspection service architecture.
  arXiv  Detail & Related papers  (2021-01-11T08:14:35Z)
• Salvage Reusable Samples from Noisy Data for Robust Learning [70.48919625304]
  We propose a reusable sample selection and correction approach, termed as CRSSC, for coping with label noise in training deep FG models with web images. Our key idea is to additionally identify and correct reusable samples, and then leverage them together with clean examples to update the networks.
  arXiv  Detail & Related papers  (2020-08-06T02:07:21Z)
• Learning-based Defect Recognition for Quasi-Periodic Microscope Images [0.0]
  We propose a semi-supervised machine learning method that assists in the detection of lattice defects from atomic resolution microscope images. It involves a convolutional neural network that classifies image patches as defective or non-defective, a graph-based that chooses one non-defective patch as a model, and finally an automatically generated convolutional filter bank. The algorithm is tested on III-V/Si crystalline materials and successfully evaluated against different metrics, showing promising results even for extremely small training data sets.
  arXiv  Detail & Related papers  (2020-07-02T18:00:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.