An unsupervised approach towards promptable defect segmentation in laser-based additive manufacturing by Segment Anything

• URL: http://arxiv.org/abs/2312.04063v3
• Date: Wed, 26 Jun 2024 15:41:37 GMT
• Title: An unsupervised approach towards promptable defect segmentation in laser-based additive manufacturing by Segment Anything
• Authors: Israt Zarin Era, Imtiaz Ahmed, Zhichao Liu, Srinjoy Das,
• Abstract summary: We construct a framework for image segmentation using a state-of-the-art Vision Transformer (ViT) based Foundation model. We obtain high accuracy without using any labeled data to guide the prompt tuning process. We envision constructing a real-time anomaly detection pipeline that could revolutionize current laser additive manufacturing processes.
• Score: 7.188573079798082
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Foundation models are currently driving a paradigm shift in computer vision tasks for various fields including biology, astronomy, and robotics among others, leveraging user-generated prompts to enhance their performance. In the Laser Additive Manufacturing (LAM) domain, accurate image-based defect segmentation is imperative to ensure product quality and facilitate real-time process control. However, such tasks are often characterized by multiple challenges including the absence of labels and the requirement for low latency inference among others. Porosity is a very common defect in LAM due to lack of fusion, entrapped gas, and keyholes, directly affecting mechanical properties like tensile strength, stiffness, and hardness, thereby compromising the quality of the final product. To address these issues, we construct a framework for image segmentation using a state-of-the-art Vision Transformer (ViT) based Foundation model (Segment Anything Model) with a novel multi-point prompt generation scheme using unsupervised clustering. Utilizing our framework we perform porosity segmentation in a case study of laser-based powder bed fusion (L-PBF) and obtain high accuracy without using any labeled data to guide the prompt tuning process. By capitalizing on lightweight foundation model inference combined with unsupervised prompt generation, we envision constructing a real-time anomaly detection pipeline that could revolutionize current laser additive manufacturing processes, thereby facilitating the shift towards Industry 4.0 and promoting defect-free production along with operational efficiency.

Related papers

• GeneralAD: Anomaly Detection Across Domains by Attending to Distorted Features [68.14842693208465]
  GeneralAD is an anomaly detection framework designed to operate in semantic, near-distribution, and industrial settings. We propose a novel self-supervised anomaly generation module that employs straightforward operations like noise addition and shuffling to patch features. We extensively evaluated our approach on ten datasets, achieving state-of-the-art results in six and on-par performance in the remaining.
  arXiv  Detail & Related papers  (2024-07-17T09:27:41Z)
• DeepInspect: An AI-Powered Defect Detection for Manufacturing Industries [0.0]
  This technology excels in precisely identifying faults by extracting intricate details from product photographs. The project leverages a deep learning framework to automate real-time flaw detection in the manufacturing process.
  arXiv  Detail & Related papers  (2023-11-07T04:59:43Z)
• CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation [73.02218479926469]
  We propose a transformer network with multi-stage CNN feature injection for surface defect segmentation. CINFormer presents a simple yet effective feature integration mechanism that injects the multi-level CNN features of the input image into different stages of the transformer network in the encoder. In addition, CINFormer presents a Top-K self-attention module to focus on tokens with more important information about the defects.
  arXiv  Detail & Related papers  (2023-09-22T06:12:02Z)
• Autoencoder-Based Visual Anomaly Localization for Manufacturing Quality Control [0.0]
  This paper proposes a defect localizing autoencoder with unsupervised class selection. The selected classes of defects are augmented with natural wild textures to simulate artificial defects. The proposed methodology shows promising results with precise and accurate localization of quality defects on melamine-faced boards for the furniture industry.
  arXiv  Detail & Related papers  (2023-09-13T11:18:15Z)
• An Adversarial Active Sampling-based Data Augmentation Framework for Manufacturable Chip Design [55.62660894625669]
  Lithography modeling is a crucial problem in chip design to ensure a chip design mask is manufacturable. Recent developments in machine learning have provided alternative solutions in replacing the time-consuming lithography simulations with deep neural networks. We propose a litho-aware data augmentation framework to resolve the dilemma of limited data and improve the machine learning model performance.
  arXiv  Detail & Related papers  (2022-10-27T20:53:39Z)
• Learning to Identify Drilling Defects in Turbine Blades with Single Stage Detectors [15.842163335920954]
  We propose a model based on Retina drilling defects in X-ray images of turbine blades. The application is challenging due to the image resolutions in which defects are very small and hardly captured by the commonly used anchor sizes. We validate the model with $3$-fold cross-validation, showing a very high accuracy in identifying images with defects.
  arXiv  Detail & Related papers  (2022-08-08T18:44:51Z)
• Generative Modeling Helps Weak Supervision (and Vice Versa) [87.62271390571837]
  We propose a model fusing weak supervision and generative adversarial networks. It captures discrete variables in the data alongside the weak supervision derived label estimate. It is the first approach to enable data augmentation through weakly supervised synthetic images and pseudolabels.
  arXiv  Detail & Related papers  (2022-03-22T20:24:21Z)
• TinyDefectNet: Highly Compact Deep Neural Network Architecture for High-Throughput Manufacturing Visual Quality Inspection [72.88856890443851]
  TinyDefectNet is a highly compact deep convolutional network architecture tailored for high- throughput manufacturing visual quality inspection. TinyDefectNet was deployed on an AMD EPYC 7R32, and achieved 7.6x faster throughput using the nativeflow environment and 9x faster throughput using AMD ZenDNN accelerator library.
  arXiv  Detail & Related papers  (2021-11-29T04:19:28Z)
• P-WAE: Generalized Patch-Wasserstein Autoencoder for Anomaly Screening [17.24628770042803]
  We propose a novel Patch-wise Wasserstein AutoEncoder (P-WAE) architecture to alleviate those challenges. In particular, a patch-wise variational inference model coupled with solving the jigsaw puzzle is designed. Comprehensive experiments, conducted on the MVTec AD dataset, demonstrate the superior performance of our propo
  arXiv  Detail & Related papers  (2021-08-09T05:31:45Z)
• Cognitive Visual Inspection Service for LCD Manufacturing Industry [80.63336968475889]
  This paper discloses a novel visual inspection system for liquid crystal display (LCD), which is currently a dominant type in the FPD industry. System is based on two cornerstones: robust/high-performance defect recognition model and cognitive visual inspection service architecture.
  arXiv  Detail & Related papers  (2021-01-11T08:14:35Z)
• A Novel Visual Fault Detection and Classification System for Semiconductor Manufacturing Using Stacked Hybrid Convolutional Neural Networks [0.24999074238880484]
  Automated visual inspection in the semiconductor industry aims to detect and classify manufacturing defects. This contribution introduces a novel deep neural network based hybrid approach. Consisting of stacked hybrid convolutional neural networks (SH-CNN) and inspired by current approaches of visual attention, the realized system draws the focus over the level of detail from its structures.
  arXiv  Detail & Related papers  (2019-11-25T21:58:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.