Unsupervised Welding Defect Detection Using Audio And Video

• URL: http://arxiv.org/abs/2409.02290v1
• Date: Tue, 3 Sep 2024 20:58:56 GMT
• Title: Unsupervised Welding Defect Detection Using Audio And Video
• Authors: Georg Stemmer, Jose A. Lopez, Juan A. Del Hoyo Ontiveros, Arvind Raju, Tara Thimmanaik, Sovan Biswas,
• Abstract summary: We describe how deep-learning methods can be applied to detect weld defects in real-time by recording the welding process with microphones and a camera. All deep learning models are trained in an unsupervised fashion because the space of possible defects is large. We demonstrate that a reliable real-time detection of most categories of weld defects is feasible both from audio and video.
• Score: 1.517355052203938
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this work we explore the application of AI to robotic welding. Robotic welding is a widely used technology in many industries, but robots currently do not have the capability to detect welding defects which get introduced due to various reasons in the welding process. We describe how deep-learning methods can be applied to detect weld defects in real-time by recording the welding process with microphones and a camera. Our findings are based on a large database with more than 4000 welding samples we collected which covers different weld types, materials and various defect categories. All deep learning models are trained in an unsupervised fashion because the space of possible defects is large and the defects in our data may contain biases. We demonstrate that a reliable real-time detection of most categories of weld defects is feasible both from audio and video, with improvements achieved by combining both modalities. Specifically, the multi-modal approach achieves an average Area-under-ROC-Curve (AUC) of 0.92 over all eleven defect types in our data. We conclude the paper with an analysis of the results by defect type and a discussion of future work.

Related papers

• Data-driven Machinery Fault Detection: A Comprehensive Review [2.373572816573706]
  Timely and accurately identifying faulty machine signals is vital in industrial applications. Data-driven Machinery Fault Diagnosis (MFD) solutions based on machine/deep learning approaches have been used ubiquitously in manufacturing. This survey provides a comprehensive review of the articles using different types of machine learning approaches for the detection and diagnosis of various types of machinery faults.
  arXiv  Detail & Related papers  (2024-05-29T07:50:47Z)
• Investigating the ability of deep learning to predict Welding Depth and Pore Volume in Hairpin Welding [0.0]
  This study presents a deep learning model that enables the prediction of two critical welds' Key Performance Characteristics (KPCs): welding depth and average pore volume. Applying DL networks to the small numerical experimental hairpin welding dataset has shown promising results.
  arXiv  Detail & Related papers  (2023-12-04T03:38:17Z)
• Automated Semiconductor Defect Inspection in Scanning Electron Microscope Images: a Systematic Review [4.493547775253646]
  Machine learning algorithms can be trained to accurately classify and locate defects in semiconductor samples. Convolutional neural networks have proved to be particularly useful in this regard. This systematic review provides a comprehensive overview of the state of automated semiconductor defect inspection on SEM images.
  arXiv  Detail & Related papers  (2023-08-16T13:59:43Z)
• Distributional Instance Segmentation: Modeling Uncertainty and High Confidence Predictions with Latent-MaskRCNN [77.0623472106488]
  In this paper, we explore a class of distributional instance segmentation models using latent codes. For robotic picking applications, we propose a confidence mask method to achieve the high precision necessary. We show that our method can significantly reduce critical errors in robotic systems, including our newly released dataset of ambiguous scenes.
  arXiv  Detail & Related papers  (2023-05-03T05:57:29Z)
• Multimodal Industrial Anomaly Detection via Hybrid Fusion [59.16333340582885]
  We propose a novel multimodal anomaly detection method with hybrid fusion scheme. Our model outperforms the state-of-the-art (SOTA) methods on both detection and segmentation precision on MVTecD-3 AD dataset.
  arXiv  Detail & Related papers  (2023-03-01T15:48:27Z)
• Recognition of Defective Mineral Wool Using Pruned ResNet Models [88.24021148516319]
  We developed a visual quality control system for mineral wool. X-ray images of wool specimens were collected to create a training set of defective and non-defective samples. We obtained a model with more than 98% accuracy, which in comparison to the current procedure used at the company, it can recognize 20% more defective products.
  arXiv  Detail & Related papers  (2022-11-01T13:58:02Z)
• An Outlier Exposure Approach to Improve Visual Anomaly Detection Performance for Mobile Robots [76.36017224414523]
  We consider the problem of building visual anomaly detection systems for mobile robots. Standard anomaly detection models are trained using large datasets composed only of non-anomalous data. We tackle the problem of exploiting these data to improve the performance of a Real-NVP anomaly detection model.
  arXiv  Detail & Related papers  (2022-09-20T15:18:13Z)
• Detecting Faults during Automatic Screwdriving: A Dataset and Use Case of Anomaly Detection for Automatic Screwdriving [80.6725125503521]
  Data-driven approaches, using Machine Learning (ML) for detecting faults have recently gained increasing interest. We present a use case of using ML models for detecting faults during automated screwdriving operations.
  arXiv  Detail & Related papers  (2021-07-05T11:46:00Z)
• Deep Learning Based Steel Pipe Weld Defect Detection [0.0]
  State-of-the-art single-stage object detection algorithm YOLOv5 is proposed to be applied to the field of steel pipe weld defect detection. The experimental results show that applying YOLOv5 to steel pipe weld defect detection can greatly improve the accuracy, complete the multi-classification task, and meet the criteria of real-time detection.
  arXiv  Detail & Related papers  (2021-04-30T11:15:13Z)
• Classification of Spot-welded Joints in Laser Thermography Data using Convolutional Neural Networks [52.661521064098416]
  We propose an approach for quality inspection of spot weldings using images from laser thermography data. We use convolutional neural networks to classify weld quality and compare the performance of different models against each other.
  arXiv  Detail & Related papers  (2020-10-24T20:38:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.