Explainable Temporal Attention-based Defect Detection For Fillet Joints in Real-Time Gas Metal Arc Welding Based on Multi-modal Data

• URL: http://arxiv.org/abs/2609.07893v1
• Date: Mon, 07 Sep 2026 18:57:50 GMT
• Title: Explainable Temporal Attention-based Defect Detection For Fillet Joints in Real-Time Gas Metal Arc Welding Based on Multi-modal Data
• Abstract summary: This paper proposes a multi modal temporal attention based deep learning defect detection model for internal defects.<n>The model is trained on collected welding images and sound data from an industrial collaborative welding robot.<n>We use explainable Artificial Intelligence to interpret the proposed models behavior and dataset distribution.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep learning is an efficient technique to monitor the real time welding process, reducing post-welding repairs and production delays. This paper leverages the monitoring capability by proposing a multi modal temporal attention based deep learning defect detection model for internal defects that are challenging to detect, including porosity, lack of penetration and fusion, undercut, and cold lap during Gas Metal Arc Welding in fillet joints. The model is trained on collected welding images and sound data from an industrial collaborative welding robot. The results show that the attention module can improve the F1 Score to 0.99. We use explainable Artificial Intelligence to interpret the proposed models behavior and dataset distribution, determining potential important areas in image and sound spectrograms and preferred modality to detect each defect. This improves trust and reliability in Artificial Intelligence driven welding inspection.

Related papers

• A multi-task spatiotemporal deep neural network for predicting penetration depth and morphology in laser welding [5.363800671164204]
  This paper introduces the innovative deep learning model that can predict penetration state, depth, and seam morphology with high accuracy.<n>The monitoring platform relies on captured weld images during the laser welding process.<n>Prediction accuracy for penetration state can reach 99.35%, while prediction error for penetration depth is 1.79 millimeter.
  arXiv  Detail & Related papers  (2026-06-24T18:02:53Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models.<n>In this paper, we investigate how detection performance varies across model backbones, types, and datasets.<n>We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Scalable AI Framework for Defect Detection in Metal Additive Manufacturing [2.303463009749888]
  We leverage convolutional neural networks (CNN) to analyze thermal images of printed layers, automatically identifying anomalies that impact these properties. Our work integrates these models in the CLoud ADditive MAnufacturing (CLADMA) module to enhance their accessibility and practicality for AM applications.
  arXiv  Detail & Related papers  (2024-11-01T18:17:59Z)
• Unsupervised Welding Defect Detection Using Audio And Video [1.517355052203938]
  We describe how deep-learning methods can be applied to detect weld defects in real-time by recording the welding process with microphones and a camera. All deep learning models are trained in an unsupervised fashion because the space of possible defects is large. We demonstrate that a reliable real-time detection of most categories of weld defects is feasible both from audio and video.
  arXiv  Detail & Related papers  (2024-09-03T20:58:56Z)
• An Improved Anomaly Detection Model for Automated Inspection of Power Line Insulators [0.0]
  Inspection of insulators is important to ensure reliable operation of the power system. Deep learning is being increasingly exploited to automate the inspection process. This article proposes the use of anomaly detection along with object detection in a two-stage approach for incipient fault detection.
  arXiv  Detail & Related papers  (2023-11-14T11:36:20Z)
• ImDiffusion: Imputed Diffusion Models for Multivariate Time Series Anomaly Detection [44.21198064126152]
  We propose a novel anomaly detection framework named ImDiffusion. ImDiffusion combines time series imputation and diffusion models to achieve accurate and robust anomaly detection. We evaluate the performance of ImDiffusion via extensive experiments on benchmark datasets.
  arXiv  Detail & Related papers  (2023-07-03T04:57:40Z)
• Graph Neural Networks with Trainable Adjacency Matrices for Fault Diagnosis on Multivariate Sensor Data [69.25738064847175]
  It is necessary to consider the behavior of the signals in each sensor separately, to take into account their correlation and hidden relationships with each other. The graph nodes can be represented as data from the different sensors, and the edges can display the influence of these data on each other. It was proposed to construct a graph during the training of graph neural network. This allows to train models on data where the dependencies between the sensors are not known in advance.
  arXiv  Detail & Related papers  (2022-10-20T11:03:21Z)
• Ranking-Based Physics-Informed Line Failure Detection in Power Grids [66.0797334582536]
  Real-time and accurate detecting of potential line failures is the first step to mitigating the extreme weather impact and activating emergency controls. Power balance equations nonlinearity, increased uncertainty in generation during extreme events, and lack of grid observability compromise the efficiency of traditional data-driven failure detection methods. This paper proposes a Physics-InformEd Line failure Detector (FIELD) that leverages grid topology information to reduce sample and time complexities and improve localization accuracy.
  arXiv  Detail & Related papers  (2022-08-31T18:19:25Z)
• Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
  We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold. We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples. We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
  arXiv  Detail & Related papers  (2022-06-23T14:16:30Z)
• ReDFeat: Recoupling Detection and Description for Multimodal Feature Learning [51.07496081296863]
  We recouple independent constraints of detection and description of multimodal feature learning with a mutual weighting strategy. We propose a detector that possesses a large receptive field and is equipped with learnable non-maximum suppression layers. We build a benchmark that contains cross visible, infrared, near-infrared and synthetic aperture radar image pairs for evaluating the performance of features in feature matching and image registration tasks.
  arXiv  Detail & Related papers  (2022-05-16T04:24:22Z)
• Deep Learning Based Steel Pipe Weld Defect Detection [0.0]
  State-of-the-art single-stage object detection algorithm YOLOv5 is proposed to be applied to the field of steel pipe weld defect detection. The experimental results show that applying YOLOv5 to steel pipe weld defect detection can greatly improve the accuracy, complete the multi-classification task, and meet the criteria of real-time detection.
  arXiv  Detail & Related papers  (2021-04-30T11:15:13Z)
• Classification of Spot-welded Joints in Laser Thermography Data using Convolutional Neural Networks [52.661521064098416]
  We propose an approach for quality inspection of spot weldings using images from laser thermography data. We use convolutional neural networks to classify weld quality and compare the performance of different models against each other.
  arXiv  Detail & Related papers  (2020-10-24T20:38:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.