Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

• URL: http://arxiv.org/abs/2408.10710v1
• Date: Tue, 20 Aug 2024 10:24:59 GMT
• Title: Coarse-to-Fine Detection of Multiple Seams for Robotic Welding
• Authors: Pengkun Wei, Shuo Cheng, Dayou Li, Ran Song, Yipeng Zhang, Wei Zhang,
• Abstract summary: This paper proposes the framework used to obtain the region of interest by approximately localizing the weld seams. The results showcase the potential for real-world industrial applications.
• Score: 24.367563906633357
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Efficiently detecting target weld seams while ensuring sub-millimeter accuracy has always been an important challenge in autonomous welding, which has significant application in industrial practice. Previous works mostly focused on recognizing and localizing welding seams one by one, leading to inferior efficiency in modeling the workpiece. This paper proposes a novel framework capable of multiple weld seams extraction using both RGB images and 3D point clouds. The RGB image is used to obtain the region of interest by approximately localizing the weld seams, and the point cloud is used to achieve the fine-edge extraction of the weld seams within the region of interest using region growth. Our method is further accelerated by using a pre-trained deep learning model to ensure both efficiency and generalization ability. The performance of the proposed method has been comprehensively tested on various workpieces featuring both linear and curved weld seams and in physical experiment systems. The results showcase considerable potential for real-world industrial applications, emphasizing the method's efficiency and effectiveness. Videos of the real-world experiments can be found at https://youtu.be/pq162HSP2D4.

Related papers

• Unsupervised Welding Defect Detection Using Audio And Video [1.517355052203938]
  We describe how deep-learning methods can be applied to detect weld defects in real-time by recording the welding process with microphones and a camera. All deep learning models are trained in an unsupervised fashion because the space of possible defects is large. We demonstrate that a reliable real-time detection of most categories of weld defects is feasible both from audio and video.
  arXiv  Detail & Related papers  (2024-09-03T20:58:56Z)
• Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition [53.359383163184425]
  We introduce a novel multimodality synergistic knowledge distillation scheme tailored for efficient single-eye motion recognition tasks. This method allows a lightweight, unimodal student spiking neural network (SNN) to extract rich knowledge from an event-frame multimodal teacher network.
  arXiv  Detail & Related papers  (2024-06-20T07:24:47Z)
• Inter-slice Super-resolution of Magnetic Resonance Images by Pre-training and Self-supervised Fine-tuning [49.197385954021456]
  In clinical practice, 2D magnetic resonance (MR) sequences are widely adopted. While individual 2D slices can be stacked to form a 3D volume, the relatively large slice spacing can pose challenges for visualization and subsequent analysis tasks. To reduce slice spacing, deep-learning-based super-resolution techniques are widely investigated. Most current solutions require a substantial number of paired high-resolution and low-resolution images for supervised training, which are typically unavailable in real-world scenarios.
  arXiv  Detail & Related papers  (2024-06-10T02:20:26Z)
• Investigating the ability of deep learning to predict Welding Depth and Pore Volume in Hairpin Welding [0.0]
  This study presents a deep learning model that enables the prediction of two critical welds' Key Performance Characteristics (KPCs): welding depth and average pore volume. Applying DL networks to the small numerical experimental hairpin welding dataset has shown promising results.
  arXiv  Detail & Related papers  (2023-12-04T03:38:17Z)
• Towards Generalizable Deepfake Detection by Primary Region Regularization [52.41801719896089]
  This paper enhances the generalization capability from a novel regularization perspective. Our method consists of two stages, namely the static localization for primary region maps, and the dynamic exploitation of primary region masks. We conduct extensive experiments over three widely used deepfake datasets - DFDC, DF-1.0, and Celeb-DF with five backbones.
  arXiv  Detail & Related papers  (2023-07-24T05:43:34Z)
• GPU-Accelerated Machine Learning in Non-Orthogonal Multiple Access [71.58925117604039]
  Non-orthogonal multiple access (NOMA) is an interesting technology that enables massive connectivity as required in future 5G and 6G networks. We propose a neural network architecture that combines the advantages of both linear and non-linear processing.
  arXiv  Detail & Related papers  (2022-06-13T09:38:23Z)
• Deep Learning Based Steel Pipe Weld Defect Detection [0.0]
  State-of-the-art single-stage object detection algorithm YOLOv5 is proposed to be applied to the field of steel pipe weld defect detection. The experimental results show that applying YOLOv5 to steel pipe weld defect detection can greatly improve the accuracy, complete the multi-classification task, and meet the criteria of real-time detection.
  arXiv  Detail & Related papers  (2021-04-30T11:15:13Z)
• Classification of Spot-welded Joints in Laser Thermography Data using Convolutional Neural Networks [52.661521064098416]
  We propose an approach for quality inspection of spot weldings using images from laser thermography data. We use convolutional neural networks to classify weld quality and compare the performance of different models against each other.
  arXiv  Detail & Related papers  (2020-10-24T20:38:12Z)
• Knowing Depth Quality In Advance: A Depth Quality Assessment Method For RGB-D Salient Object Detection [53.603301314081826]
  We propose a simple yet effective scheme to measure D quality in advance. The proposed D quality measurement method achieves steady performance improvements for almost 2.0% in general.
  arXiv  Detail & Related papers  (2020-08-07T10:52:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.