Semi-Siamese Network for Robust Change Detection Across Different Domains with Applications to 3D Printing

• URL: http://arxiv.org/abs/2212.08583v2
• Date: Thu, 3 Aug 2023 03:46:30 GMT
• Title: Semi-Siamese Network for Robust Change Detection Across Different Domains with Applications to 3D Printing
• Authors: Yushuo Niu, Ethan Chadwick, Anson W. K. Ma, Qian Yang
• Abstract summary: We present a novel Semi-Siamese deep learning model for defect detection in 3D printing processes. Our model is designed to enable comparison of heterogeneous images from different domains while being robust against perturbations in the imaging setup. Using our model, defect localization predictions can be made in less than half a second per layer using a standard MacBook Pro while achieving an F1-score of more than 0.9.
• Score: 17.176767333354636
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Automatic defect detection for 3D printing processes, which shares many characteristics with change detection problems, is a vital step for quality control of 3D printed products. However, there are some critical challenges in the current state of practice. First, existing methods for computer vision-based process monitoring typically work well only under specific camera viewpoints and lighting situations, requiring expensive pre-processing, alignment, and camera setups. Second, many defect detection techniques are specific to pre-defined defect patterns and/or print schematics. In this work, we approach the defect detection problem using a novel Semi-Siamese deep learning model that directly compares a reference schematic of the desired print and a camera image of the achieved print. The model then solves an image segmentation problem, precisely identifying the locations of defects of different types with respect to the reference schematic. Our model is designed to enable comparison of heterogeneous images from different domains while being robust against perturbations in the imaging setup such as different camera angles and illumination. Crucially, we show that our simple architecture, which is easy to pre-train for enhanced performance on new datasets, outperforms more complex state-of-the-art approaches based on generative adversarial networks and transformers. Using our model, defect localization predictions can be made in less than half a second per layer using a standard MacBook Pro while achieving an F1-score of more than 0.9, demonstrating the efficacy of using our method for in-situ defect detection in 3D printing.

Related papers

• Neural Real-Time Recalibration for Infrared Multi-Camera Systems [2.249916681499244]
  There are no learning-free or neural techniques for real-time recalibration of infrared multi-camera systems. We propose a neural network-based method capable of dynamic real-time calibration.
  arXiv  Detail & Related papers  (2024-10-18T14:37:37Z)
• LLM-3D Print: Large Language Models To Monitor and Control 3D Printing [6.349503549199403]
  Industry 4.0 has revolutionized manufacturing by driving digitalization and shifting the paradigm toward additive manufacturing (AM) FDM, a key AM technology, enables the creation of highly customized, cost-effective products with minimal material waste through layer-by-layer extrusion. We present a process monitoring and control framework that leverages pre-trained Large Language Models (LLMs) alongside 3D printers to detect and address printing defects.
  arXiv  Detail & Related papers  (2024-08-26T14:38:19Z)
• Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
  This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
  arXiv  Detail & Related papers  (2024-03-19T09:28:19Z)
• Self-supervised Feature Adaptation for 3D Industrial Anomaly Detection [59.41026558455904]
  We focus on multi-modal anomaly detection. Specifically, we investigate early multi-modal approaches that attempted to utilize models pre-trained on large-scale visual datasets. We propose a Local-to-global Self-supervised Feature Adaptation (LSFA) method to finetune the adaptors and learn task-oriented representation toward anomaly detection.
  arXiv  Detail & Related papers  (2024-01-06T07:30:41Z)
• 3DiffTection: 3D Object Detection with Geometry-Aware Diffusion Features [70.50665869806188]
  3DiffTection is a state-of-the-art method for 3D object detection from single images. We fine-tune a diffusion model to perform novel view synthesis conditioned on a single image. We further train the model on target data with detection supervision.
  arXiv  Detail & Related papers  (2023-11-07T23:46:41Z)
• Deep Learning-Based Defect Classification and Detection in SEM Images [1.9206693386750882]
  In particular, we train RetinaNet models using different ResNet, VGGNet architectures as backbone. We propose a preference-based ensemble strategy to combine the output predictions from different models in order to achieve better performance on classification and detection of defects.
  arXiv  Detail & Related papers  (2022-06-20T16:34:11Z)
• Learning a Model-Driven Variational Network for Deformable Image Registration [89.9830129923847]
  VR-Net is a novel cascaded variational network for unsupervised deformable image registration. It outperforms state-of-the-art deep learning methods on registration accuracy. It maintains the fast inference speed of deep learning and the data-efficiency of variational model.
  arXiv  Detail & Related papers  (2021-05-25T21:37:37Z)
• A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection [93.38607559281601]
  We devise a hierarchical generative model that captures the multi-scale patch distribution of each training image. The anomaly score is obtained by aggregating the patch-based votes of the correct transformation across scales and image regions.
  arXiv  Detail & Related papers  (2021-04-29T17:49:48Z)
• Wide-angle Image Rectification: A Survey [86.36118799330802]
  wide-angle images contain distortions that violate the assumptions underlying pinhole camera models. Image rectification, which aims to correct these distortions, can solve these problems. We present a detailed description and discussion of the camera models used in different approaches. Next, we review both traditional geometry-based image rectification methods and deep learning-based methods.
  arXiv  Detail & Related papers  (2020-10-30T17:28:40Z)
• Print Defect Mapping with Semantic Segmentation [4.189639503810488]
  We propose the first end-to-end framework to map print defects at pixel level. Our framework uses Convolutional Neural Networks, specifically DeepLab-v3+, and achieves promising results.
  arXiv  Detail & Related papers  (2020-01-27T22:40:09Z)
• A Novel Inspection System For Variable Data Printing Using Deep Learning [0.9176056742068814]
  We present a novel approach for inspecting variable data prints (VDP) with an ultra-low false alarm rate (0.005%) The system is based on a comparison between two images: a reference image and an image captured by low-cost scanners.
  arXiv  Detail & Related papers  (2020-01-13T15:07:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.