PAEDID: Patch Autoencoder Based Deep Image Decomposition For Pixel-level Defective Region Segmentation

• URL: http://arxiv.org/abs/2203.14457v1
• Date: Mon, 28 Mar 2022 02:50:06 GMT
• Title: PAEDID: Patch Autoencoder Based Deep Image Decomposition For Pixel-level Defective Region Segmentation
• Authors: Shancong Mou, Meng Cao, Haoping Bai, Ping Huang, Jianjun Shi and Jiulong Shan
• Abstract summary: Unsupervised patch autoencoder based deep image decomposition (PAEDID) method for defective region segmentation is presented. We learn the common background as a deep image prior by a patch autoencoder (PAE) network. By adopting the proposed approach, the defective regions in the image can be accurately extracted in an unsupervised fashion.
• Score: 16.519583839906904
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Unsupervised pixel-level defective region segmentation is an important task in image-based anomaly detection for various industrial applications. The state-of-the-art methods have their own advantages and limitations: matrix-decomposition-based methods are robust to noise but lack complex background image modeling capability; representation-based methods are good at defective region localization but lack accuracy in defective region shape contour extraction; reconstruction-based methods detected defective region match well with the ground truth defective region shape contour but are noisy. To combine the best of both worlds, we present an unsupervised patch autoencoder based deep image decomposition (PAEDID) method for defective region segmentation. In the training stage, we learn the common background as a deep image prior by a patch autoencoder (PAE) network. In the inference stage, we formulate anomaly detection as an image decomposition problem with the deep image prior and domain-specific regularizations. By adopting the proposed approach, the defective regions in the image can be accurately extracted in an unsupervised fashion. We demonstrate the effectiveness of the PAEDID method in simulation studies and an industrial dataset in the case study.

Related papers

• A 2D Sinogram-Based Approach to Defect Localization in Computed Tomography [3.4916237834391874]
  We present a comprehensive three-step deep learning algorithm to identify and analyze defects within objects without resorting to image reconstruction. Our method achieves the Intersection over Union of 92.02% on our simulated data, with an average position error of 1.3 pixels for defect detection on a 512-pixel-wide detector.
  arXiv  Detail & Related papers  (2024-01-29T12:20:26Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• Pixel-Inconsistency Modeling for Image Manipulation Localization [63.54342601757723]
  Digital image forensics plays a crucial role in image authentication and manipulation localization. This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts. Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
  arXiv  Detail & Related papers  (2023-09-30T02:54:51Z)
• RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detection [18.10039647382319]
  We propose a Robust GAN-inversion (RGI) method with a provable robustness guarantee to achieve image restoration under unknown textitgross corruptions. We show that the restored image and the identified corrupted region mask convergeally to the ground truth. The proposed RGI/R-RGI method unifies two important applications with state-of-the-art (SOTA) performance.
  arXiv  Detail & Related papers  (2023-02-24T05:43:03Z)
• Exploring Resolution and Degradation Clues as Self-supervised Signal for Low Quality Object Detection [77.3530907443279]
  We propose a novel self-supervised framework to detect objects in degraded low resolution images. Our methods has achieved superior performance compared with existing methods when facing variant degradation situations.
  arXiv  Detail & Related papers  (2022-08-05T09:36:13Z)
• Spatially-Adaptive Image Restoration using Distortion-Guided Networks [51.89245800461537]
  We present a learning-based solution for restoring images suffering from spatially-varying degradations. We propose SPAIR, a network design that harnesses distortion-localization information and dynamically adjusts to difficult regions in the image.
  arXiv  Detail & Related papers  (2021-08-19T11:02:25Z)
• Reference-based Defect Detection Network [57.89399576743665]
  The first issue is the texture shift which means a trained defect detector model will be easily affected by unseen texture. The second issue is partial visual confusion which indicates that a partial defect box is visually similar with a complete box. We propose a Reference-based Defect Detection Network (RDDN) to tackle these two problems.
  arXiv  Detail & Related papers  (2021-08-10T05:44:23Z)
• Inpainting Transformer for Anomaly Detection [0.0]
  Inpainting Transformer (InTra) is trained to inpaint covered patches in a large sequence of image patches. InTra achieves better than state-of-the-art results on the MVTec AD dataset for detection and localization.
  arXiv  Detail & Related papers  (2021-04-28T17:27:44Z)
• CutPaste: Self-Supervised Learning for Anomaly Detection and Localization [59.719925639875036]
  We propose a framework for building anomaly detectors using normal training data only. We first learn self-supervised deep representations and then build a generative one-class classifier on learned representations. Our empirical study on MVTec anomaly detection dataset demonstrates the proposed algorithm is general to be able to detect various types of real-world defects.
  arXiv  Detail & Related papers  (2021-04-08T19:04:55Z)
• DFR: Deep Feature Reconstruction for Unsupervised Anomaly Segmentation [24.52418722578279]
  This paper proposes an effective unsupervised anomaly segmentation approach. It can detect and segment out the anomalies in small and confined regions of images. It advances the state-of-the-art performances on several benchmark datasets.
  arXiv  Detail & Related papers  (2020-12-13T18:30:51Z)
• Few-Shot Defect Segmentation Leveraging Abundant Normal Training Samples Through Normal Background Regularization and Crop-and-Paste Operation [4.626338154327536]
  In industrial inspection tasks, it is common to capture abundant defect-free image samples but very limited anomalous ones. This paper tackles the challenging few-shot defect segmentation task with sufficient normal (defect-free) training images but very few anomalous ones. We present two effective regularization techniques via incorporating abundant defect-free images into the training of a UNet-like encoder-decoder defect segmentation network.
  arXiv  Detail & Related papers  (2020-07-18T14:15:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.