TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detection

• URL: http://arxiv.org/abs/2311.09999v2
• Date: Wed, 10 Jul 2024 13:44:42 GMT
• Title: TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detection
• Authors: Matic Fučka, Vitjan Zavrtanik, Danijel Skočaj,
• Abstract summary: We propose a novel discriminative anomaly detection method that achieves state-of-the-art performance on two datasets. TransFusion achieves state-of-the-art performance on both the VisA and the MVTec AD datasets, with an image-level AUROC of 98.5% and 99.2%, respectively.
• Score: 2.7855886538423182
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Surface anomaly detection is a vital component in manufacturing inspection. Current discriminative methods follow a two-stage architecture composed of a reconstructive network followed by a discriminative network that relies on the reconstruction output. Currently used reconstructive networks often produce poor reconstructions that either still contain anomalies or lack details in anomaly-free regions. Discriminative methods are robust to some reconstructive network failures, suggesting that the discriminative network learns a strong normal appearance signal that the reconstructive networks miss. We reformulate the two-stage architecture into a single-stage iterative process that allows the exchange of information between the reconstruction and localization. We propose a novel transparency-based diffusion process where the transparency of anomalous regions is progressively increased, restoring their normal appearance accurately while maintaining the appearance of anomaly-free regions using localization cues of previous steps. We implement the proposed process as TRANSparency DifFUSION (TransFusion), a novel discriminative anomaly detection method that achieves state-of-the-art performance on both the VisA and the MVTec AD datasets, with an image-level AUROC of 98.5% and 99.2%, respectively. Code: https://github.com/MaticFuc/ECCV_TransFusion

Related papers

• Multi-feature Reconstruction Network using Crossed-mask Restoration for Unsupervised Industrial Anomaly Detection [4.742650815342744]
  Unsupervised anomaly detection is of great significance for quality inspection in industrial manufacturing. We propose a multi-feature reconstruction network, MFRNet, using crossed-mask restoration in this paper. Our method is highly competitive with or significantly outperforms other state-of-the-arts on four public available datasets and one self-made dataset.
  arXiv  Detail & Related papers  (2024-04-20T05:13:56Z)
• Produce Once, Utilize Twice for Anomaly Detection [6.501323305130114]
  We derive POUTA, which improves both the accuracy and efficiency by reusing the discriminant information potential in the reconstructive network. POUTA achieves better performance than the state-of-the-art few-shot anomaly detection methods without any special design.
  arXiv  Detail & Related papers  (2023-12-20T10:49:49Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
  This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image. In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting. Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
  arXiv  Detail & Related papers  (2023-11-27T13:14:06Z)
• Reversing the Abnormal: Pseudo-Healthy Generative Networks for Anomaly Detection [8.737589725372398]
  We introduce a novel unsupervised approach, called PHANES (Pseudo Healthy generative networks for ANomaly) Our method has the capability of reversing anomalies, preserving healthy tissue and replacing anomalous regions with pseudo-healthy reconstructions. We demonstrate the effectiveness of PHANES in detecting stroke lesions in T1w brain MRI datasets and show significant improvements over state-of-the-art (SOTA) methods.
  arXiv  Detail & Related papers  (2023-03-15T08:54:20Z)
• DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration [103.79030498369319]
  Self-supervised diffusion model for hyperspectral image restoration is proposed. textttDDS2M enjoys stronger ability to generalization compared to existing diffusion-based methods. Experiments on HSI denoising, noisy HSI completion and super-resolution on a variety of HSIs demonstrate textttDDS2M's superiority over the existing task-specific state-of-the-arts.
  arXiv  Detail & Related papers  (2023-03-12T14:57:04Z)
• Gait Cycle Reconstruction and Human Identification from Occluded Sequences [2.198430261120653]
  We propose an effective neural network-based model to reconstruct the occluded frames in an input sequence before carrying out gait recognition. We employ LSTM networks to predict an embedding for each occluded frame both from the forward and the backward directions. While the LSTMs are trained to minimize the mean-squared loss, the fusion network is trained to optimize the pixel-wise cross-entropy loss between the ground-truth and the reconstructed samples.
  arXiv  Detail & Related papers  (2022-06-20T16:04:31Z)
• Visual Attention Emerges from Recurrent Sparse Reconstruction [82.78753751860603]
  We present a new attention formulation built on two prominent features of the human visual attention mechanism: recurrency and sparsity. We show that self-attention is a special case of VARS with a single-step optimization and no sparsity constraint. VARS can be readily used as a replacement for self-attention in popular vision transformers, consistently improving their robustness across various benchmarks.
  arXiv  Detail & Related papers  (2022-04-23T00:35:02Z)
• Learning Discriminative Shrinkage Deep Networks for Image Deconvolution [122.79108159874426]
  We propose an effective non-blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms. Experimental results show that the proposed method performs favorably against the state-of-the-art ones in terms of efficiency and accuracy.
  arXiv  Detail & Related papers  (2021-11-27T12:12:57Z)
• Iterative Network for Image Super-Resolution [69.07361550998318]
  Single image super-resolution (SISR) has been greatly revitalized by the recent development of convolutional neural networks (CNN) This paper provides a new insight on conventional SISR algorithm, and proposes a substantially different approach relying on the iterative optimization. A novel iterative super-resolution network (ISRN) is proposed on top of the iterative optimization.
  arXiv  Detail & Related papers  (2020-05-20T11:11:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.