AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model
- URL: http://arxiv.org/abs/2312.05767v2
- Date: Thu, 22 Feb 2024 02:54:11 GMT
- Title: AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model
- Authors: Teng Hu, Jiangning Zhang, Ran Yi, Yuzhen Du, Xu Chen, Liang Liu,
Yabiao Wang, Chengjie Wang
- Abstract summary: Anomaly inspection plays an important role in industrial manufacture.
Existing anomaly inspection methods are limited in their performance due to insufficient anomaly data.
We propose AnomalyDiffusion, a novel diffusion-based few-shot anomaly generation model.
- Score: 59.08735812631131
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Anomaly inspection plays an important role in industrial manufacture.
Existing anomaly inspection methods are limited in their performance due to
insufficient anomaly data. Although anomaly generation methods have been
proposed to augment the anomaly data, they either suffer from poor generation
authenticity or inaccurate alignment between the generated anomalies and masks.
To address the above problems, we propose AnomalyDiffusion, a novel
diffusion-based few-shot anomaly generation model, which utilizes the strong
prior information of latent diffusion model learned from large-scale dataset to
enhance the generation authenticity under few-shot training data. Firstly, we
propose Spatial Anomaly Embedding, which consists of a learnable anomaly
embedding and a spatial embedding encoded from an anomaly mask, disentangling
the anomaly information into anomaly appearance and location information.
Moreover, to improve the alignment between the generated anomalies and the
anomaly masks, we introduce a novel Adaptive Attention Re-weighting Mechanism.
Based on the disparities between the generated anomaly image and normal sample,
it dynamically guides the model to focus more on the areas with less noticeable
generated anomalies, enabling generation of accurately-matched anomalous
image-mask pairs. Extensive experiments demonstrate that our model
significantly outperforms the state-of-the-art methods in generation
authenticity and diversity, and effectively improves the performance of
downstream anomaly inspection tasks. The code and data are available in
https://github.com/sjtuplayer/anomalydiffusion.
Related papers
- DualAnoDiff: Dual-Interrelated Diffusion Model for Few-Shot Anomaly Image Generation [40.257604426546216]
The performance of anomaly inspection in industrial manufacturing is constrained by the scarcity of anomaly data.
Existing anomaly generation methods suffer from limited diversity in the generated anomalies.
We propose DualAnoDiff, a novel diffusion-based few-shot anomaly image generation model.
arXiv Detail & Related papers (2024-08-24T08:09:32Z) - GLAD: Towards Better Reconstruction with Global and Local Adaptive Diffusion Models for Unsupervised Anomaly Detection [60.78684630040313]
Diffusion models tend to reconstruct normal counterparts of test images with certain noises added.
From the global perspective, the difficulty of reconstructing images with different anomalies is uneven.
We propose a global and local adaptive diffusion model (abbreviated to GLAD) for unsupervised anomaly detection.
arXiv Detail & Related papers (2024-06-11T17:27:23Z) - Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image.
In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting.
Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
arXiv Detail & Related papers (2023-11-27T13:14:06Z) - Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detection [26.08881235151695]
Open-set supervised anomaly detection (OSAD) aims at utilizing a few samples of anomaly classes seen during training to detect unseen anomalies.
We introduce a novel approach, namely Anomaly Heterogeneity Learning (AHL), that simulates a diverse set of heterogeneous anomaly distributions.
We show that AHL can 1) substantially enhance different state-of-the-art OSAD models in detecting seen and unseen anomalies, and 2) effectively generalize to unseen anomalies in new domains.
arXiv Detail & Related papers (2023-10-19T14:47:11Z) - SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detection [24.43321988051129]
We propose a novel saliency-guided data augmentation method, SaliencyCut, to produce pseudo but more common anomalies.
We then design a novel patch-wise residual module in the anomaly learning head to extract and assess the fine-grained anomaly features from each sample.
arXiv Detail & Related papers (2023-06-14T08:55:36Z) - The role of noise in denoising models for anomaly detection in medical
images [62.0532151156057]
Pathological brain lesions exhibit diverse appearance in brain images.
Unsupervised anomaly detection approaches have been proposed using only normal data for training.
We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
arXiv Detail & Related papers (2023-01-19T21:39:38Z) - Prototypical Residual Networks for Anomaly Detection and Localization [80.5730594002466]
We propose a framework called Prototypical Residual Network (PRN)
PRN learns feature residuals of varying scales and sizes between anomalous and normal patterns to accurately reconstruct the segmentation maps of anomalous regions.
We present a variety of anomaly generation strategies that consider both seen and unseen appearance variance to enlarge and diversify anomalies.
arXiv Detail & Related papers (2022-12-05T05:03:46Z) - Fast Unsupervised Brain Anomaly Detection and Segmentation with
Diffusion Models [1.6352599467675781]
We propose a method based on diffusion models to detect and segment anomalies in brain imaging.
Our diffusion models achieve competitive performance compared with autoregressive approaches across a series of experiments with 2D CT and MRI data.
arXiv Detail & Related papers (2022-06-07T17:30:43Z) - Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
We introduce a novel weakly-supervised anomaly detection framework to train detection models.
The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability.
Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
arXiv Detail & Related papers (2021-08-01T14:33:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.