Deep Anomaly Detection by Residual Adaptation

• URL: http://arxiv.org/abs/2010.02310v1
• Date: Mon, 5 Oct 2020 20:02:58 GMT
• Title: Deep Anomaly Detection by Residual Adaptation
• Authors: Lucas Deecke, Lukas Ruff, Robert A. Vandermeulen, Hakan Bilen
• Abstract summary: We propose a novel approach to deep anomaly detection based on augmenting large pretrained networks with residual corrections that adjusts them to the task of anomaly detection. Our method gives rise to a highly parameter-efficient learning mechanism, enhances disentanglement of representations in the pretrained model, and outperforms all existing anomaly detection methods.
• Score: 34.47788988778933
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly detection based on augmenting large pretrained networks with residual corrections that adjusts them to the task of anomaly detection. Our method gives rise to a highly parameter-efficient learning mechanism, enhances disentanglement of representations in the pretrained model, and outperforms all existing anomaly detection methods including other baselines utilizing pretrained networks. On the CIFAR-10 one-versus-rest benchmark, for example, our technique raises the state of the art from 96.1 to 99.0 mean AUC.

Related papers

• Unsupervised Anomaly Detection Using Diffusion Trend Analysis [48.19821513256158]
  We propose a method to detect anomalies by analysis of reconstruction trend depending on the degree of degradation. The proposed method is validated on an open dataset for industrial anomaly detection.
  arXiv  Detail & Related papers  (2024-07-12T01:50:07Z)
• Robust Semi-Supervised Anomaly Detection via Adversarially Learned Continuous Noise Corruption [11.135527192198092]
  Anomaly detection is the task of recognising novel samples which deviate significantly from pre-establishednormality. Deep Autoencoders (AE) have been widely used foranomaly detection tasks, but suffer from overfitting to a null identity function. We introduce an efficient methodof producing Adversarially Learned Continuous Noise (ALCN) to maximally globally corrupt the input prior to denoising.
  arXiv  Detail & Related papers  (2023-03-02T22:59:20Z)
• Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
  We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold. We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples. We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
  arXiv  Detail & Related papers  (2022-06-23T14:16:30Z)
• Simple Adaptive Projection with Pretrained Features for Anomaly Detection [0.0]
  We propose a novel adaptation framework including simple linear transformation and self-attention. Our simple adaptive projection with pretrained features(SAP2) yields a novel anomaly detection criterion.
  arXiv  Detail & Related papers  (2021-12-05T15:29:59Z)
• Robust lEarned Shrinkage-Thresholding (REST): Robust unrolling for sparse recover [87.28082715343896]
  We consider deep neural networks for solving inverse problems that are robust to forward model mis-specifications. We design a new robust deep neural network architecture by applying algorithm unfolding techniques to a robust version of the underlying recovery problem. The proposed REST network is shown to outperform state-of-the-art model-based and data-driven algorithms in both compressive sensing and radar imaging problems.
  arXiv  Detail & Related papers  (2021-10-20T06:15:45Z)
• Semantic Perturbations with Normalizing Flows for Improved Generalization [62.998818375912506]
  We show that perturbations in the latent space can be used to define fully unsupervised data augmentations. We find that our latent adversarial perturbations adaptive to the classifier throughout its training are most effective.
  arXiv  Detail & Related papers  (2021-08-18T03:20:00Z)
• Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
  We introduce a novel weakly-supervised anomaly detection framework to train detection models. The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability. Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
  arXiv  Detail & Related papers  (2021-08-01T14:33:17Z)
• Meta-learning One-class Classifiers with Eigenvalue Solvers for Supervised Anomaly Detection [55.888835686183995]
  We propose a neural network-based meta-learning method for supervised anomaly detection. We experimentally demonstrate that the proposed method achieves better performance than existing anomaly detection and few-shot learning methods.
  arXiv  Detail & Related papers  (2021-03-01T01:43:04Z)
• Towards Fair Deep Anomaly Detection [24.237000220172906]
  We propose a new architecture for the fair anomaly detection approach (Deep Fair SVDD) We show that our proposed approach can remove the unfairness largely with minimal loss on the anomaly detection performance.
  arXiv  Detail & Related papers  (2020-12-29T22:34:45Z)
• A Transfer Learning Framework for Anomaly Detection Using Model of Normality [2.9685635948299995]
  Convolutional Neural Network (CNN) techniques have proven to be very useful in image-based anomaly detection applications. We introduce a transfer learning framework for anomaly detection based on similarity measure with a Model of Normality (MoN) We show that with the proposed threshold settings, a significant performance improvement can be achieved.
  arXiv  Detail & Related papers  (2020-11-12T05:26:32Z)
• Regularized Cycle Consistent Generative Adversarial Network for Anomaly Detection [5.457279006229213]
  We propose a new Regularized Cycle Consistent Generative Adversarial Network (RCGAN) in which deep neural networks are adversarially trained to better recognize anomalous samples. Experimental results on both real-world and synthetic data show that our model leads to significant and consistent improvements on previous anomaly detection benchmarks.
  arXiv  Detail & Related papers  (2020-01-18T03:35:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.