G2D: Generate to Detect Anomaly
- URL: http://arxiv.org/abs/2006.11629v2
- Date: Sat, 27 Jun 2020 18:18:52 GMT
- Title: G2D: Generate to Detect Anomaly
- Authors: Masoud Pourreza, Bahram Mohammadi, Mostafa Khaki, Samir Bouindour,
Hichem Snoussi, Mohammad Sabokrou
- Abstract summary: We learn two deep neural networks (generator and discriminator) in a GAN-style setting on merely the normal samples.
In the training phase, when the generator fails to produce normal data, it can be considered as an irregularity generator.
We train a binary classifier on the generated anomalous samples along with the normal instances in order to be capable of detecting irregularities.
- Score: 10.977404378308817
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we propose a novel method for irregularity detection. Previous
researches solve this problem as a One-Class Classification (OCC) task where
they train a reference model on all of the available samples. Then, they
consider a test sample as an anomaly if it has a diversion from the reference
model. Generative Adversarial Networks (GANs) have achieved the most promising
results for OCC while implementing and training such networks, especially for
the OCC task, is a cumbersome and computationally expensive procedure. To cope
with the mentioned challenges, we present a simple but effective method to
solve the irregularity detection as a binary classification task in order to
make the implementation easier along with improving the detection performance.
We learn two deep neural networks (generator and discriminator) in a GAN-style
setting on merely the normal samples. During training, the generator gradually
becomes an expert to generate samples which are similar to the normal ones. In
the training phase, when the generator fails to produce normal data (in the
early stages of learning and also prior to the complete convergence), it can be
considered as an irregularity generator. In this way, we simultaneously
generate the irregular samples. Afterward, we train a binary classifier on the
generated anomalous samples along with the normal instances in order to be
capable of detecting irregularities. The proposed framework applies to
different related applications of outlier and anomaly detection in images and
videos, respectively. The results confirm that our proposed method is superior
to the baseline and state-of-the-art solutions.
Related papers
- Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image.
In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting.
Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
arXiv Detail & Related papers (2023-11-27T13:14:06Z) - Normality Learning-based Graph Anomaly Detection via Multi-Scale
Contrastive Learning [61.57383634677747]
Graph anomaly detection (GAD) has attracted increasing attention in machine learning and data mining.
Here, we propose a normality learning-based GAD framework via multi-scale contrastive learning networks (NLGAD for abbreviation)
Notably, the proposed algorithm improves the detection performance (up to 5.89% AUC gain) compared with the state-of-the-art methods.
arXiv Detail & Related papers (2023-09-12T08:06:04Z) - Spot The Odd One Out: Regularized Complete Cycle Consistent Anomaly Detector GAN [4.5123329001179275]
This study presents an adversarial method for anomaly detection in real-world applications, leveraging the power of generative adversarial neural networks (GANs)
Previous methods suffer from the high variance between class-wise accuracy which leads to not being applicable for all types of anomalies.
The proposed method named RCALAD tries to solve this problem by introducing a novel discriminator to the structure, which results in a more efficient training process.
arXiv Detail & Related papers (2023-04-16T13:05:39Z) - Augment to Detect Anomalies with Continuous Labelling [10.646747658653785]
Anomaly detection is to recognize samples that differ in some respect from the training observations.
Recent state-of-the-art deep learning-based anomaly detection methods suffer from high computational cost, complexity, unstable training procedures, and non-trivial implementation.
We leverage a simple learning procedure that trains a lightweight convolutional neural network, reaching state-of-the-art performance in anomaly detection.
arXiv Detail & Related papers (2022-07-03T20:11:51Z) - Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold.
We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples.
We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
arXiv Detail & Related papers (2022-06-23T14:16:30Z) - Training a Bidirectional GAN-based One-Class Classifier for Network
Intrusion Detection [8.158224495708978]
Existing generative adversarial networks (GANs) are primarily used for creating synthetic samples from reals.
In our proposed method, we construct the trained encoder-discriminator as a one-class classifier based on Bidirectional GAN (Bi-GAN)
Our experimental result illustrates that our proposed method is highly effective to be used in network intrusion detection tasks.
arXiv Detail & Related papers (2022-02-02T23:51:11Z) - Dual-encoder Bidirectional Generative Adversarial Networks for Anomaly
Detection [0.0]
We develop a dual-encoder in a bidirectional GAN architecture that is trained simultaneously with a generator and a discriminator network.
We show that our proposed method performs well in capturing the distribution of normal samples, thereby improving anomaly detection on GAN-based models.
arXiv Detail & Related papers (2020-12-22T05:05:33Z) - Understanding Classifier Mistakes with Generative Models [88.20470690631372]
Deep neural networks are effective on supervised learning tasks, but have been shown to be brittle.
In this paper, we leverage generative models to identify and characterize instances where classifiers fail to generalize.
Our approach is agnostic to class labels from the training set which makes it applicable to models trained in a semi-supervised way.
arXiv Detail & Related papers (2020-10-05T22:13:21Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z) - Old is Gold: Redefining the Adversarially Learned One-Class Classifier
Training Paradigm [15.898383112569237]
A popular method for anomaly detection is to use the generator of an adversarial network to formulate anomaly scores.
We propose a framework that effectively generates stable results across a wide range of training steps.
Our model achieves a frame-level AUC of 98.1%, surpassing recent state-of-the-art methods.
arXiv Detail & Related papers (2020-04-16T13:48:58Z) - Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction.
We put forward an alternative measure of anomaly score to replace the reconstruction-based metric.
Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
arXiv Detail & Related papers (2020-03-24T08:26:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.