From MIM-Based GAN to Anomaly Detection:Event Probability Influence on
Generative Adversarial Networks
- URL: http://arxiv.org/abs/2203.13464v1
- Date: Fri, 25 Mar 2022 06:08:03 GMT
- Title: From MIM-Based GAN to Anomaly Detection:Event Probability Influence on
Generative Adversarial Networks
- Authors: Rui She and Pingyi Fan
- Abstract summary: In this paper, we introduce the exponential information metric into the GAN, referred to as MIM-based GAN.
We propose an anomaly detection method with MIM-based GAN, as well as explain its principle for the unsupervised learning case.
- Score: 13.599726672717827
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In order to introduce deep learning technologies into anomaly detection,
Generative Adversarial Networks (GANs) are considered as important roles in the
algorithm design and realistic applications. In terms of GANs, event
probability reflected in the objective function, has an impact on the event
generation which plays a crucial part in GAN-based anomaly detection. The
information metric, e.g. Kullback-Leibler divergence in the original GAN, makes
the objective function have different sensitivity on different event
probability, which provides an opportunity to refine GAN-based anomaly
detection by influencing data generation. In this paper, we introduce the
exponential information metric into the GAN, referred to as MIM-based GAN,
whose superior characteristics on data generation are discussed in theory.
Furthermore, we propose an anomaly detection method with MIM-based GAN, as well
as explain its principle for the unsupervised learning case from the viewpoint
of probability event generation. Since this method is promising to detect
anomalies in Internet of Things (IoT), such as environmental, medical and
biochemical outliers, we make use of several datasets from the online ODDS
repository to evaluate its performance and compare it with other methods.
Related papers
- Targeted Cause Discovery with Data-Driven Learning [66.86881771339145]
We propose a novel machine learning approach for inferring causal variables of a target variable from observations.
We employ a neural network trained to identify causality through supervised learning on simulated data.
Empirical results demonstrate the effectiveness of our method in identifying causal relationships within large-scale gene regulatory networks.
arXiv Detail & Related papers (2024-08-29T02:21:11Z) - MIM-GAN-based Anomaly Detection for Multivariate Time Series Data [7.734588574138427]
The loss function of Generative adversarial network(GAN) is an important factor that affects the quality and diversity of the generated samples for anomaly detection.
We propose an unsupervised multiple time series anomaly detection algorithm based on the GAN with message importance measure(MIM-GAN)
Experimental results show that the proposed MIM-GAN-based anomaly detection algorithm has superior performance in terms of precision, recall, and F1 score.
arXiv Detail & Related papers (2023-10-26T02:09:39Z) - Energy-based Out-of-Distribution Detection for Graph Neural Networks [76.0242218180483]
We propose a simple, powerful and efficient OOD detection model for GNN-based learning on graphs, which we call GNNSafe.
GNNSafe achieves up to $17.0%$ AUROC improvement over state-of-the-arts and it could serve as simple yet strong baselines in such an under-developed area.
arXiv Detail & Related papers (2023-02-06T16:38:43Z) - Leveraging a Probabilistic PCA Model to Understand the Multivariate
Statistical Network Monitoring Framework for Network Security Anomaly
Detection [64.1680666036655]
We revisit anomaly detection techniques based on PCA from a probabilistic generative model point of view.
We have evaluated the mathematical model using two different datasets.
arXiv Detail & Related papers (2023-02-02T13:41:18Z) - Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data.
We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism.
We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
arXiv Detail & Related papers (2022-06-30T06:00:13Z) - Learning Neural Causal Models with Active Interventions [83.44636110899742]
We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process.
Our method significantly reduces the required number of interactions compared with random intervention targeting.
We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
arXiv Detail & Related papers (2021-09-06T13:10:37Z) - Tail of Distribution GAN (TailGAN): Generative-
Adversarial-Network-Based Boundary Formation [0.0]
We create a GAN-based tail formation model for anomaly detection, the Tail of distribution GAN (TailGAN)
Using TailGAN, we leverage GANs for anomaly detection and use maximum entropy regularization.
We evaluate TailGAN for identifying Out-of-Distribution (OoD) data and its performance evaluated on MNIST, CIFAR-10, Baggage X-Ray, and OoD data shows competitiveness compared to methods from the literature.
arXiv Detail & Related papers (2021-07-24T17:29:21Z) - Multi-class Classification Based Anomaly Detection of Insider Activities [18.739091829480234]
We propose an approach that combines generative model with supervised learning to perform multi-class classification using deep learning.
The generative adversarial network (GAN) based insider detection model introduces Conditional Generative Adversarial Network (CGAN) to enrich minority class samples.
The comprehensive experiments performed on the benchmark dataset demonstrates the effectiveness of introducing GAN derived synthetic data.
arXiv Detail & Related papers (2021-02-15T00:08:39Z) - Estimating Structural Target Functions using Machine Learning and
Influence Functions [103.47897241856603]
We propose a new framework for statistical machine learning of target functions arising as identifiable functionals from statistical models.
This framework is problem- and model-agnostic and can be used to estimate a broad variety of target parameters of interest in applied statistics.
We put particular focus on so-called coarsening at random/doubly robust problems with partially unobserved information.
arXiv Detail & Related papers (2020-08-14T16:48:29Z) - MIM-Based GAN: Information Metric to Amplify Small Probability Events
Importance in Generative Adversarial Networks [13.599726672717827]
In terms of Generative Adversarial Networks (GANs), the information metric to discriminate the generative data from the real data lies in the key point of generation efficiency.
In this paper, we adopt the exponential form, referred from the information measure, i.e. MIM, to replace the logarithm form of the original GAN.
This approach is called MIM-based GAN, has better performance on networks training and rare events generation.
arXiv Detail & Related papers (2020-03-25T09:11:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.