AD-MERCS: Modeling Normality and Abnormality in Unsupervised Anomaly
Detection
- URL: http://arxiv.org/abs/2305.12958v1
- Date: Mon, 22 May 2023 12:09:14 GMT
- Title: AD-MERCS: Modeling Normality and Abnormality in Unsupervised Anomaly
Detection
- Authors: Jonas Soenen, Elia Van Wolputte, Vincent Vercruyssen, Wannes Meert,
and Hendrik Blockeel
- Abstract summary: We present AD-MERCS, an unsupervised approach to anomaly detection that explicitly aims at doing both.
AD-MERCS identifies multiple subspaces of the instance space within which patterns exist, and identifies conditions that characterize instances that deviate from these patterns.
Experiments show that this modeling of both normality and abnormality makes the anomaly detector performant on a wide range of types of anomalies.
- Score: 12.070251470948772
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Most anomaly detection systems try to model normal behavior and assume
anomalies deviate from it in diverse manners. However, there may be patterns in
the anomalies as well. Ideally, an anomaly detection system can exploit
patterns in both normal and anomalous behavior. In this paper, we present
AD-MERCS, an unsupervised approach to anomaly detection that explicitly aims at
doing both. AD-MERCS identifies multiple subspaces of the instance space within
which patterns exist, and identifies conditions (possibly in other subspaces)
that characterize instances that deviate from these patterns. Experiments show
that this modeling of both normality and abnormality makes the anomaly detector
performant on a wide range of types of anomalies. Moreover, by identifying
patterns and conditions in (low-dimensional) subspaces, the anomaly detector
can provide simple explanations of why something is considered an anomaly.
These explanations can be both negative (deviation from some pattern) as
positive (meeting some condition that is typical for anomalies).
Related papers
- Generating and Reweighting Dense Contrastive Patterns for Unsupervised
Anomaly Detection [59.34318192698142]
We introduce a prior-less anomaly generation paradigm and develop an innovative unsupervised anomaly detection framework named GRAD.
PatchDiff effectively expose various types of anomaly patterns.
experiments on both MVTec AD and MVTec LOCO datasets also support the aforementioned observation.
arXiv Detail & Related papers (2023-12-26T07:08:06Z) - Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detection [26.08881235151695]
Open-set supervised anomaly detection (OSAD) aims at utilizing a few samples of anomaly classes seen during training to detect unseen anomalies.
We introduce a novel approach, namely Anomaly Heterogeneity Learning (AHL), that simulates a diverse set of heterogeneous anomaly distributions.
We show that AHL can 1) substantially enhance different state-of-the-art OSAD models in detecting seen and unseen anomalies, and 2) effectively generalize to unseen anomalies in new domains.
arXiv Detail & Related papers (2023-10-19T14:47:11Z) - Prototypical Residual Networks for Anomaly Detection and Localization [80.5730594002466]
We propose a framework called Prototypical Residual Network (PRN)
PRN learns feature residuals of varying scales and sizes between anomalous and normal patterns to accurately reconstruct the segmentation maps of anomalous regions.
We present a variety of anomaly generation strategies that consider both seen and unseen appearance variance to enlarge and diversify anomalies.
arXiv Detail & Related papers (2022-12-05T05:03:46Z) - Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for
Supervised Anomaly Detection [14.27685411466415]
Most anomaly detection (AD) models are learned using only normal samples in an unsupervised way.
We propose a novel explicit boundary guided semi-push-pull contrastive learning mechanism.
arXiv Detail & Related papers (2022-07-04T14:50:23Z) - Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data.
We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism.
We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
arXiv Detail & Related papers (2022-06-30T06:00:13Z) - Catching Both Gray and Black Swans: Open-set Supervised Anomaly
Detection [90.32910087103744]
A few labeled anomaly examples are often available in many real-world applications.
These anomaly examples provide valuable knowledge about the application-specific abnormality.
Those anomalies seen during training often do not illustrate every possible class of anomaly.
This paper tackles open-set supervised anomaly detection.
arXiv Detail & Related papers (2022-03-28T05:21:37Z) - Variation and generality in encoding of syntactic anomaly information in
sentence embeddings [7.132368785057315]
We explore fine-grained differences in anomaly encoding by designing probing tasks that vary the hierarchical level at which anomalies occur in a sentence.
We test not only models' ability to detect a given anomaly, but also the generality of the detected anomaly signal.
Results suggest that all models encode some information supporting anomaly detection, but detection performance varies between anomalies.
arXiv Detail & Related papers (2021-11-12T10:23:43Z) - Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
We introduce a novel weakly-supervised anomaly detection framework to train detection models.
The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability.
Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
arXiv Detail & Related papers (2021-08-01T14:33:17Z) - Deep Weakly-supervised Anomaly Detection [118.55172352231381]
Pairwise Relation prediction Network (PReNet) learns pairwise relation features and anomaly scores.
PReNet can detect any seen/unseen abnormalities that fit the learned pairwise abnormal patterns.
Empirical results on 12 real-world datasets show that PReNet significantly outperforms nine competing methods in detecting seen and unseen anomalies.
arXiv Detail & Related papers (2019-10-30T00:40:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.