Novel Applications for VAE-based Anomaly Detection Systems
- URL: http://arxiv.org/abs/2204.12577v1
- Date: Tue, 26 Apr 2022 20:30:37 GMT
- Title: Novel Applications for VAE-based Anomaly Detection Systems
- Authors: Luca Bergamin, Tommaso Carraro, Mirko Polato, Fabio Aiolli
- Abstract summary: Deep generative modeling (DGM) can create novel and unseen data, starting from a given data set.
As the technology shows promising applications, many ethical issues also arise.
Research indicates different biases affect deep learning models, leading to social issues such as misrepresentation.
- Score: 5.065947993017157
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The recent rise in deep learning technologies fueled innovation and boosted
scientific research. Their achievements enabled new research directions for
deep generative modeling (DGM), an increasingly popular approach that can
create novel and unseen data, starting from a given data set. As the technology
shows promising applications, many ethical issues also arise. For example,
their misuse can enable disinformation campaigns and powerful phishing
attempts. Research also indicates different biases affect deep learning models,
leading to social issues such as misrepresentation. In this work, we formulate
a novel setting to deal with similar problems, showing that a repurposed
anomaly detection system effectively generates novel data, avoiding generating
specified unwanted data. We propose Variational Auto-encoding Binary
Classifiers (V-ABC): a novel model that repurposes and extends the
Auto-encoding Binary Classifier (ABC) anomaly detector, using the Variational
Auto-encoder (VAE). We survey the limitations of existing approaches and
explore many tools to show the model's inner workings in an interpretable way.
This proposal has excellent potential for generative applications: models that
rely on user-generated data could automatically filter out unwanted content,
such as offensive language, obscene images, and misleading information.
Related papers
- CableInspect-AD: An Expert-Annotated Anomaly Detection Dataset [14.246172794156987]
$textitCableInspect-AD$ is a high-quality dataset created and annotated by domain experts from Hydro-Qu'ebec, a Canadian public utility.
This dataset includes high-resolution images with challenging real-world anomalies, covering defects with varying severity levels.
We present a comprehensive evaluation protocol based on cross-validation to assess models' performances.
arXiv Detail & Related papers (2024-09-30T14:50:13Z) - A Comprehensive Library for Benchmarking Multi-class Visual Anomaly Detection [52.228708947607636]
This paper introduces a comprehensive visual anomaly detection benchmark, ADer, which is a modular framework for new methods.
The benchmark includes multiple datasets from industrial and medical domains, implementing fifteen state-of-the-art methods and nine comprehensive metrics.
We objectively reveal the strengths and weaknesses of different methods and provide insights into the challenges and future directions of multi-class visual anomaly detection.
arXiv Detail & Related papers (2024-06-05T13:40:07Z) - AnomalyLLM: Few-shot Anomaly Edge Detection for Dynamic Graphs using Large Language Models [19.36513465638031]
AnomalyLLM is an in-context learning framework that integrates the information of a few labeled samples to achieve few-shot anomaly detection.
Experiments on four datasets reveal that AnomalyLLM can not only significantly improve the performance of few-shot anomaly detection, but also achieve superior results on new anomalies without any update of model parameters.
arXiv Detail & Related papers (2024-05-13T10:37:50Z) - Zero-shot Retrieval: Augmenting Pre-trained Models with Search Engines [83.65380507372483]
Large pre-trained models can dramatically reduce the amount of task-specific data required to solve a problem, but they often fail to capture domain-specific nuances out of the box.
This paper shows how to leverage recent advances in NLP and multi-modal learning to augment a pre-trained model with search engine retrieval.
arXiv Detail & Related papers (2023-11-29T05:33:28Z) - Language Models for Novelty Detection in System Call Traces [0.27309692684728604]
This paper introduces a novelty detection methodology that relies on a probability distribution over sequences of system calls.
The proposed methodology requires minimal expert hand-crafting and achieves an F-score and AuROC greater than 95% on most novelties.
The source code and trained models are publicly available on GitHub while the datasets are available on Zenodo.
arXiv Detail & Related papers (2023-09-05T13:11:40Z) - AES Systems Are Both Overstable And Oversensitive: Explaining Why And
Proposing Defenses [66.49753193098356]
We investigate the reason behind the surprising adversarial brittleness of scoring models.
Our results indicate that autoscoring models, despite getting trained as "end-to-end" models, behave like bag-of-words models.
We propose detection-based protection models that can detect oversensitivity and overstability causing samples with high accuracies.
arXiv Detail & Related papers (2021-09-24T03:49:38Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - Open Set Recognition with Conditional Probabilistic Generative Models [51.40872765917125]
We propose Conditional Probabilistic Generative Models (CPGM) for open set recognition.
CPGM can detect unknown samples but also classify known classes by forcing different latent features to approximate conditional Gaussian distributions.
Experiment results on multiple benchmark datasets reveal that the proposed method significantly outperforms the baselines.
arXiv Detail & Related papers (2020-08-12T06:23:49Z) - Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction.
We put forward an alternative measure of anomaly score to replace the reconstruction-based metric.
Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
arXiv Detail & Related papers (2020-03-24T08:26:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.