Anomaly Detection with SDAE
- URL: http://arxiv.org/abs/2004.04391v1
- Date: Thu, 9 Apr 2020 07:22:08 GMT
- Title: Anomaly Detection with SDAE
- Authors: Benjamin Smith, Kevin Cant, Gloria Wang
- Abstract summary: A Simple, Deep, and Supervised Deep Autoencoder were trained and compared for anomaly detection over the ASHRAE building energy dataset.
The Deep Autoencoder perfoms the best, however the Supervised Deep Autoencoder outperforms the other models in total anomalies detected.
- Score: 2.9447568514391067
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Anomaly detection is a prominent data preprocessing step in learning
applications for correction and/or removal of faulty data. Automating this data
type with the use of autoencoders could increase the quality of the dataset by
isolating anomalies that were missed through manual or basic statistical
analysis. A Simple, Deep, and Supervised Deep Autoencoder were trained and
compared for anomaly detection over the ASHRAE building energy dataset. Given
the restricted parameters under which the models were trained, the Deep
Autoencoder perfoms the best, however, the Supervised Deep Autoencoder
outperforms the other models in total anomalies detected when considerations
for the test datasets are given.
Related papers
- Attention and Autoencoder Hybrid Model for Unsupervised Online Anomaly
Detection [3.6049348666007934]
This paper introduces a hybrid attention and autoencoder (AE) model for unsupervised online anomaly detection in time series.
The autoencoder captures local structural patterns in short embeddings, while the attention model learns long-term features, facilitating parallel computing with positional encoding.
It employs an attention-based mechanism, akin to the deep transformer model, with key architectural modifications for predicting the next time step window in the autoencoder's latent space.
arXiv Detail & Related papers (2024-01-06T22:55:02Z) - A Robust and Explainable Data-Driven Anomaly Detection Approach For
Power Electronics [56.86150790999639]
We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer.
The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data.
A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
arXiv Detail & Related papers (2022-09-23T06:09:35Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - Bayesian Autoencoders for Drift Detection in Industrial Environments [69.93875748095574]
Autoencoders are unsupervised models which have been used for detecting anomalies in multi-sensor environments.
Anomalies can come either from real changes in the environment (real drift) or from faulty sensory devices (virtual drift)
arXiv Detail & Related papers (2021-07-28T10:19:58Z) - Anomaly Detection Based on Multiple-Hypothesis Autoencoder [0.0]
A model trained with normal data generates a larger restoration error for abnormal data.
The restoration area for the input data of AE is limited in the latent space.
We propose Multiple-hypothesis Autoencoder(MH-AE) model composed of several decoders.
arXiv Detail & Related papers (2021-07-07T05:09:03Z) - DASVDD: Deep Autoencoding Support Vector Data Descriptor for Anomaly
Detection [9.19194451963411]
Semi-supervised anomaly detection aims to detect anomalies from normal samples using a model that is trained on normal data.
We propose a method, DASVDD, that jointly learns the parameters of an autoencoder while minimizing the volume of an enclosing hyper-sphere on its latent representation.
arXiv Detail & Related papers (2021-06-09T21:57:41Z) - ESAD: End-to-end Deep Semi-supervised Anomaly Detection [85.81138474858197]
We propose a new objective function that measures the KL-divergence between normal and anomalous data.
The proposed method significantly outperforms several state-of-the-arts on multiple benchmark datasets.
arXiv Detail & Related papers (2020-12-09T08:16:35Z) - Contextual-Bandit Anomaly Detection for IoT Data in Distributed
Hierarchical Edge Computing [65.78881372074983]
IoT devices can hardly afford complex deep neural networks (DNN) models, and offloading anomaly detection tasks to the cloud incurs long delay.
We propose and build a demo for an adaptive anomaly detection approach for distributed hierarchical edge computing (HEC) systems.
We show that our proposed approach significantly reduces detection delay without sacrificing accuracy, as compared to offloading detection tasks to the cloud.
arXiv Detail & Related papers (2020-04-15T06:13:33Z) - Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction.
We put forward an alternative measure of anomaly score to replace the reconstruction-based metric.
Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
arXiv Detail & Related papers (2020-03-24T08:26:58Z) - Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems
Monitoring Data [0.0]
This paper proposes an anomaly detection method based on a deep autoencoder for in-situ wastewater systems monitoring data.
Anomaly detection is then performed based on the reconstruction error of the decoding stage.
arXiv Detail & Related papers (2020-02-07T09:53:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.