Robust and Explainable Autoencoders for Unsupervised Time Series Outlier
Detection---Extended Version
- URL: http://arxiv.org/abs/2204.03341v1
- Date: Thu, 7 Apr 2022 10:24:12 GMT
- Title: Robust and Explainable Autoencoders for Unsupervised Time Series Outlier
Detection---Extended Version
- Authors: Tung Kieu, Bin Yang, Chenjuan Guo, Christian S. Jensen, Yan Zhao,
Feiteng Huang, Kai Zheng
- Abstract summary: Time series data occurs widely, and outlier detection is a fundamental problem in data mining.
Existing autoencoder-based approaches deliver state-of-the-art performance on challenging real-world data but are vulnerable to outliers and exhibit low explainability.
We propose robust and explainable unsupervised autoencoder frameworks that decompose an input time series into a clean time series and an outlier time series.
- Score: 27.191005130096684
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Time series data occurs widely, and outlier detection is a fundamental
problem in data mining, which has numerous applications. Existing
autoencoder-based approaches deliver state-of-the-art performance on
challenging real-world data but are vulnerable to outliers and exhibit low
explainability. To address these two limitations, we propose robust and
explainable unsupervised autoencoder frameworks that decompose an input time
series into a clean time series and an outlier time series using autoencoders.
Improved explainability is achieved because clean time series are better
explained with easy-to-understand patterns such as trends and periodicities. We
provide insight into this by means of a post-hoc explainability analysis and
empirical studies. In addition, since outliers are separated from clean time
series iteratively, our approach offers improved robustness to outliers, which
in turn improves accuracy. We evaluate our approach on five real-world datasets
and report improvements over the state-of-the-art approaches in terms of
robustness and explainability.
This is an extended version of "Robust and Explainable Autoencoders for
Unsupervised Time Series Outlier Detection", to appear in IEEE ICDE 2022.
Related papers
- AVATAR: Adversarial Autoencoders with Autoregressive Refinement for Time Series Generation [0.9374652839580181]
We introduce AVATAR, a framework that combines Adversarial Autoencoders (AAE) with Autoregressive Learning to generate time series data.
Specifically, our technique integrates the autoencoder with a supervisor and introduces a novel supervised loss to assist the decoder in learning the temporal dynamics of time series data.
arXiv Detail & Related papers (2025-01-03T05:44:13Z) - Interpreting Outliers in Time Series Data through Decoding Autoencoder [2.156170153103442]
This study focuses on manufacturing time series data from a German automotive supply industry.
We utilize autoencoders to compress the entire time series and then apply anomaly detection techniques to its latent features.
arXiv Detail & Related papers (2024-09-03T08:52:21Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEs [50.25683648762602]
We introduce Koopman VAE, a new generative framework that is based on a novel design for the model prior.
Inspired by Koopman theory, we represent the latent conditional prior dynamics using a linear map.
KoVAE outperforms state-of-the-art GAN and VAE methods across several challenging synthetic and real-world time series generation benchmarks.
arXiv Detail & Related papers (2023-10-04T07:14:43Z) - AnomalyBERT: Self-Supervised Transformer for Time Series Anomaly
Detection using Data Degradation Scheme [0.7216399430290167]
Anomaly detection task for time series, especially for unlabeled data, has been a challenging problem.
We address it by applying a suitable data degradation scheme to self-supervised model training.
Inspired by the self-attention mechanism, we design a Transformer-based architecture to recognize the temporal context.
arXiv Detail & Related papers (2023-05-08T05:42:24Z) - A Robust and Explainable Data-Driven Anomaly Detection Approach For
Power Electronics [56.86150790999639]
We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer.
The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data.
A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
arXiv Detail & Related papers (2022-09-23T06:09:35Z) - Recurrent Auto-Encoder With Multi-Resolution Ensemble and Predictive
Coding for Multivariate Time-Series Anomaly Detection [3.772827533440353]
Real-world time-series data exhibit complex temporal dependencies.
RAE-M EPC learns informative normal representations based on multi-resolution ensemble and predictive coding.
Experiments on real-world benchmark datasets show that the proposed model outperforms the benchmark models.
arXiv Detail & Related papers (2022-02-21T05:47:22Z) - Towards Generating Real-World Time Series Data [52.51620668470388]
We propose a novel generative framework for time series data generation - RTSGAN.
RTSGAN learns an encoder-decoder module which provides a mapping between a time series instance and a fixed-dimension latent vector.
To generate time series with missing values, we further equip RTSGAN with an observation embedding layer and a decide-and-generate decoder.
arXiv Detail & Related papers (2021-11-16T11:31:37Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z) - RobustTAD: Robust Time Series Anomaly Detection via Decomposition and
Convolutional Neural Networks [37.16594704493679]
We propose RobustTAD, a Robust Time series Anomaly Detection framework.
It integrates robust seasonal-trend decomposition and convolutional neural network for time series data.
It is deployed as a public online service and widely adopted in different business scenarios at Alibaba Group.
arXiv Detail & Related papers (2020-02-21T20:43:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.