Weakly Augmented Variational Autoencoder in Time Series Anomaly
Detection
- URL: http://arxiv.org/abs/2401.03341v1
- Date: Sun, 7 Jan 2024 00:23:05 GMT
- Title: Weakly Augmented Variational Autoencoder in Time Series Anomaly
Detection
- Abstract summary: We propose a novel generative framework that combines deep Variencoders (VAEs) with self-supervised learning (SSL) to address this issue.
- Score: 32.98391970820966
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Due to their unsupervised training and uncertainty estimation, deep
Variational Autoencoders (VAEs) have become powerful tools for
reconstruction-based Time Series Anomaly Detection (TSAD). Existing VAE-based
TSAD methods, either statistical or deep, tune meta-priors to estimate the
likelihood probability for effectively capturing spatiotemporal dependencies in
the data. However, these methods confront the challenge of inherent data
scarcity, which is often the case in anomaly detection tasks. Such scarcity
easily leads to latent holes, discontinuous regions in latent space, resulting
in non-robust reconstructions on these discontinuous spaces. We propose a novel
generative framework that combines VAEs with self-supervised learning (SSL) to
address this issue.
Related papers
- ASTER: Latent Pseudo-Anomaly Generation for Unsupervised Time-Series Anomaly Detection [13.213712558290823]
Time-series anomaly detection is critical in domains such as industrial monitoring, healthcare, and cybersecurity.<n>We propose ASTER, a framework that generates pseudo-anomalies directly in the latent space.<n>A latent-space decoder produces tailored pseudo-anomalies to train a Transformer-based anomaly.<n>A pre-trained LLM enriches the temporal and contextual representations of this space.
arXiv Detail & Related papers (2026-04-15T14:32:35Z) - ARES: Anomaly Recognition Model For Edge Streams [15.767494189633133]
We introduce ARES, an unsupervised anomaly detection framework for edge streams.<n> ARES combines Graph Neural Networks (GNNs) for feature extraction with Half-Space Trees (HST) for anomaly scoring.<n>GNNs capture both spike and burst anomalous behaviors within streams by embedding node and edge properties in a latent space, while HST partitions this space to isolate anomalies efficiently.
arXiv Detail & Related papers (2025-11-27T03:56:35Z) - Anomaly Detection in Time Series Data Using Reinforcement Learning, Variational Autoencoder, and Active Learning [0.8287206589886879]
This approach is pivotal in domains such as data centers, sensor networks, and finance.
Our method overcomes these limitations by integrating Deep Reinforcement Learning (DRL) with a Variational Autoencoder (VAE) and Active Learning.
arXiv Detail & Related papers (2025-04-03T19:41:52Z) - Reshaping the Online Data Buffering and Organizing Mechanism for Continual Test-Time Adaptation [49.53202761595912]
Continual Test-Time Adaptation involves adapting a pre-trained source model to continually changing unsupervised target domains.
We analyze the challenges of this task: online environment, unsupervised nature, and the risks of error accumulation and catastrophic forgetting.
We propose an uncertainty-aware buffering approach to identify and aggregate significant samples with high certainty from the unsupervised, single-pass data stream.
arXiv Detail & Related papers (2024-07-12T15:48:40Z) - Revisiting VAE for Unsupervised Time Series Anomaly Detection: A
Frequency Perspective [40.21603048003118]
Variational Autoencoders (VAEs) have gained popularity in recent decades due to their superior de-noising capabilities.
FCVAE exploits an innovative approach to concurrently integrate both the global and local frequency features into the condition of Conditional Variational Autoencoder (CVAE)
Our approach has been evaluated on public datasets and a large-scale cloud system, and the results demonstrate that it outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-02-05T09:06:57Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image.
In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting.
Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
arXiv Detail & Related papers (2023-11-27T13:14:06Z) - Explainable Time Series Anomaly Detection using Masked Latent Generative Modeling [1.3927943269211591]
We present TimeVQVAE-AD, a novel time series anomaly detection method.
TimeVQVAE-AD achieves excellent detection accuracy while offering a superior level of explainability.
We provide our implementation on GitHub.
arXiv Detail & Related papers (2023-11-21T11:59:16Z) - Unraveling the "Anomaly" in Time Series Anomaly Detection: A
Self-supervised Tri-domain Solution [89.16750999704969]
Anomaly labels hinder traditional supervised models in time series anomaly detection.
Various SOTA deep learning techniques, such as self-supervised learning, have been introduced to tackle this issue.
We propose a novel self-supervised learning based Tri-domain Anomaly Detector (TriAD)
arXiv Detail & Related papers (2023-11-19T05:37:18Z) - Semi-Supervised Temporal Action Detection with Proposal-Free Masking [134.26292288193298]
We propose a novel Semi-supervised Temporal action detection model based on PropOsal-free Temporal mask (SPOT)
SPOT outperforms state-of-the-art alternatives, often by a large margin.
arXiv Detail & Related papers (2022-07-14T16:58:47Z) - Reducing Catastrophic Forgetting in Self Organizing Maps with
Internally-Induced Generative Replay [67.50637511633212]
A lifelong learning agent is able to continually learn from potentially infinite streams of pattern sensory data.
One major historic difficulty in building agents that adapt is that neural systems struggle to retain previously-acquired knowledge when learning from new samples.
This problem is known as catastrophic forgetting (interference) and remains an unsolved problem in the domain of machine learning to this day.
arXiv Detail & Related papers (2021-12-09T07:11:14Z) - Memory-augmented Adversarial Autoencoders for Multivariate Time-series
Anomaly Detection with Deep Reconstruction and Prediction [4.033624665609417]
We propose MemAAE, a novel unsupervised anomaly detection method for time-series.
By jointly training two complementary proxy tasks, reconstruction and prediction, we show that detecting anomalies via multiple tasks obtains superior performance.
MemAAE achieves an overall F1 score of 0.90 on four public datasets, significantly outperforming the best baseline by 0.02.
arXiv Detail & Related papers (2021-10-15T18:29:05Z) - Heteroscedastic Temporal Variational Autoencoder For Irregular Time Series [15.380441563675243]
We propose a new deep learning framework for irregularly sampled time series that we call the Heteroscedastic Temporal Variational Autoencoder (HeTVAE)
HeTVAE includes a novel input layer to encode information about input observation sparsity, a temporal VAE architecture to propagate uncertainty due to input sparsity, and a heteroscedastic output layer to enable variable uncertainty in output due to variables.
Our results show that the proposed architecture is better able to reflect variable uncertainty through time sparse and irregular sampling than a range of baseline and traditional models, as well as recently proposed deep latent variable models that use
arXiv Detail & Related papers (2021-07-23T16:59:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.