Multivariate Time Series Anomaly Detection with Few Positive Samples
- URL: http://arxiv.org/abs/2207.00705v1
- Date: Sat, 2 Jul 2022 00:58:52 GMT
- Title: Multivariate Time Series Anomaly Detection with Few Positive Samples
- Authors: Feng Xue, Weizhong Yan
- Abstract summary: We introduce two methodologies to address the needs of this practical situation.
Our proposed methods anchor on representative learning of normal operation with autoregressive (AR) model.
We demonstrate effective performance in comparison with approaches from literature.
- Score: 12.256288627540536
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Given the scarcity of anomalies in real-world applications, the majority of
literature has been focusing on modeling normality. The learned representations
enable anomaly detection as the normality model is trained to capture certain
key underlying data regularities under normal circumstances. In practical
settings, particularly industrial time series anomaly detection, we often
encounter situations where a large amount of normal operation data is available
along with a small number of anomaly events collected over time. This practical
situation calls for methodologies to leverage these small number of anomaly
events to create a better anomaly detector. In this paper, we introduce two
methodologies to address the needs of this practical situation and compared
them with recently developed state of the art techniques. Our proposed methods
anchor on representative learning of normal operation with autoregressive (AR)
model along with loss components to encourage representations that separate
normal versus few positive examples. We applied the proposed methods to two
industrial anomaly detection datasets and demonstrated effective performance in
comparison with approaches from literature. Our study also points out
additional challenges with adopting such methods in practical applications.
Related papers
- Anomaly Detection by Context Contrasting [57.695202846009714]
Anomaly detection focuses on identifying samples that deviate from the norm.
Recent advances in self-supervised learning have shown great promise in this regard.
We propose Con$$, which learns through context augmentations.
arXiv Detail & Related papers (2024-05-29T07:59:06Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Learning Multi-Pattern Normalities in the Frequency Domain for Efficient Time Series Anomaly Detection [37.992737349167676]
We propose a multi-normal-pattern accommodated anomaly detection method in the frequency domain for time series anomaly detection.
There are three novel characteristics of it: (i) a pattern extraction mechanism excelling at handling diverse normal patterns with a unified model; (ii) a dualistic convolution mechanism that amplifies short-term anomalies in the time domain and hinders the reconstruction of anomalies in the frequency domain; and (iii) leveraging the sparsity and parallelism of frequency domain to enhance model efficiency.
arXiv Detail & Related papers (2023-11-26T03:31:43Z) - Few-shot Anomaly Detection in Text with Deviation Learning [13.957106119614213]
We introduce FATE, a framework that learns anomaly scores explicitly in an end-to-end method using deviation learning.
Our model is optimized to learn the distinct behavior of anomalies by utilizing a multi-head self-attention layer and multiple instance learning approaches.
arXiv Detail & Related papers (2023-08-22T20:40:21Z) - SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detection [24.43321988051129]
We propose a novel saliency-guided data augmentation method, SaliencyCut, to produce pseudo but more common anomalies.
We then design a novel patch-wise residual module in the anomaly learning head to extract and assess the fine-grained anomaly features from each sample.
arXiv Detail & Related papers (2023-06-14T08:55:36Z) - Real-Time Outlier Detection with Dynamic Process Limits [0.609170287691728]
This paper proposes an online anomaly detection algorithm for existing real-time infrastructures.
Online inverse cumulative distribution-based approach is introduced to eliminate common problems of offline anomaly detectors.
The benefit of the proposed method is the ease of use, fast computation, and deployability as shown in two case studies of real microgrid operation data.
arXiv Detail & Related papers (2023-01-31T10:23:02Z) - Prototypical Residual Networks for Anomaly Detection and Localization [80.5730594002466]
We propose a framework called Prototypical Residual Network (PRN)
PRN learns feature residuals of varying scales and sizes between anomalous and normal patterns to accurately reconstruct the segmentation maps of anomalous regions.
We present a variety of anomaly generation strategies that consider both seen and unseen appearance variance to enlarge and diversify anomalies.
arXiv Detail & Related papers (2022-12-05T05:03:46Z) - Object-centric and memory-guided normality reconstruction for video
anomaly detection [56.64792194894702]
This paper addresses anomaly detection problem for videosurveillance.
Due to the inherent rarity and heterogeneity of abnormal events, the problem is viewed as a normality modeling strategy.
Our model learns object-centric normal patterns without seeing anomalous samples during training.
arXiv Detail & Related papers (2022-03-07T19:28:39Z) - Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
We introduce a novel weakly-supervised anomaly detection framework to train detection models.
The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability.
Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
arXiv Detail & Related papers (2021-08-01T14:33:17Z) - Self-trained Deep Ordinal Regression for End-to-End Video Anomaly
Detection [114.9714355807607]
We show that applying self-trained deep ordinal regression to video anomaly detection overcomes two key limitations of existing methods.
We devise an end-to-end trainable video anomaly detection approach that enables joint representation learning and anomaly scoring without manually labeled normal/abnormal data.
arXiv Detail & Related papers (2020-03-15T08:44:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.