Unsupervised Time Series Anomaly Prediction with Importance-based Generative Contrastive Learning

• URL: http://arxiv.org/abs/2410.16888v1
• Date: Tue, 22 Oct 2024 10:46:36 GMT
• Title: Unsupervised Time Series Anomaly Prediction with Importance-based Generative Contrastive Learning
• Authors: Kai Zhao, Zhihao Zhuang, Chenjuan Guo, Hao Miao, Yunyao Cheng, Bin Yang,
• Abstract summary: Time series anomaly prediction plays an essential role in many real-world scenarios, such as environmental prevention and prompt maintenance of cyber-physical systems. Existing time series anomaly prediction methods mainly require supervised training with plenty of manually labeled data. In this paper, we study a novel problem of unsupervised time series anomaly prediction.
• Score: 13.082961588929606
• License:
• Abstract: Time series anomaly prediction plays an essential role in many real-world scenarios, such as environmental prevention and prompt maintenance of cyber-physical systems. However, existing time series anomaly prediction methods mainly require supervised training with plenty of manually labeled data, which are difficult to obtain in practice. Besides, unseen anomalies can occur during inference, which could differ from the labeled training data and make these models fail to predict such new anomalies. In this paper, we study a novel problem of unsupervised time series anomaly prediction. We provide a theoretical analysis and propose Importance-based Generative Contrastive Learning (IGCL) to address the aforementioned problems. IGCL distinguishes between normal and anomaly precursors, which are generated by our anomaly precursor pattern generation module. To address the efficiency issues caused by the potential complex anomaly precursor combinations, we propose a memory bank with importance-based scores to adaptively store representative anomaly precursors and generate more complicated anomaly precursors. Extensive experiments on seven benchmark datasets show our method outperforms state-of-the-art baselines on unsupervised time series anomaly prediction problems.

Related papers

• Anomaly Prediction: A Novel Approach with Explicit Delay and Horizon [1.8816077341295625]
  This paper introduces a novel approach for time series anomaly prediction, incorporating temporal information directly into the prediction results. Our results demonstrate the efficacy of our approach in providing timely and accurate anomaly predictions, setting a new benchmark for future research in this field.
  arXiv  Detail & Related papers  (2024-08-08T11:22:52Z)
• Deep learning for predicting the occurrence of tipping points [9.699777597848618]
  We develop a deep learning algorithm for predicting the occurrence of tipping points in untrained systems. Our algorithm not only outperforms traditional methods but also achieves accurate predictions for irregularly-sampled model time series. Our ability to predict tipping points paves the way for mitigation risks, prevention of catastrophic failures, and restoration of degraded systems.
  arXiv  Detail & Related papers  (2024-07-26T12:17:57Z)
• Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values [67.76168547245237]
  We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies. Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-11T10:10:16Z)
• Performative Time-Series Forecasting [71.18553214204978]
  We formalize performative time-series forecasting (PeTS) from a machine-learning perspective. We propose a novel approach, Feature Performative-Shifting (FPS), which leverages the concept of delayed response to anticipate distribution shifts. We conduct comprehensive experiments using multiple time-series models on COVID-19 and traffic forecasting tasks.
  arXiv  Detail & Related papers  (2023-10-09T18:34:29Z)
• CARLA: Self-supervised Contrastive Representation Learning for Time Series Anomaly Detection [53.83593870825628]
  One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios. Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an unsupervised manner. We introduce a novel end-to-end self-supervised ContrAstive Representation Learning approach for time series anomaly detection.
  arXiv  Detail & Related papers  (2023-08-18T04:45:56Z)
• Disruption Precursor Onset Time Study Based on Semi-supervised Anomaly Detection [6.287037295927318]
  We present a disruption prediction method based on anomaly detection that overcomes the drawbacks of unbalanced positive and negative data samples. We optimize precursor labeling using the onset times inferred by the anomaly detection predictor and test the optimized labels on supervised learning disruption predictors.
  arXiv  Detail & Related papers  (2023-03-27T07:54:56Z)
• An Extreme-Adaptive Time Series Prediction Model Based on Probability-Enhanced LSTM Neural Networks [6.5700527395783315]
  We propose a novel probability-enhanced neural network model, called NEC+, which concurrently learns extreme and normal prediction functions. We evaluate the proposed model on the difficult 3-day ahead hourly water level prediction task applied to 9 reservoirs in California.
  arXiv  Detail & Related papers  (2022-11-29T03:01:59Z)
• Are we certain it's anomalous? [57.729669157989235]
  Anomaly detection in time series is a complex task since anomalies are rare due to highly non-linear temporal correlations. Here we propose the novel use of Hyperbolic uncertainty for Anomaly Detection (HypAD) HypAD learns self-supervisedly to reconstruct the input signal.
  arXiv  Detail & Related papers  (2022-11-16T21:31:39Z)
• Calibrated One-class Classification for Unsupervised Time Series Anomaly Detection [27.15951068292889]
  This paper proposes one-class classification for anomaly detection. It realizes contamination-tolerant, anomaly-informed learning of data normality. Our model achieves substantial improvement over sixteen state-of-the-art contenders.
  arXiv  Detail & Related papers  (2022-07-25T13:43:13Z)
• Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
  We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data. We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism. We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
  arXiv  Detail & Related papers  (2022-06-30T06:00:13Z)
• Ambiguity in Sequential Data: Predicting Uncertain Futures with Recurrent Models [110.82452096672182]
  We propose an extension of the Multiple Hypothesis Prediction (MHP) model to handle ambiguous predictions with sequential data. We also introduce a novel metric for ambiguous problems, which is better suited to account for uncertainties.
  arXiv  Detail & Related papers  (2020-03-10T09:15:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.