Joint Selective State Space Model and Detrending for Robust Time Series Anomaly Detection

• URL: http://arxiv.org/abs/2405.19823v2
• Date: Tue, 20 Aug 2024 08:00:02 GMT
• Title: Joint Selective State Space Model and Detrending for Robust Time Series Anomaly Detection
• Authors: Junqi Chen, Xu Tan, Sylwan Rahardja, Jiawei Yang, Susanto Rahardja,
• Abstract summary: Deep learning-based sequence models are extensively employed in Time Series Anomaly Detection tasks. The ability of TSAD is limited by two key challenges: (i) the ability to model long-range dependency and (ii) the generalization issue in the presence of non-stationary data.
• Score: 25.60381244912307
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep learning-based sequence models are extensively employed in Time Series Anomaly Detection (TSAD) tasks due to their effective sequential modeling capabilities. However, the ability of TSAD is limited by two key challenges: (i) the ability to model long-range dependency and (ii) the generalization issue in the presence of non-stationary data. To tackle these challenges, an anomaly detector that leverages the selective state space model known for its proficiency in capturing long-term dependencies across various domains is proposed. Additionally, a multi-stage detrending mechanism is introduced to mitigate the prominent trend component in non-stationary data to address the generalization issue. Extensive experiments conducted on realworld public datasets demonstrate that the proposed methods surpass all 12 compared baseline methods.

Related papers

• Causal Time-Series Synchronization for Multi-Dimensional Forecasting [1.1060425537315088]
  The process industry's high expectations for Digital Twins require modeling approaches that can generalize across tasks and diverse domains. Our approach focuses on: (i) identifying highly lagged causal relationships using data-driven methods, (ii) synchronizing cause-effect pairs to generate training samples for channel-dependent pre-training, and (iii) evaluating the effectiveness of this approach in channel-dependent forecasting.
  arXiv  Detail & Related papers  (2024-11-15T12:50:57Z)
• MITA: Bridging the Gap between Model and Data for Test-time Adaptation [68.62509948690698]
  Test-Time Adaptation (TTA) has emerged as a promising paradigm for enhancing the generalizability of models. We propose Meet-In-The-Middle based MITA, which introduces energy-based optimization to encourage mutual adaptation of the model and data from opposing directions.
  arXiv  Detail & Related papers  (2024-10-12T07:02:33Z)
• On the Resurgence of Recurrent Models for Long Sequences -- Survey and Research Opportunities in the Transformer Era [59.279784235147254]
  This survey is aimed at providing an overview of these trends framed under the unifying umbrella of Recurrence. It emphasizes novel research opportunities that become prominent when abandoning the idea of processing long sequences.
  arXiv  Detail & Related papers  (2024-02-12T23:55:55Z)
• Revisiting VAE for Unsupervised Time Series Anomaly Detection: A Frequency Perspective [40.21603048003118]
  Variational Autoencoders (VAEs) have gained popularity in recent decades due to their superior de-noising capabilities. FCVAE exploits an innovative approach to concurrently integrate both the global and local frequency features into the condition of Conditional Variational Autoencoder (CVAE) Our approach has been evaluated on public datasets and a large-scale cloud system, and the results demonstrate that it outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-05T09:06:57Z)
• Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values [67.76168547245237]
  We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies. Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-11T10:10:16Z)
• Time series anomaly detection with reconstruction-based state-space models [10.085100442558828]
  We propose a novel unsupervised anomaly detection method for time series data. A long short-term memory (LSTM)-based encoder-decoder is adopted to represent the mapping between the observation space and the latent space. Regularization of the latent space places constraints on the states of normal samples, and Mahalanobis distance is used to evaluate the abnormality level.
  arXiv  Detail & Related papers  (2023-03-06T17:52:35Z)
• Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models [2.299617836036273]
  We put forward SSSD, an imputation model that relies on two emerging technologies,conditional diffusion models and structured state space models. We demonstrate that SSSD matches or even exceeds state-of-the-art probabilistic imputation and forecasting performance on a broad range of data sets and different missingness scenarios.
  arXiv  Detail & Related papers  (2022-08-19T15:29:43Z)
• Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
  We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data. We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism. We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
  arXiv  Detail & Related papers  (2022-06-30T06:00:13Z)
• Time Series Anomaly Detection via Reinforcement Learning-Based Model Selection [3.1692938090731584]
  Time series anomaly detection is of critical importance for the reliable and efficient operation of real-world systems. In this work, we assume that a pool of anomaly detection models is accessible and propose to utilize reinforcement learning to dynamically select a candidate model. It is demonstrated that the proposed strategy can outperforms all baseline models in terms of overall performance.
  arXiv  Detail & Related papers  (2022-05-19T22:10:35Z)
• A Multi-Channel Neural Graphical Event Model with Negative Evidence [76.51278722190607]
  Event datasets are sequences of events of various types occurring irregularly over the time-line. We propose a non-parametric deep neural network approach in order to estimate the underlying intensity functions.
  arXiv  Detail & Related papers  (2020-02-21T23:10:50Z)
• A Comprehensive Study on Temporal Modeling for Online Action Detection [50.558313106389335]
  Online action detection (OAD) is a practical yet challenging task, which has attracted increasing attention in recent years. This paper aims to provide a comprehensive study on temporal modeling for OAD including four meta types of temporal modeling methods. We present several hybrid temporal modeling methods, which outperform the recent state-of-the-art methods with sizable margins on THUMOS-14 and TVSeries.
  arXiv  Detail & Related papers  (2020-01-21T13:12:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.