FreCT: Frequency-augmented Convolutional Transformer for Robust Time Series Anomaly Detection
- URL: http://arxiv.org/abs/2505.00941v2
- Date: Sat, 10 May 2025 08:32:35 GMT
- Title: FreCT: Frequency-augmented Convolutional Transformer for Robust Time Series Anomaly Detection
- Authors: Wenxin Zhang, Ding Xu, Guangzhen Yao, Xiaojian Lin, Renxiang Guan, Chengze Du, Renda Han, Xi Xuan, Cuicui Luo,
- Abstract summary: Time series anomaly detection is critical for system monitoring and risk identification.<n>We propose a novel Frequency-augmented Convolutional Transformer (FreCT)<n>FreCT utilizes patch operations to generate contrastive views and employs an improved Transformer architecture integrated with a convolution module.
- Score: 8.779286654383796
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Time series anomaly detection is critical for system monitoring and risk identification, across various domains, such as finance and healthcare. However, for most reconstruction-based approaches, detecting anomalies remains a challenge due to the complexity of sequential patterns in time series data. On the one hand, reconstruction-based techniques are susceptible to computational deviation stemming from anomalies, which can lead to impure representations of normal sequence patterns. On the other hand, they often focus on the time-domain dependencies of time series, while ignoring the alignment of frequency information beyond the time domain. To address these challenges, we propose a novel Frequency-augmented Convolutional Transformer (FreCT). FreCT utilizes patch operations to generate contrastive views and employs an improved Transformer architecture integrated with a convolution module to capture long-term dependencies while preserving local topology information. The introduced frequency analysis based on Fourier transformation could enhance the model's ability to capture crucial characteristics beyond the time domain. To protect the training quality from anomalies and improve the robustness, FreCT deploys stop-gradient Kullback-Leibler (KL) divergence and absolute error to optimize consistency information in both time and frequency domains. Extensive experiments on four public datasets demonstrate that FreCT outperforms existing methods in identifying anomalies.
Related papers
- Multivariate Long-term Time Series Forecasting with Fourier Neural Filter [55.09326865401653]
We introduce FNF as the backbone and DBD as architecture to provide excellent learning capabilities and optimal learning pathways for spatial-temporal modeling.<n>We show that FNF unifies local time-domain and global frequency-domain information processing within a single backbone that extends naturally to spatial modeling.
arXiv Detail & Related papers (2025-06-10T18:40:20Z) - Decomposition-based multi-scale transformer framework for time series anomaly detection [0.9438207505148947]
We propose a transformer-based framework built on decomposition (TransDe) for time series anomaly detection.<n>A multi-scale patch-based transformer architecture is proposed to exploit the representative dependencies of each decomposed component of the time series.<n>A novel asynchronous loss function with a stop-gradient strategy is introduced to enhance the performance of TransDe effectively.
arXiv Detail & Related papers (2025-04-19T06:47:38Z) - MFRS: A Multi-Frequency Reference Series Approach to Scalable and Accurate Time-Series Forecasting [51.94256702463408]
Time series predictability is derived from periodic characteristics at different frequencies.<n>We propose a novel time series forecasting method based on multi-frequency reference series correlation analysis.<n> Experiments on major open and synthetic datasets show state-of-the-art performance.
arXiv Detail & Related papers (2025-03-11T11:40:14Z) - Calibrated Unsupervised Anomaly Detection in Multivariate Time-series using Reinforcement Learning [0.0]
This paper investigates unsupervised anomaly detection in time-series data using reinforcement learning (RL) in the latent space of an autoencoder.<n>We use wavelet analysis to enhance anomaly detection, enabling time-series data decomposition into both time and frequency domains.<n>We calibrate the decision boundary by generating synthetic anomalies and embedding a supervised framework within the model.
arXiv Detail & Related papers (2025-02-05T15:02:40Z) - TSINR: Capturing Temporal Continuity via Implicit Neural Representations for Time Series Anomaly Detection [22.367552254229665]
Time series anomaly detection aims to identify unusual patterns in data or deviations from systems' expected behavior.
Reconstruction-based methods are the mainstream in this task, which learn point-wise representation via unsupervised learning.
We propose a time series anomaly detection method based on implicit neural representation (INR) reconstruction, named TSINR, to address this challenge.
arXiv Detail & Related papers (2024-11-18T15:19:54Z) - Revisiting VAE for Unsupervised Time Series Anomaly Detection: A
Frequency Perspective [40.21603048003118]
Variational Autoencoders (VAEs) have gained popularity in recent decades due to their superior de-noising capabilities.
FCVAE exploits an innovative approach to concurrently integrate both the global and local frequency features into the condition of Conditional Variational Autoencoder (CVAE)
Our approach has been evaluated on public datasets and a large-scale cloud system, and the results demonstrate that it outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-02-05T09:06:57Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Correlation-aware Spatial-Temporal Graph Learning for Multivariate
Time-series Anomaly Detection [67.60791405198063]
We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection.
CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module.
A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
arXiv Detail & Related papers (2023-07-17T11:04:27Z) - Diagnostic Spatio-temporal Transformer with Faithful Encoding [54.02712048973161]
This paper addresses the task of anomaly diagnosis when the underlying data generation process has a complex-temporal (ST) dependency.
We formalize the problem as supervised dependency discovery, where the ST dependency is learned as a side product of time-series classification.
We show that temporal positional encoding used in existing ST transformer works has a serious limitation capturing frequencies in higher frequencies (short time scales)
We also propose a new ST dependency discovery framework, which can provide readily consumable diagnostic information in both spatial and temporal directions.
arXiv Detail & Related papers (2023-05-26T05:31:23Z) - A Joint Time-frequency Domain Transformer for Multivariate Time Series
Forecasting [7.501660339993144]
This paper introduces the Joint Time-Frequency Domain Transformer (JTFT)
JTFT combines time and frequency domain representations to make predictions.
Experimental results on six real-world datasets demonstrate that JTFT outperforms state-of-the-art baselines in predictive performance.
arXiv Detail & Related papers (2023-05-24T02:37:23Z) - Transform Once: Efficient Operator Learning in Frequency Domain [69.74509540521397]
We study deep neural networks designed to harness the structure in frequency domain for efficient learning of long-range correlations in space or time.
This work introduces a blueprint for frequency domain learning through a single transform: transform once (T1)
arXiv Detail & Related papers (2022-11-26T01:56:05Z) - TFAD: A Decomposition Time Series Anomaly Detection Architecture with
Time-Frequency Analysis [12.867257563413972]
Time series anomaly detection is a challenging problem due to the complex temporal dependencies and the limited label data.
We propose a Time-Frequency analysis based time series Anomaly Detection model, or TFAD, to exploit both time and frequency domains for performance improvement.
arXiv Detail & Related papers (2022-10-18T09:08:57Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.