TFGformer: Multivariate Time Series Forecasting via Time-Frequency Graph Learning and Covariate Fusion
- URL: http://arxiv.org/abs/2607.29459v1
- Date: Fri, 31 Jul 2026 14:24:26 GMT
- Title: TFGformer: Multivariate Time Series Forecasting via Time-Frequency Graph Learning and Covariate Fusion
- Abstract summary: We propose a retrieval-augmented forecasting framework that integrates Shape-Aware Memory (SAM) with RevIN normalization for magnitude-robust shape-level retrieval.<n>Experiments on seven public benchmarks show that CrossRAG consistently outperforms both parametric-only baselines and existing retrieval-augmented forecasting methods.
- Score: 12.980172248250257
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: Large-scale multivariate time series from heterogeneous IoT sensors demand accurate long-term forecasting for resource scheduling and predictive maintenance. While recent time series foundation models exhibit strong generalization, they rely on static parametric knowledge and lack dynamic access to external historical patterns during inference. Retrieval-Augmented Generation (RAG) offers a potential remedy, yet its application to time series forecasting is challenged by magnitude variations across heterogeneous sources and the mismatch between historical similarity and future consistency. We propose CrossRAG, a retrieval-augmented forecasting framework that integrates Shape-Aware Memory (SAM) with RevIN normalization for magnitude-robust shape-level retrieval, Future-Consistent Contrastive (FCC) learning to distinguish informative references from hard negatives with similar history but divergent futures, and Cross-Attention Temporal Fusion (CATF) to fuse retrieved historical--future reference pairs into the backbone's representations at the representation level. Experiments on seven public benchmarks show that CrossRAG consistently outperforms both parametric-only baselines and existing retrieval-augmented forecasting methods.
Related papers
- Multivariate Time Series Forecasting needs Cross Variable Loss [11.325603740473376]
We propose a plug-in structural regularizer that constrains forecast residuals on a cross-variable graph.<n>CvLoss penalizes inconsistent edge-wise residual differences over forecast patches, encouraging consistency across both synchronous and asynchronous interactions.<n>Our experiments show that CvLoss consistently improves competitive forecasting models, outperforms representative learning objectives, and is compatible with a variety of forecasting backbones.
arXiv Detail & Related papers (2026-08-06T08:22:45Z) - Spectral Retrieval-Augmented Time-Series Forecasting [7.885089945243776]
Time series forecasting leverages historical patterns to predict future values, but traditional methods face challenges when dealing with complex, non-stationary patterns.<n>Retrieval-augmented approaches have emerged as promising solutions by retrieving similar historical patterns to enhance predictions.<n>We propose SpecReTF, a novel retrieval method that converts time series into windowed frequency representations, measuring similarity with a combined metric.
arXiv Detail & Related papers (2026-06-17T15:42:19Z) - Semantics-Enhanced Retrieval-Augmented Time Series Forecasting [5.059121667323038]
Time series forecasting models often benefit from historical patterns.<n>Recent research explored retrieving relevant historical time series segments to enhance forecasting.<n>We propose a multimodal approach: a textbfSemantics-textbfEnhanced textbfRetrieval-textbfAugmented Time Series textbfForecasting framework, SERAF.
arXiv Detail & Related papers (2026-06-12T20:32:10Z) - Trio: Learning Time-Series Forecasting with Temporal-Spatial-Sample Attention and Structural Causal Priors [27.20677965052]
Recent Prior-Data Fitted Networks (PFNs) suggest that synthetic tasks can be useful for learning transferable inference behavior.<n>We propose Trio, a sample-aware time-series forecasting architecture based on Temporal-Spatial-Sample attention.<n>We introduce a Time-Series Structural Causal Model (TS-SCM) generator to create structured synthetic forecasting tasks with dynamic lags, cross-variable interactions, noise, feedback, and distributional drift.
arXiv Detail & Related papers (2026-06-05T14:01:58Z) - Stationarity-Aware Retrieval-Augmented Time Series Forecasting [5.059121667323038]
Time series forecasting relies on historical patterns.<n>Real-world series often exhibit non-stationarity and regime shifts.<n>We propose Stationarity-Aware Retrieval-Augmented Time Series Forecasting.
arXiv Detail & Related papers (2026-06-02T18:47:16Z) - RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO [53.38929612273108]
Causal autoregressive video diffusion models support real-time streaming generation by extrapolating future chunks from previously generated content.<n>We introduce the Real-time Autoregressive Video Extrapolation Network (RAVEN), a training-time test framework that repacks each self rollout into an interleaved sequence of clean historical endpoints.
arXiv Detail & Related papers (2026-05-14T17:59:30Z) - Preserving Temporal Dynamics in Time Series Generation [0.2099922236065961]
Time-series data augmentation plays a crucial role in regression-oriented forecasting tasks.<n>Existing approaches primarily focus on matching marginal data distributions.<n>We propose a model-agnostic Markov Chain Monte Carlo framework to mitigate distribution shift and preserve temporal dynamics.
arXiv Detail & Related papers (2026-04-29T20:32:45Z) - TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting [67.91113180885601]
TimeAPN explicitly models and predicts non-stationary factors from both the time and frequency domains.<n>TimeAPN consistently improves long-term forecasting accuracy across multiple prediction horizons.<n>It outperforms state-of-the-art reversible normalization methods.
arXiv Detail & Related papers (2026-03-18T07:21:24Z) - A Unified Frequency Domain Decomposition Framework for Interpretable and Robust Time Series Forecasting [81.73338008264115]
Current approaches for time series forecasting, whether in the time or frequency domain, predominantly use deep learning models based on linear layers or transformers.<n>We propose FIRE, a unified frequency domain decomposition framework that provides a mathematical abstraction for diverse types of time series.<n>Fire consistently outperforms state-of-the-art models on long-term forecasting benchmarks.
arXiv Detail & Related papers (2025-10-11T09:59:25Z) - MFRS: A Multi-Frequency Reference Series Approach to Scalable and Accurate Time-Series Forecasting [51.94256702463408]
Time series predictability is derived from periodic characteristics at different frequencies.<n>We propose a novel time series forecasting method based on multi-frequency reference series correlation analysis.<n> Experiments on major open and synthetic datasets show state-of-the-art performance.
arXiv Detail & Related papers (2025-03-11T11:40:14Z) - Timer-XL: Long-Context Transformers for Unified Time Series Forecasting [67.83502953961505]
We present Timer-XL, a causal Transformer for unified time series forecasting.<n>Based on large-scale pre-training, Timer-XL achieves state-of-the-art zero-shot performance.
arXiv Detail & Related papers (2024-10-07T07:27:39Z) - TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling [67.02157180089573]
Time series pre-training has recently garnered wide attention for its potential to reduce labeling expenses and benefit various downstream tasks.
This paper proposes TimeSiam as a simple but effective self-supervised pre-training framework for Time series based on Siamese networks.
arXiv Detail & Related papers (2024-02-04T13:10:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.