CoRA: Boosting Time Series Foundation Models for Multivariate Forecasting through Correlation-aware Adapter

• URL: http://arxiv.org/abs/2603.21828v1
• Date: Mon, 23 Mar 2026 11:13:02 GMT
• Title: CoRA: Boosting Time Series Foundation Models for Multivariate Forecasting through Correlation-aware Adapter
• Abstract summary: CoRrelation-aware Adapter (CoRA) is a lightweight plug-and-play method that requires only fine-tuning with Time Series Foundation Models (TSFMs)<n>To reduce complexity, we innovatively decompose the correlation matrix into low-rank Time-Varying Time-Inrank components.<n>To learn positive and negative correlations that appear only among some channels, we introduce a novel dual contrastive learning method.
• Score: 21.809575304934867
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Most existing Time Series Foundation Models (TSFMs) use channel independent modeling and focus on capturing and generalizing temporal dependencies, while neglecting the correlations among channels or overlooking the different aspects of correlations. However, these correlations play a vital role in Multivariate time series forecasting. To address this, we propose a CoRrelation-aware Adapter (CoRA), a lightweight plug-and-play method that requires only fine-tuning with TSFMs and is able to capture different types of correlations, so as to improve forecast performance. Specifically, to reduce complexity, we innovatively decompose the correlation matrix into low-rank Time-Varying and Time-Invariant components. For the Time-Varying component, we further design learnable polynomials to learn dynamic correlations by capturing trends or periodic patterns. To learn positive and negative correlations that appear only among some channels, we introduce a novel dual contrastive learning method that identifies correlations through projection layers, regulated by a Heterogeneous-Partial contrastive loss during training, without introducing additional complexity in the inference stage. Extensive experiments on 10 real-world datasets demonstrate that CoRA can improve TSFMs in multivariate forecasting performance.

Related papers

• TiWeaver: Unified Temporal Dynamics Modeling via Contextual Patching [15.279995924017458]
  TiWeaver is a unified framework designed to handle temporal dynamics and fine-grained inter-channel dependencies adaptively.<n>We evaluate TiWeaver on 12 real-world time series datasets, where it achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-06-02T04:06:12Z)
• Improving Day-Ahead Grid Carbon Intensity Forecasting by Joint Modeling of Local-Temporal and Cross-Variable Dependencies Across Different Frequencies [3.1953619915392246]
  Accurate forecasting of the grid carbon intensity factor (CIF) is critical for enabling demand-side management and reducing emissions in modern electricity systems.<n>Despite advances in deep learning-based methods, it remains challenging to capture the fine-grained local-temporal dependencies.<n>We propose a novel model that integrates two parallel modules.
  arXiv  Detail & Related papers  (2026-01-10T11:20:55Z)
• SDGF: Fusing Static and Multi-Scale Dynamic Correlations for Multivariate Time Series Forecasting [9.027814258970684]
  Inter-series correlations are crucial for accurate time series forecasting.<n>These relationships often exhibit complex dynamics across different temporal scales.<n>Existing methods are limited in modeling these multi-scale dependencies.
  arXiv  Detail & Related papers  (2025-09-14T11:23:12Z)
• MFRS: A Multi-Frequency Reference Series Approach to Scalable and Accurate Time-Series Forecasting [51.94256702463408]
  Time series predictability is derived from periodic characteristics at different frequencies.<n>We propose a novel time series forecasting method based on multi-frequency reference series correlation analysis.<n> Experiments on major open and synthetic datasets show state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-03-11T11:40:14Z)
• MGCP: A Multi-Grained Correlation based Prediction Network for Multivariate Time Series [54.91026286579748]
  We propose a Multi-Grained Correlations-based Prediction Network. It simultaneously considers correlations at three levels to enhance prediction performance. It employs adversarial training with an attention mechanism-based predictor and conditional discriminator to optimize prediction results at coarse-grained level.
  arXiv  Detail & Related papers  (2024-05-30T03:32:44Z)
• Mitigating Shortcut Learning with Diffusion Counterfactuals and Diverse Ensembles [104.60508550106618]
  We propose DiffDiv, an ensemble diversification framework exploiting Diffusion Probabilistic Models (DPMs)<n>We show that DPMs can generate images with novel feature combinations, even when trained on samples displaying correlated input features.<n>We show that DPM-guided diversification is sufficient to remove dependence on shortcut cues, without a need for additional supervised signals.
  arXiv  Detail & Related papers  (2023-11-23T15:47:33Z)
• Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection [67.60791405198063]
  We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection. CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module. A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
  arXiv  Detail & Related papers  (2023-07-17T11:04:27Z)
• Robust Detection of Lead-Lag Relationships in Lagged Multi-Factor Models [61.10851158749843]
  Key insights can be obtained by discovering lead-lag relationships inherent in the data. We develop a clustering-driven methodology for robust detection of lead-lag relationships in lagged multi-factor models.
  arXiv  Detail & Related papers  (2023-05-11T10:30:35Z)
• Gaussian Process Latent Variable Modeling for Few-shot Time Series Forecasting [25.612524060553703]
  Time series forecasting is crucial for optimizing resource allocation, industrial production, and urban management.<n>Existing models struggle to capture long-term dependencies and to model diverse meta-knowledge explicitly in few-shot scenarios.<n>We propose MetaGP, a meta-learning-based Gaussian process latent variable model to capture long-term dependencies and to maintain strong correlations in time series.
  arXiv  Detail & Related papers  (2022-12-20T14:54:04Z)
• Multi-scale Attention Flow for Probabilistic Time Series Forecasting [68.20798558048678]
  We propose a novel non-autoregressive deep learning model, called Multi-scale Attention Normalizing Flow(MANF) Our model avoids the influence of cumulative error and does not increase the time complexity. Our model achieves state-of-the-art performance on many popular multivariate datasets.
  arXiv  Detail & Related papers  (2022-05-16T07:53:42Z)
• Pay Attention to Evolution: Time Series Forecasting with Deep Graph-Evolution Learning [33.79957892029931]
  This work presents a novel neural network architecture for time-series forecasting. We named our method Recurrent Graph Evolution Neural Network (ReGENN) An extensive set of experiments was conducted comparing ReGENN with dozens of ensemble methods and classical statistical ones.
  arXiv  Detail & Related papers  (2020-08-28T20:10:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.