Multivariate Time Series Forecasting needs Cross Variable Loss

• URL: http://arxiv.org/abs/2608.05742v1
• Date: Thu, 06 Aug 2026 08:22:45 GMT
• Title: Multivariate Time Series Forecasting needs Cross Variable Loss
• Abstract summary: We propose a plug-in structural regularizer that constrains forecast residuals on a cross-variable graph.<n>CvLoss penalizes inconsistent edge-wise residual differences over forecast patches, encouraging consistency across both synchronous and asynchronous interactions.<n>Our experiments show that CvLoss consistently improves competitive forecasting models, outperforms representative learning objectives, and is compatible with a variety of forecasting backbones.
• Score: 11.325603740473376
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multivariate time series forecasting presents unique challenges because future variables often co-evolve under shared system dynamics. While existing studies mainly focus on cross-variable dependencies in historical observations, dependencies among future values are much less explored. Specifically, modern forecasting models largely follow the Direct Forecasting (DF) paradigm, generating multi-step forecasts with point-wise objectives that do not explicitly constrain cross-variable structure. In this work, we show that the DF objective is mismatched in the presence of cross-variable and lagged dependencies, revealing an objective gap. To address this issue, we propose \textbf{C}ross-\textbf{V}ariable \textbf{Loss} (CvLoss), a plug-in structural regularizer that constrains forecast residuals on a cross-variable graph. CvLoss penalizes inconsistent edge-wise residual differences over forecast patches, encouraging consistency across both synchronous and asynchronous interactions. Our experiments show that CvLoss consistently improves competitive forecasting models, outperforms representative learning objectives, and is compatible with a variety of forecasting backbones.

Related papers

• TFGformer: Multivariate Time Series Forecasting via Time-Frequency Graph Learning and Covariate Fusion [12.980172248250257]
  We propose a retrieval-augmented forecasting framework that integrates Shape-Aware Memory (SAM) with RevIN normalization for magnitude-robust shape-level retrieval.<n>Experiments on seven public benchmarks show that CrossRAG consistently outperforms both parametric-only baselines and existing retrieval-augmented forecasting methods.
  arXiv  Detail & Related papers  (2026-07-31T14:24:26Z)
• Factorize to Generalize: Retrieval-Guided Invariant-Dynamic Decomposition for Time Series Forecasting [64.2640656619583]
  Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction.<n>We propose a Retrieval-guided Invariant-Dynamic DEcomposition framework for time series forecasting.
  arXiv  Detail & Related papers  (2026-05-24T07:31:55Z)
• TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting [67.91113180885601]
  TimeAPN explicitly models and predicts non-stationary factors from both the time and frequency domains.<n>TimeAPN consistently improves long-term forecasting accuracy across multiple prediction horizons.<n>It outperforms state-of-the-art reversible normalization methods.
  arXiv  Detail & Related papers  (2026-03-18T07:21:24Z)
• CITRAS: Covariate-Informed Transformer for Time Series Forecasting [0.49157446832511503]
  We propose CITRAS, a decoder-only Transformer that flexibly leverages multiple targets, past covariates, and future covariates.<n>We show that CITRAS outperforms state-of-the-art models on thirteen real-world benchmarks.
  arXiv  Detail & Related papers  (2025-03-31T12:32:23Z)
• Is Precise Recovery Necessary? A Task-Oriented Imputation Approach for Time Series Forecasting on Variable Subset [27.180618587832463]
  We propose Task-Oriented Imputation for Variable Subset Forecasting (TOI-VSF) for time series forecasting. TOI-VSF incorporates a self-supervised imputation module, agnostic to the forecasting model, designed to fill in missing variables. Extensive experiments across four datasets demonstrate the superiority of TOI-VSF, outperforming baseline methods by $15%$ on average.
  arXiv  Detail & Related papers  (2024-11-15T04:00:54Z)
• TimeBridge: Non-Stationarity Matters for Long-term Time Series Forecasting [49.6208017412376]
  TimeBridge is a novel framework designed to bridge the gap between non-stationarity and dependency modeling.<n>TimeBridge consistently achieves state-of-the-art performance in both short-term and long-term forecasting.
  arXiv  Detail & Related papers  (2024-10-06T10:41:03Z)
• Learning Graph Structures and Uncertainty for Accurate and Calibrated Time-series Forecasting [65.40983982856056]
  We introduce STOIC, that leverages correlations between time-series to learn underlying structure between time-series and to provide well-calibrated and accurate forecasts. Over a wide-range of benchmark datasets STOIC provides 16% more accurate and better-calibrated forecasts.
  arXiv  Detail & Related papers  (2024-07-02T20:14:32Z)
• Probabilistic Learning of Multivariate Time Series with Temporal Irregularity [21.361823581838355]
  Real-world time series often suffer from temporal irregularities, including nonuniform intervals and misaligned variables.<n>We propose an end-to-end framework that models temporal irregularities while capturing the joint distribution of variables at arbitrary continuous-time points.
  arXiv  Detail & Related papers  (2023-06-15T14:08:48Z)
• Cross-LKTCN: Modern Convolution Utilizing Cross-Variable Dependency for Multivariate Time Series Forecasting Dependency for Multivariate Time Series Forecasting [9.433527676880903]
  Key to accurate forecasting results is capturing the long-term dependency between each time step. Recent methods mainly focus on the cross-time dependency but seldom consider the cross-variable dependency. We propose a modern pure convolution structure, namely Cross-LKTCN, to better utilize both cross-time and cross-variable dependency.
  arXiv  Detail & Related papers  (2023-06-04T10:50:52Z)
• The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecasting [50.48888534815361]
  We show that models trained with the Channel Independent (CI) strategy outperform those trained with the Channel Dependent (CD) strategy. Our results conclude that the CD approach has higher capacity but often lacks robustness to accurately predict distributionally drifted time series. We propose a modified CD method called Predict Residuals with Regularization (PRReg) that can surpass the CI strategy.
  arXiv  Detail & Related papers  (2023-04-11T13:15:33Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.