Time-Aware Prior Fitted Networks for Zero-Shot Forecasting with Exogenous Variables

• URL: http://arxiv.org/abs/2603.15802v1
• Date: Mon, 16 Mar 2026 18:33:23 GMT
• Title: Time-Aware Prior Fitted Networks for Zero-Shot Forecasting with Exogenous Variables
• Abstract summary: We develop ApolloPFN, a prior-data fitted network (PFN) that is time-aware (unlike prior PFNs)<n>Our design introduces two major advances: (i) a synthetic data generation procedure tailored to resolve the failure modes that arise when PFNs are applied to time series; and (ii) time-aware architectural modifications that embed inductive biases needed to exploit the time series context.
• Score: 59.37476887007663
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In many time series forecasting settings, the target time series is accompanied by exogenous covariates, such as promotions and prices in retail demand; temperature in energy load; calendar and holiday indicators for traffic or sales; and grid load or fuel costs in electricity pricing. Ignoring these exogenous signals can substantially degrade forecasting accuracy, particularly when they drive spikes, discontinuities, or regime and phase changes in the target series. Most current time series foundation models (e.g., Chronos, Sundial, TimesFM, TimeMoE, TimeLLM, and LagLlama) ignore exogenous covariates and make forecasts solely from the numerical time series history, thereby limiting their performance. In this paper, we develop ApolloPFN, a prior-data fitted network (PFN) that is time-aware (unlike prior PFNs) and that natively incorporates exogenous covariates (unlike prior univariate forecasters). Our design introduces two major advances: (i) a synthetic data generation procedure tailored to resolve the failure modes that arise when tabular (non-temporal) PFNs are applied to time series; and (ii) time-aware architectural modifications that embed inductive biases needed to exploit the time series context. We demonstrate that ApolloPFN achieves state-of-the-art results across benchmarks, such as M5 and electric price forecasting, that contain exogenous information.

Related papers

• Preserving Temporal Dynamics in Time Series Generation [0.2099922236065961]
  Time-series data augmentation plays a crucial role in regression-oriented forecasting tasks.<n>Existing approaches primarily focus on matching marginal data distributions.<n>We propose a model-agnostic Markov Chain Monte Carlo framework to mitigate distribution shift and preserve temporal dynamics.
  arXiv  Detail & Related papers  (2026-04-29T20:32:45Z)
• TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting [67.91113180885601]
  TimeAPN explicitly models and predicts non-stationary factors from both the time and frequency domains.<n>TimeAPN consistently improves long-term forecasting accuracy across multiple prediction horizons.<n>It outperforms state-of-the-art reversible normalization methods.
  arXiv  Detail & Related papers  (2026-03-18T07:21:24Z)
• Accelerating Time Series Foundation Models with Speculative Decoding [46.99742287518152]
  Large-scale Transformer-based models have achieved state-of-the-art performance in time-series forecasting but suffer from high computational costs.<n>We propose a general inference acceleration framework that adapts speculative decoding to autoregressive time-series models.<n>Our approach employs a smaller "draft" model to propose future time-series patches, which are then verified in parallel by a larger "target" model.
  arXiv  Detail & Related papers  (2025-11-22T21:04:57Z)
• A Unified Frequency Domain Decomposition Framework for Interpretable and Robust Time Series Forecasting [81.73338008264115]
  Current approaches for time series forecasting, whether in the time or frequency domain, predominantly use deep learning models based on linear layers or transformers.<n>We propose FIRE, a unified frequency domain decomposition framework that provides a mathematical abstraction for diverse types of time series.<n>Fire consistently outperforms state-of-the-art models on long-term forecasting benchmarks.
  arXiv  Detail & Related papers  (2025-10-11T09:59:25Z)
• Time-o1: Time-Series Forecasting Needs Transformed Label Alignment [50.54348432664401]
  Time-o1 is a transformation-augmented learning objective tailored for time-series forecasting.<n>The central idea is to transform the label sequence into decorrelated components with discriminated significance.<n>Time-o1 achieves state-of-the-art performance and is compatible with various forecast models.
  arXiv  Detail & Related papers  (2025-05-23T13:00:35Z)
• How Much Can Time-related Features Enhance Time Series Forecasting? [27.030553080458716]
  We introduce a module designed to encode time-related features, Time Stamp Forecaster (TimeSter)<n>TimeSter significantly improves the performance of a single linear projector, reducing MSE by an average of 23% on benchmark datasets such as Electricity and Traffic.
  arXiv  Detail & Related papers  (2024-12-02T14:45:26Z)
• ExoTST: Exogenous-Aware Temporal Sequence Transformer for Time Series Prediction [11.511830352094353]
  We propose ExoTST, a transformer-based framework for time series prediction. To integrate past and current variables, ExoTST introduces a novel cross-temporal modality fusion module. Experiments on real-world carbon flux datasets and time series benchmarks demonstrate ExoTST's superior performance.
  arXiv  Detail & Related papers  (2024-10-16T03:04:37Z)
• Timer-XL: Long-Context Transformers for Unified Time Series Forecasting [67.83502953961505]
  We present Timer-XL, a causal Transformer for unified time series forecasting.<n>Based on large-scale pre-training, Timer-XL achieves state-of-the-art zero-shot performance.
  arXiv  Detail & Related papers  (2024-10-07T07:27:39Z)
• FAITH: Frequency-domain Attention In Two Horizons for Time Series Forecasting [13.253624747448935]
  Time Series Forecasting plays a crucial role in various fields such as industrial equipment maintenance, meteorology, energy consumption, traffic flow and financial investment. Current deep learning-based predictive models often exhibit a significant deviation between their forecasting outcomes and the ground truth. We propose a novel model Frequency-domain Attention In Two Horizons, which decomposes time series into trend and seasonal components.
  arXiv  Detail & Related papers  (2024-05-22T02:37:02Z)
• Unified Training of Universal Time Series Forecasting Transformers [104.56318980466742]
  We present a Masked-based Universal Time Series Forecasting Transformer (Moirai) Moirai is trained on our newly introduced Large-scale Open Time Series Archive (LOTSA) featuring over 27B observations across nine domains. Moirai achieves competitive or superior performance as a zero-shot forecaster when compared to full-shot models.
  arXiv  Detail & Related papers  (2024-02-04T20:00:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.