Explainable Load Forecasting with Covariate-Informed Time Series Foundation Models

• URL: http://arxiv.org/abs/2604.28149v1
• Date: Thu, 30 Apr 2026 17:36:24 GMT
• Title: Explainable Load Forecasting with Covariate-Informed Time Series Foundation Models
• Abstract summary: Time Series Foundation Models (TSFMs) have recently emerged as general-purpose forecasting models.<n>We propose an efficient algorithm for computing Shapley Additive Explanations (SHAP) tailored to these models.<n>We demonstrate that TSFMs can serve as transparent and reliable tools for operational energy forecasting.
• Score: 38.33974575909916
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Time Series Foundation Models (TSFMs) have recently emerged as general-purpose forecasting models and show considerable potential for applications in energy systems. However, applications in critical infrastructure like power grids require transparency to ensure trust and reliability and cannot rely on pure black-box models. To enhance the transparency of TSFMs, we propose an efficient algorithm for computing Shapley Additive Explanations (SHAP) tailored to these models. The proposed approach leverages the flexibility of TSFMs with respect to input context length and provided covariates. This property enables efficient temporal and covariate masking (selectively withholding inputs), allowing for a scalable explanation of model predictions using SHAP. We evaluate two TSFMs - Chronos-2 and TabPFN-TS - on a day-ahead load forecasting task for a transmission system operator (TSO). In a zero-shot setting, both models achieve predictive performance competitive with a Transformer model trained specifically on multiple years of TSO data. The explanations obtained through our proposed approach align with established domain knowledge, particularly as the TSFMs appropriately use weather and calendar information for load prediction. Overall, we demonstrate that TSFMs can serve as transparent and reliable tools for operational energy forecasting.

Related papers

• Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
  Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T11:40:39Z)
• RefineBridge: Generative Bridge Models Improve Financial Forecasting by Foundation Models [7.099080844853931]
  Financial time series forecasting is challenging due to non-stationarity, heavy-tailed distributions, and high-frequency noise.<n>Low-rank adaptation (LoRA) has become a popular parameter-efficient method for adapting pre-trained TSFMs to downstream data domains.<n>We propose a novel refinement module, RefineBridge, built upon a tractable Schrdinger Bridge (SB)generative framework.
  arXiv  Detail & Related papers  (2025-12-25T08:28:16Z)
• Estimating Time Series Foundation Model Transferability via In-Context Learning [74.65355820906355]
  Time series foundation models (TSFMs) offer strong zero-shot forecasting via large-scale pre-training.<n>Fine-tuning remains critical for boosting performance in domains with limited public data.<n>We introduce TimeTic, a transferability estimation framework that recasts model selection as an in-context-learning problem.
  arXiv  Detail & Related papers  (2025-09-28T07:07:13Z)
• TFMAdapter: Lightweight Instance-Level Adaptation of Foundation Models for Forecasting with Covariates [21.978694988304692]
  Time Series Foundation Models (TSFMs) have recently achieved state-of-the-art performance in univariate forecasting on new time series.<n>We propose TFMAdapter, a lightweight, instance-level adapter that augments TSFMs with covariate information without fine-tuning.<n>Extensive experiments on real-world datasets demonstrate that TFMAdapter consistently outperforms both foundation models and supervised baselines.
  arXiv  Detail & Related papers  (2025-09-17T11:13:14Z)
• WindFM: An Open-Source Foundation Model for Zero-Shot Wind Power Forecasting [18.100611997642257]
  This paper introduces WindFM, a lightweight and generative Foundation Model for wind power forecasting.<n>WindFM learns a universal representation of wind generation dynamics by autoregressively pre-training on these token sequences.<n>Our experiments demonstrate that WindFM achieves state-of-the-art zero-shot performance on both deterministic and probabilistic tasks.
  arXiv  Detail & Related papers  (2025-09-08T03:26:18Z)
• Multi-Scale Finetuning for Encoder-based Time Series Foundation Models [67.95907033226585]
  Time series foundation models (TSFMs) demonstrate impressive zero-shot performance for time series forecasting.<n>While naive finetuning can yield performance gains, we argue that it falls short of fully leveraging TSFMs' capabilities.<n>We propose Multiscale finetuning (MSFT), a simple yet general framework that explicitly integrates multi-scale modeling into the finetuning process.
  arXiv  Detail & Related papers  (2025-06-17T01:06:01Z)
• Can Time-Series Foundation Models Perform Building Energy Management Tasks? [5.450531952940644]
  Building energy management tasks require processing and learning from a variety of time-series data.<n>Existing solutions rely on bespoke task- and data-specific models to perform these tasks.<n>Inspired by the transformative success of Large Language Models (LLMs), Time-Series Foundation Models (TSFMs) have the potential to change this.
  arXiv  Detail & Related papers  (2025-06-12T19:45:10Z)
• Less is More: Unlocking Specialization of Time Series Foundation Models via Structured Pruning [27.23328609888911]
  Time Series Foundation Models pre-train vast parameters and achieve remarkable zero-shot forecasting performance.<n>Surprisingly, even after fine-tuning, TSFMs cannot consistently outperform smaller, specialized models trained on full-shot downstream data.<n>We propose a structured pruning method to regularize the subsequent fine-tuning process by focusing it on a more relevant and compact parameter space.
  arXiv  Detail & Related papers  (2025-05-29T07:33:49Z)
• Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distribution [57.71199089609161]
  Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational self-attention mechanism. We propose an efficient Transformerbased model, named Conformer, which differentiates itself from existing methods for LTTF in three aspects.
  arXiv  Detail & Related papers  (2023-01-05T13:59:29Z)
• Probabilistic electric load forecasting through Bayesian Mixture Density Networks [70.50488907591463]
  Probabilistic load forecasting (PLF) is a key component in the extended tool-chain required for efficient management of smart energy grids. We propose a novel PLF approach, framed on Bayesian Mixture Density Networks. To achieve reliable and computationally scalable estimators of the posterior distributions, both Mean Field variational inference and deep ensembles are integrated.
  arXiv  Detail & Related papers  (2020-12-23T16:21:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.