Systematic Evaluation of TabPFN-TS for Zero-Shot Probabilistic Heat Load Forecasting in District Heating Networks

• URL: http://arxiv.org/abs/2608.20024v1
• Date: Thu, 20 Aug 2026 13:33:37 GMT
• Title: Systematic Evaluation of TabPFN-TS for Zero-Shot Probabilistic Heat Load Forecasting in District Heating Networks
• Abstract summary: District energy hubs require reliable heat load forecasts for efficient operational scheduling.<n>Time-series foundation models and in-context forecasting offer a promising alternative.<n>This study systematically evaluates TabPFN-TS against time-series foundation models and trained machine-learning baselines.
• Score: 35.66975292316149
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: District heating energy hubs require reliable heat load forecasts for efficient operational scheduling. Conventional forecasting workflows train system-specific models on historical data, which can become burdensome when networks change through new consumers, retrofits, or changing operating regimes. Zero-shot time-series foundation models and in-context forecasting offer a promising alternative: they can adapt at inference time from recent observations rather than by repeated retraining. This study systematically evaluates TabPFN-TS against time-series foundation models and trained machine-learning baselines for probabilistic heat load forecasting in district heating networks. Unlike foundation models pretrained on large collections of real time series, TabPFN-TS relies on synthetic pretraining data, which avoids direct pretraining-test overlap but raises the question of whether the learned prior captures district heating dynamics. We analyze covariate choice, context length, temporal resolution, and prediction horizon on representative operating weeks, validate the selected configuration over a full year, and test transferability on a second network. The results identify hourly 24-hour forecasting with a 12-week rolling context and ambient temperature as a parsimonious high-performing configuration; longer context windows do not improve accuracy. TabPFN-TS remains close to Chronos-2 in deterministic accuracy, reaching CVRMSE values of 13.06% versus 12.48% on the main dataset, and lies within the critical-difference threshold in the daily-rank comparison. Although Chronos-2 achieves the lowest aggregate full-year error, TabPFN-TS shows better empirical calibration. Finally, the diagnostic findings motivate a Multi-Resolution Residual-Correction Forecaster that combines a low-frequency Base Forecaster with a short-horizon Residual Forecaster to improve longer-horizon planning accuracy.

Related papers

• Improving the sharpness in neural network-based parametric post-processing of ensemble forecasts [0.0]
  We show the effect of a proposed technique on 2m temperature ensemble forecasts of the European Centre for Medium-Range Weather Forecasts.<n>Case studies confirm a substantial relative decrease ($8.2%-12.5%$) in the width of the nominal central prediction interval.<n>There is no deterioration in the mean CRPS of probabilistic forecasts and in the RMSE of the predictive mean.
  arXiv  Detail & Related papers  (2026-06-07T11:57:09Z)
• Benchmarking Transformer and xLSTM for Time-Series Forecasting of Heat Consumption [0.0]
  This paper benchmarks Transformer-based and xLSTM architectures for short-term heat-demand forecasting.<n>We establish a benchmark that tests whether models trained on pooled, heterogeneous building data are able to generalize across diverse building stock.<n>The results show that the xLSTM achieves the lowest RMSE (19.88 kWh for three-hour, 21.47 kWh for 24-hour forecasts), while the Temporal Fusion Transformer attains the best MAE (9.16 kWh for three-hour forecasts)
  arXiv  Detail & Related papers  (2026-05-10T19:40:03Z)
• Tyche: One Step Flow for Efficient Probabilistic Weather Forecasting [48.263481135566316]
  We present Tyche, a one-step conditional flow model for efficient probabilistic weather forecasting.<n>Experiments on ERA5 at 1.5$circ$ and 6-hour resolution show that our Tyche, using merely a single NFE, matches or exceeds the forecast skill and calibration of state-of-the-art multi-step generative baselines.
  arXiv  Detail & Related papers  (2026-05-07T20:25:28Z)
• Echo State Networks for Time Series Forecasting: Hyperparameter Sweep and Benchmarking [51.56484100374058]
  We evaluate whether a fully automatic, purely feedback-driven ESN can serve as a competitive alternative to widely used statistical forecasting methods.<n>Forecast accuracy is measured using MASE and sMAPE and benchmarked against simple benchmarks like drift and seasonal naive and statistical models.
  arXiv  Detail & Related papers  (2026-02-03T16:01:22Z)
• A Unified Frequency Domain Decomposition Framework for Interpretable and Robust Time Series Forecasting [81.73338008264115]
  Current approaches for time series forecasting, whether in the time or frequency domain, predominantly use deep learning models based on linear layers or transformers.<n>We propose FIRE, a unified frequency domain decomposition framework that provides a mathematical abstraction for diverse types of time series.<n>Fire consistently outperforms state-of-the-art models on long-term forecasting benchmarks.
  arXiv  Detail & Related papers  (2025-10-11T09:59:25Z)
• Estimating Time Series Foundation Model Transferability via In-Context Learning [74.65355820906355]
  Time series foundation models (TSFMs) offer strong zero-shot forecasting via large-scale pre-training.<n>Fine-tuning remains critical for boosting performance in domains with limited public data.<n>We introduce TimeTic, a transferability estimation framework that recasts model selection as an in-context-learning problem.
  arXiv  Detail & Related papers  (2025-09-28T07:07:13Z)
• Empirical Comparison of Lightweight Forecasting Models for Seasonal and Non-Seasonal Time Series [1.9799527196428246]
  This study provides an empirical comparison between a Polynomial and a Radial Basis Network (RBFNN)<n>Model performance is evaluated by forecasting accuracy (using Mean Absolute Error, Root Mean Squared Error, and Coefficient Function of Variation of Root Mean Squared Error) and computational time.<n>Results show that the PC yields more accurate and faster forecasts for non seasonal series, whereas RBFNN performs better on seasonal patterns.
  arXiv  Detail & Related papers  (2025-05-02T10:12:23Z)
• Battling the Non-stationarity in Time Series Forecasting via Test-time Adaptation [39.7344214193566]
  We introduce a pioneering test-time adaptation framework tailored for time series forecasting (TSF)<n>TAFAS, the proposed approach to TSF-TTA, flexibly adapts source forecasters to continuously shifting test distributions while preserving the core semantic information learned during pre-training.<n>The novel utilization of partially-observed ground truth and gated calibration module enables proactive, robust, and model-agnostic adaptation of source forecasters.
  arXiv  Detail & Related papers  (2025-01-09T04:59:15Z)
• Learning When to See for Long-term Traffic Data Collection on Power-constrained Devices [7.712009864814493]
  We introduce a novel learning-based framework that strategically decides observation timings for battery-powered devices. We reconstruct the full data stream from sparsely sampled observations, resulting in minimal performance loss. We evaluate the performance of the proposed method on PeMS data by an RNN (Recurrent Neural Network) predictor and estimator, and a DRQN (Deep Recurrent Q-Network) controller.
  arXiv  Detail & Related papers  (2024-01-25T20:50:34Z)
• When Rigidity Hurts: Soft Consistency Regularization for Probabilistic Hierarchical Time Series Forecasting [69.30930115236228]
  Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting. Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions. We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
  arXiv  Detail & Related papers  (2023-10-17T20:30:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.