On-line conformalized neural networks ensembles for probabilistic forecasting of day-ahead electricity prices

• URL: http://arxiv.org/abs/2404.02722v2
• Date: Mon, 10 Jun 2024 09:13:29 GMT
• Title: On-line conformalized neural networks ensembles for probabilistic forecasting of day-ahead electricity prices
• Authors: Alessandro Brusaferri, Andrea Ballarino, Luigi Grossi, Fabrizio Laurini,
• Abstract summary: We propose a novel approach to PEPF, extending the state of the art neural networks ensembles based methods through conformal inference based techniques. Experiments have been conducted on multiple market regions, achieving day-ahead forecasts with improved hourly coverage and stable probabilistic scores.
• Score: 41.94295877935867
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Probabilistic electricity price forecasting (PEPF) is subject of increasing interest, following the demand for proper quantification of prediction uncertainty, to support the operation in complex power markets with increasing share of renewable generation. Distributional neural networks ensembles have been recently shown to outperform state of the art PEPF benchmarks. Still, they require critical reliability enhancements, as fail to pass the coverage tests at various steps on the prediction horizon. In this work, we propose a novel approach to PEPF, extending the state of the art neural networks ensembles based methods through conformal inference based techniques, deployed within an on-line recalibration procedure. Experiments have been conducted on multiple market regions, achieving day-ahead forecasts with improved hourly coverage and stable probabilistic scores.

Related papers

• Any-Quantile Probabilistic Forecasting of Short-Term Electricity Demand [8.068451210598678]
  Power systems operate under uncertainty originating from multiple factors that are impossible to account for deterministically. Recent progress in deep learning has helped to significantly improve the accuracy of point forecasts. We propose a novel general approach for distributional forecasting capable of predicting arbitrary quantiles.
  arXiv  Detail & Related papers  (2024-04-26T14:43:19Z)
• Probabilistic Forecasting of Real-Time Electricity Market Signals via Interpretable Generative AI [41.99446024585741]
  We present WIAE-GPF, a Weak Innovation AutoEncoder-based Generative Probabilistic Forecasting architecture. A novel learning algorithm with structural convergence guarantees is proposed, ensuring that the generated forecast samples match the ground truth conditional probability distribution.
  arXiv  Detail & Related papers  (2024-03-09T00:41:30Z)
• Generative Probabilistic Time Series Forecasting and Applications in Grid Operations [47.19756484695248]
  Generative probabilistic forecasting produces future time series samples according to the conditional probability distribution given past time series observations. We propose a weak innovation autoencoder architecture and a learning algorithm to extract independent and identically distributed innovation sequences. We show that the weak innovation sequence is Bayesian sufficient, which makes the proposed weak innovation autoencoder a canonical architecture for generative probabilistic forecasting.
  arXiv  Detail & Related papers  (2024-02-21T15:23:21Z)
• When Rigidity Hurts: Soft Consistency Regularization for Probabilistic Hierarchical Time Series Forecasting [69.30930115236228]
  Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting. Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions. We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
  arXiv  Detail & Related papers  (2023-10-17T20:30:16Z)
• Combining predictive distributions of electricity prices: Does minimizing the CRPS lead to optimal decisions in day-ahead bidding? [0.0]
  We study whether using CRPS learning, a novel weighting technique, leads to optimal decisions in day-ahead bidding. We find that increasing the diversity of an ensemble can have a positive impact on accuracy. The higher computational cost of using CRPS learning compared to an equal-weighted aggregation of distributions is not offset by higher profits.
  arXiv  Detail & Related papers  (2023-08-29T17:10:38Z)
• Distributional neural networks for electricity price forecasting [0.0]
  We present a novel approach to probabilistic electricity price forecasting (EPF) The novel network structure for EPF is based on a regularized distributional multilayer perceptron (DMLP) Using the framework, the neural network's output is defined to be a distribution, either normal or potentially skewed and heavy-tailed Johnson's SU (JSU)
  arXiv  Detail & Related papers  (2022-07-06T17:42:52Z)
• When Rigidity Hurts: Soft Consistency Regularization for Probabilistic Hierarchical Time Series Forecasting [69.30930115236228]
  Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting. Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions. We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
  arXiv  Detail & Related papers  (2022-06-16T06:13:53Z)
• Quantifying Uncertainty in Deep Spatiotemporal Forecasting [67.77102283276409]
  We describe two types of forecasting problems: regular grid-based and graph-based. We analyze UQ methods from both the Bayesian and the frequentist point view, casting in a unified framework via statistical decision theory. Through extensive experiments on real-world road network traffic, epidemics, and air quality forecasting tasks, we reveal the statistical computational trade-offs for different UQ methods.
  arXiv  Detail & Related papers  (2021-05-25T14:35:46Z)
• Probabilistic electric load forecasting through Bayesian Mixture Density Networks [70.50488907591463]
  Probabilistic load forecasting (PLF) is a key component in the extended tool-chain required for efficient management of smart energy grids. We propose a novel PLF approach, framed on Bayesian Mixture Density Networks. To achieve reliable and computationally scalable estimators of the posterior distributions, both Mean Field variational inference and deep ensembles are integrated.
  arXiv  Detail & Related papers  (2020-12-23T16:21:34Z)
• Probabilistic Load Forecasting Based on Adaptive Online Learning [7.373617024876726]
  This paper presents a method for probabilistic load forecasting based on the adaptive online learning of hidden Markov models. We propose learning and forecasting techniques with theoretical guarantees, and experimentally assess their performance in multiple scenarios. The results show that the proposed method can significantly improve the performance of existing techniques for a wide range of scenarios.
  arXiv  Detail & Related papers  (2020-11-30T12:02:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.