Bayesian Hierarchical Probabilistic Forecasting of Intraday Electricity Prices
- URL: http://arxiv.org/abs/2403.05441v2
- Date: Tue, 30 Jul 2024 14:46:12 GMT
- Title: Bayesian Hierarchical Probabilistic Forecasting of Intraday Electricity Prices
- Authors: Daniel Nickelsen, Gernot Müller,
- Abstract summary: We present a first study of Bayesian forecasting of electricity prices traded on the German continuous intraday market.
For validation we use the exceedingly volatile electricity prices of 2022, which have hardly been the subject of forecasting studies before.
We challenge the declared gold standard of using LASSO for feature selection in electricity price forecasting by presenting strong statistical evidence that OMP leads to better forecasting performance.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: We present a first study of Bayesian forecasting of electricity prices traded on the German continuous intraday market which fully incorporates parameter uncertainty. A particularly large set of endogenous and exogenous covariables is used, handled through feature selection with Orthogonal Matching Pursuit (OMP) and regularising priors. Our target variable is the IDFull price index, forecasts are given in terms of posterior predictive distributions. For validation we use the exceedingly volatile electricity prices of 2022, which have hardly been the subject of forecasting studies before. As a benchmark model, we use all available intraday transactions at the time of forecast creation to compute a current value for the IDFull. According to the weak-form efficiency hypothesis, it would not be possible to significantly improve this benchmark built from last price information. We do, however, observe statistically significant improvement in terms of both point measures and probability scores. Finally, we challenge the declared gold standard of using LASSO for feature selection in electricity price forecasting by presenting strong statistical evidence that OMP leads to better forecasting performance.
Related papers
- F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data [65.6499834212641]
We formulate the demand prediction as a meta-learning problem and develop the Feature-based First-Order Model-Agnostic Meta-Learning (F-FOMAML) algorithm.
By considering domain similarities through task-specific metadata, our model improved generalization, where the excess risk decreases as the number of training tasks increases.
Compared to existing state-of-the-art models, our method demonstrates a notable improvement in demand prediction accuracy, reducing the Mean Absolute Error by 26.24% on an internal vending machine dataset and by 1.04% on the publicly accessible JD.com dataset.
arXiv Detail & Related papers (2024-06-23T21:28:50Z) - Revisiting Day-ahead Electricity Price: Simple Model Save Millions [7.088576782842557]
We propose a simple piecewise linear model that significantly enhances forecast accuracy by directly deriving prices from readily forecastable demand-supply values.
Experiments in the day-ahead electricity markets of Shanxi province and ISO New England reveal that such forecasts could potentially save residents millions of dollars a year.
arXiv Detail & Related papers (2024-05-20T08:27:14Z) - Postprocessing of point predictions for probabilistic forecasting of day-ahead electricity prices: The benefits of using isotonic distributional regression [0.0]
We examine three postprocessing methods for converting point forecasts of day-ahead electricity prices into probabilistic ones.
We find that while the latter demonstrates the most varied behavior, it contributes the most to the ensemble of the predictive distributions.
Remarkably, the performance of the combination is superior to that of state-of-the-art Distributional Deep Neural Networks over two 4.5-year test periods from the German and Spanish power markets.
arXiv Detail & Related papers (2024-04-02T19:50:36Z) - A probabilistic forecast methodology for volatile electricity prices in
the Australian National Electricity Market [0.36832029288386137]
The South Australia region of the Australian National Electricity Market displays some of the highest levels of price volatility observed in modern electricity markets.
This paper outlines an approach to probabilistic forecasting under these extreme conditions, including spike filtration and several post-processing steps.
arXiv Detail & Related papers (2023-11-13T12:33:33Z) - Combining predictive distributions of electricity prices: Does
minimizing the CRPS lead to optimal decisions in day-ahead bidding? [0.0]
We study whether using CRPS learning, a novel weighting technique, leads to optimal decisions in day-ahead bidding.
We find that increasing the diversity of an ensemble can have a positive impact on accuracy.
The higher computational cost of using CRPS learning compared to an equal-weighted aggregation of distributions is not offset by higher profits.
arXiv Detail & Related papers (2023-08-29T17:10:38Z) - Diffusion Variational Autoencoder for Tackling Stochasticity in
Multi-Step Regression Stock Price Prediction [54.21695754082441]
Multi-step stock price prediction over a long-term horizon is crucial for forecasting its volatility.
Current solutions to multi-step stock price prediction are mostly designed for single-step, classification-based predictions.
We combine a deep hierarchical variational-autoencoder (VAE) and diffusion probabilistic techniques to do seq2seq stock prediction.
Our model is shown to outperform state-of-the-art solutions in terms of its prediction accuracy and variance.
arXiv Detail & Related papers (2023-08-18T16:21:15Z) - Prediction-Oriented Bayesian Active Learning [51.426960808684655]
Expected predictive information gain (EPIG) is an acquisition function that measures information gain in the space of predictions rather than parameters.
EPIG leads to stronger predictive performance compared with BALD across a range of datasets and models.
arXiv Detail & Related papers (2023-04-17T10:59:57Z) - Confidence and Dispersity Speak: Characterising Prediction Matrix for
Unsupervised Accuracy Estimation [51.809741427975105]
This work aims to assess how well a model performs under distribution shifts without using labels.
We use the nuclear norm that has been shown to be effective in characterizing both properties.
We show that the nuclear norm is more accurate and robust in accuracy than existing methods.
arXiv Detail & Related papers (2023-02-02T13:30:48Z) - Multivariate Probabilistic Forecasting of Intraday Electricity Prices
using Normalizing Flows [62.997667081978825]
In Germany, the intraday electricity price typically fluctuates around the day-ahead price of the EPEX spot markets in a distinct hourly pattern.
This work proposes a probabilistic modeling approach that models the intraday price difference to the day-ahead contracts.
arXiv Detail & Related papers (2022-05-27T08:38:20Z) - Stock Price Prediction Under Anomalous Circumstances [81.37657557441649]
This paper aims to capture the movement pattern of stock prices under anomalous circumstances.
We train ARIMA and LSTM models at the single-stock level, industry level, and general market level.
Based on 100 companies' stock prices in the period of 2016 to 2020, the models achieve an average prediction accuracy of 98%.
arXiv Detail & Related papers (2021-09-14T18:50:38Z) - Ensemble Forecasting for Intraday Electricity Prices: Simulating
Trajectories [0.0]
Recent studies have shown that the hourly German Intraday Continuous Market is weak-form efficient.
A probabilistic forecasting of the hourly intraday electricity prices is performed by simulating trajectories in every trading window.
The study aims to forecast the price distribution in the German Intraday Continuous Market in the last 3 hours of trading, but the approach allows for application to other continuous markets, especially in Europe.
arXiv Detail & Related papers (2020-05-04T10:21:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.