Predicting and Publishing Accurate Imbalance Prices Using Monte Carlo Tree Search

• URL: http://arxiv.org/abs/2411.04011v1
• Date: Wed, 06 Nov 2024 15:49:28 GMT
• Title: Predicting and Publishing Accurate Imbalance Prices Using Monte Carlo Tree Search
• Authors: Fabio Pavirani, Jonas Van Gompel, Seyed Soroush Karimi Madahi, Bert Claessens, Chris Develder,
• Abstract summary: We propose a Monte Carlo Tree Search method that publishes accurate imbalance prices while accounting for potential response actions. Our approach models the system dynamics using a neural network forecaster and a cluster of virtual batteries controlled by reinforcement learning agents.
• Score: 4.950434218152639
• License:
• Abstract: The growing reliance on renewable energy sources, particularly solar and wind, has introduced challenges due to their uncontrollable production. This complicates maintaining the electrical grid balance, prompting some transmission system operators in Western Europe to implement imbalance tariffs that penalize unsustainable power deviations. These tariffs create an implicit demand response framework to mitigate grid instability. Yet, several challenges limit active participation. In Belgium, for example, imbalance prices are only calculated at the end of each 15-minute settlement period, creating high risk due to price uncertainty. This risk is further amplified by the inherent volatility of imbalance prices, discouraging participation. Although transmission system operators provide minute-based price predictions, the system imbalance volatility makes accurate price predictions challenging to obtain and requires sophisticated techniques. Moreover, publishing price estimates can prompt participants to adjust their schedules, potentially affecting the system balance and the final price, adding further complexity. To address these challenges, we propose a Monte Carlo Tree Search method that publishes accurate imbalance prices while accounting for potential response actions. Our approach models the system dynamics using a neural network forecaster and a cluster of virtual batteries controlled by reinforcement learning agents. Compared to Belgium's current publication method, our technique improves price accuracy by 20.4% under ideal conditions and by 12.8% in more realistic scenarios. This research addresses an unexplored, yet crucial problem, positioning this paper as a pioneering work in analyzing the potential of more advanced imbalance price publishing techniques.

Related papers

• Control Policy Correction Framework for Reinforcement Learning-based Energy Arbitrage Strategies [4.950434218152639]
  We propose a new RL-based control framework for batteries to obtain a safe energy arbitrage strategy in the imbalance settlement mechanism. We use the Belgian imbalance price of 2023 to evaluate the performance of our proposed framework.
  arXiv  Detail & Related papers  (2024-04-29T16:03:21Z)
• Probabilistic forecasting of power system imbalance using neural network-based ensembles [4.573008040057806]
  We propose an ensemble of C-VSNs, which are our adaptation of variable selection networks (VSNs) Each minute, our model predicts the imbalance of the current and upcoming two quarter-hours, along with uncertainty estimations on these forecasts. For high imbalance magnitude situations, our model outperforms the state-of-the-art by 23.4%.
  arXiv  Detail & Related papers  (2024-04-23T08:42:35Z)
• Distributional Reinforcement Learning-based Energy Arbitrage Strategies in Imbalance Settlement Mechanism [6.520803851931361]
  Growth in the penetration of renewable energy sources makes supply more uncertain and leads to an increase in the system imbalance. We propose a battery control framework based on distributional reinforcement learning (DRL) Our proposed control framework takes a risk-sensitive perspective, allowing BRPs to adjust their risk preferences.
  arXiv  Detail & Related papers  (2023-12-23T15:38:31Z)
• Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction [54.21695754082441]
  Multi-step stock price prediction over a long-term horizon is crucial for forecasting its volatility. Current solutions to multi-step stock price prediction are mostly designed for single-step, classification-based predictions. We combine a deep hierarchical variational-autoencoder (VAE) and diffusion probabilistic techniques to do seq2seq stock prediction. Our model is shown to outperform state-of-the-art solutions in terms of its prediction accuracy and variance.
  arXiv  Detail & Related papers  (2023-08-18T16:21:15Z)
• Price-Aware Deep Learning for Electricity Markets [58.3214356145985]
  We propose to embed electricity market-clearing optimization as a deep learning layer. Differentiating through this layer allows for balancing between prediction and pricing errors. We showcase the price-aware deep learning in the nexus of wind power forecasting and short-term electricity market clearing.
  arXiv  Detail & Related papers  (2023-08-02T21:16:05Z)
• Bayesian Bilinear Neural Network for Predicting the Mid-price Dynamics in Limit-Order Book Markets [84.90242084523565]
  Traditional time-series econometric methods often appear incapable of capturing the true complexity of the multi-level interactions driving the price dynamics. By adopting a state-of-the-art second-order optimization algorithm, we train a Bayesian bilinear neural network with temporal attention. By addressing the use of predictive distributions to analyze errors and uncertainties associated with the estimated parameters and model forecasts, we thoroughly compare our Bayesian model with traditional ML alternatives.
  arXiv  Detail & Related papers  (2022-03-07T18:59:54Z)
• Prescribing net demand for two-stage electricity generation scheduling [0.0]
  We consider a two-stage generation scheduling problem comprising a forward dispatch and a real-time re-dispatch. Standard industry practice deals with the uncertain net demand in the forward stage by replacing it with a good estimate of its conditional expectation. We propose a bilevel program to construct a prescription of the net demand that does account for the power system's cost asymmetry.
  arXiv  Detail & Related papers  (2021-08-02T16:05:53Z)
• Probabilistic Forecasting of Imbalance Prices in the Belgian Context [32.17079308878932]
  A novel two-step probabilistic approach is proposed, with a particular focus on the Belgian case. The first step consists of computing the net regulation volume state transition probabilities. The corresponding marginal prices for each activation level are published by the Belgian Transmission System Operator one day before electricity delivery.
  arXiv  Detail & Related papers  (2021-06-09T13:02:34Z)
• The impact of online machine-learning methods on long-term investment decisions and generator utilization in electricity markets [69.68068088508505]
  We investigate the impact of eleven offline and five online learning algorithms to predict the electricity demand profile over the next 24h. We show we can reduce the mean absolute error by 30% using an online algorithm when compared to the best offline algorithm. We also show that large errors in prediction accuracy have a disproportionate error on investments made over a 17-year time frame.
  arXiv  Detail & Related papers  (2021-03-07T11:28:54Z)
• Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids [56.35173057183362]
  We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. We propose the formulation of a smart grid environment as a Markov game.
  arXiv  Detail & Related papers  (2020-05-05T07:32:40Z)
• Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting [91.43582419264763]
  We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of optimism in the face of uncertainty. LqgOpt efficiently explores the system dynamics, estimates the model parameters up to their confidence interval, and deploys the controller of the most optimistic model.
  arXiv  Detail & Related papers  (2020-03-12T19:56:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.