Deep Reinforcement Learning for Long Term Hydropower Production Scheduling

• URL: http://arxiv.org/abs/2012.06312v1
• Date: Wed, 9 Dec 2020 13:39:09 GMT
• Title: Deep Reinforcement Learning for Long Term Hydropower Production Scheduling
• Authors: Signe Riemer-Sorensen, Gjert H. Rosenlund
• Abstract summary: We explore the use of deep reinforcement learning to provide strategies for long term scheduling of hydropower production. We consider a use-case where the aim is to optimise the yearly revenue given week-by-week inflows to the reservoir and electricity prices. The presented model is not ready to substitute traditional optimisation tools but demonstrates the complementary potential of reinforcement learning in the data-rich field of hydropower scheduling.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: We explore the use of deep reinforcement learning to provide strategies for long term scheduling of hydropower production. We consider a use-case where the aim is to optimise the yearly revenue given week-by-week inflows to the reservoir and electricity prices. The challenge is to decide between immediate water release at the spot price of electricity and storing the water for later power production at an unknown price, given constraints on the system. We successfully train a soft actor-critic algorithm on a simplified scenario with historical data from the Nordic power market. The presented model is not ready to substitute traditional optimisation tools but demonstrates the complementary potential of reinforcement learning in the data-rich field of hydropower scheduling.

Related papers

• Deep learning-based flow disaggregation for short-term hydropower plant operations [2.4874453414078896]
  High temporal resolution data plays a vital role in effective short-term hydropower plant operations. In this study, we propose a deep learning-based time series disaggregation model to derive hourly inflow data from daily inflow data for short-term hydropower plant operations.
  arXiv  Detail & Related papers  (2023-08-11T10:52:43Z)
• Price-Aware Deep Learning for Electricity Markets [58.3214356145985]
  We propose to embed electricity market-clearing optimization as a deep learning layer. Differentiating through this layer allows for balancing between prediction and pricing errors. We showcase the price-aware deep learning in the nexus of wind power forecasting and short-term electricity market clearing.
  arXiv  Detail & Related papers  (2023-08-02T21:16:05Z)
• Rapid Flood Inundation Forecast Using Fourier Neural Operator [77.30160833875513]
  Flood inundation forecast provides critical information for emergency planning before and during flood events. High-resolution hydrodynamic modeling has become more accessible in recent years, however, predicting flood extents at the street and building levels in real-time is still computationally demanding. We present a hybrid process-based and data-driven machine learning (ML) approach for flood extent and inundation depth prediction.
  arXiv  Detail & Related papers  (2023-07-29T22:49:50Z)
• Multiobjective Hydropower Reservoir Operation Optimization with Transformer-Based Deep Reinforcement Learning [14.376630486051795]
  The proposed approach is applied to Lake Mead and Lake Powell in the Colorado River Basin. It produces 10.11% more electricity, reduce the amended annual proportional flow deviation by 39.69%, and increase water supply revenue by 4.10%.
  arXiv  Detail & Related papers  (2023-07-11T10:38:31Z)
• Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach [48.18355658448509]
  Recent breakthroughs in generative artificial intelligence have triggered a surge in demand for machine learning training, which poses significant cost burdens and environmental challenges due to its substantial energy consumption. Scheduling training jobs among geographically distributed cloud data centers unveils the opportunity to optimize the usage of computing capacity powered by inexpensive and low-carbon energy. We propose an algorithm based on multi-agent reinforcement learning and actor-critic methods to learn the optimal collaborative scheduling strategy through interacting with a cloud system built with real-life workload patterns, energy prices, and carbon intensities.
  arXiv  Detail & Related papers  (2023-04-17T02:12:30Z)
• Real-time scheduling of renewable power systems through planning-based reinforcement learning [13.65517429683729]
  renewable energy sources have posed significant challenges to traditional power scheduling. New developments in reinforcement learning have demonstrated the potential to solve this problem. We are the first to propose a systematic solution based on the state-of-the-art reinforcement learning algorithm and the real power grid environment.
  arXiv  Detail & Related papers  (2023-03-09T12:19:20Z)
• Prediction-Free, Real-Time Flexible Control of Tidal Lagoons through Proximal Policy Optimisation: A Case Study for the Swansea Lagoon [0.0]
  We propose a novel optimised operation of tidal lagoons with proximal policy optimisation through Unity ML-Agents. We show that our approach is successful in maximising energy generation through an optimised operational policy of turbines and sluices.
  arXiv  Detail & Related papers  (2021-06-18T21:34:12Z)
• The impact of online machine-learning methods on long-term investment decisions and generator utilization in electricity markets [69.68068088508505]
  We investigate the impact of eleven offline and five online learning algorithms to predict the electricity demand profile over the next 24h. We show we can reduce the mean absolute error by 30% using an online algorithm when compared to the best offline algorithm. We also show that large errors in prediction accuracy have a disproportionate error on investments made over a 17-year time frame.
  arXiv  Detail & Related papers  (2021-03-07T11:28:54Z)
• A Deep Learning Forecaster with Exogenous Variables for Day-Ahead Locational Marginal Price [0.0]
  We propose a deep learning model to forecast day-ahead locational marginal price (daLMP) in deregulated energy markets. This article shows how the proposed model outperforms traditional time series techniques while supporting risk-based analysis of shutdown decisions.
  arXiv  Detail & Related papers  (2020-10-13T16:34:13Z)
• Predictive Analytics for Water Asset Management: Machine Learning and Survival Analysis [55.41644538483948]
  We study a statistical and machine learning framework for the prediction of water pipe failures. We use a dataset containing the failure records of all pipes within the water distribution network in Barcelona, Spain. The results shed light on the effect of important risk factors, such as pipe geometry, age, material, and soil cover, among others.
  arXiv  Detail & Related papers  (2020-07-02T19:08:36Z)
• Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids [56.35173057183362]
  We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. We propose the formulation of a smart grid environment as a Markov game.
  arXiv  Detail & Related papers  (2020-05-05T07:32:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.