Multiobjective Hydropower Reservoir Operation Optimization with Transformer-Based Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2307.05643v1
• Date: Tue, 11 Jul 2023 10:38:31 GMT
• Title: Multiobjective Hydropower Reservoir Operation Optimization with Transformer-Based Deep Reinforcement Learning
• Authors: Rixin Wu, Ran Wang, Jie Hao, Qiang Wu, Ping Wang
• Abstract summary: The proposed approach is applied to Lake Mead and Lake Powell in the Colorado River Basin. It produces 10.11% more electricity, reduce the amended annual proportional flow deviation by 39.69%, and increase water supply revenue by 4.10%.
• Score: 14.376630486051795
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Due to shortage of water resources and increasing water demands, the joint operation of multireservoir systems for balancing power generation, ecological protection, and the residential water supply has become a critical issue in hydropower management. However, the numerous constraints and nonlinearity of multiple reservoirs make solving this problem time-consuming. To address this challenge, a deep reinforcement learning approach that incorporates a transformer framework is proposed. The multihead attention mechanism of the encoder effectively extracts information from reservoirs and residential areas, and the multireservoir attention network of the decoder generates suitable operational decisions. The proposed method is applied to Lake Mead and Lake Powell in the Colorado River Basin. The experimental results demonstrate that the transformer-based deep reinforcement learning approach can produce appropriate operational outcomes. Compared to a state-of-the-art method, the operation strategies produced by the proposed approach generate 10.11% more electricity, reduce the amended annual proportional flow deviation by 39.69%, and increase water supply revenue by 4.10%. Consequently, the proposed approach offers an effective method for the multiobjective operation of multihydropower reservoir systems.

Related papers

• Function Approximation for Reinforcement Learning Controller for Energy from Spread Waves [69.9104427437916]
  Multi-generator Wave Energy Converters (WEC) must handle multiple simultaneous waves coming from different directions called spread waves. These complex devices need controllers with multiple objectives of energy capture efficiency, reduction of structural stress to limit maintenance, and proactive protection against high waves. In this paper, we explore different function approximations for the policy and critic networks in modeling the sequential nature of the system dynamics.
  arXiv  Detail & Related papers  (2024-04-17T02:04:10Z)
• A Novel Hybrid Algorithm for Optimized Solutions in Ocean Renewable Energy Industry: Enhancing Power Take-Off Parameters and Site Selection Procedure of Wave Energy Converters [0.0]
  Ocean renewable energy, particularly wave energy, has emerged as a pivotal component for diversifying the global energy portfolio. This study delves into the optimization of power take-off (PTO) parameters and the site selection process for an offshore oscillating surge wave energy converter (OSWEC) By employing the HC-EGWO method, we achieved an upswing of up to 3.31% in power output compared to other methods.
  arXiv  Detail & Related papers  (2023-09-19T13:30:17Z)
• GP CC-OPF: Gaussian Process based optimization tool for Chance-Constrained Optimal Power Flow [54.94701604030199]
  The Gaussian Process (GP) based Chance-Constrained Optimal Flow (CC-OPF) is an open-source Python code for economic dispatch (ED) problem in power grids. The developed tool presents a novel data-driven approach based on the CC-OP model for solving the large regression problem with a trade-off between complexity and accuracy.
  arXiv  Detail & Related papers  (2023-02-16T17:59:06Z)
• Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach [3.900623554490941]
  Multi-uncertainties from power sources and loads have brought challenges to the stable demand supply of various resources at islands. To address these challenges, a comprehensive scheduling framework is proposed based on modeling an island integrated energy system (IES) In response to the shortage of freshwater on islands, in addition to the introduction of seawater desalination systems, a transmission structure of "hydrothermal simultaneous transmission" (HST) is proposed.
  arXiv  Detail & Related papers  (2022-12-27T12:46:25Z)
• AquaFeL-PSO: A Monitoring System for Water Resources using Autonomous Surface Vehicles based on Multimodal PSO and Federated Learning [0.0]
  The preservation, monitoring, and control of water resources has been a major challenge in recent decades. This paper proposes a water monitoring system using autonomous surface vehicles, equipped with water quality sensors.
  arXiv  Detail & Related papers  (2022-11-28T10:56:12Z)
• Stabilizing Voltage in Power Distribution Networks via Multi-Agent Reinforcement Learning with Transformer [128.19212716007794]
  We propose a Transformer-based Multi-Agent Actor-Critic framework (T-MAAC) to stabilize voltage in power distribution networks. In addition, we adopt a novel auxiliary-task training process tailored to the voltage control task, which improves the sample efficiency.
  arXiv  Detail & Related papers  (2022-06-08T07:48:42Z)
• Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications [64.1076645382049]
  Combination of energy harvesting (EH), cognitive radio (CR), and non-orthogonal multiple access (NOMA) is a promising solution to improve energy efficiency. In this paper, we study the spectrum, energy, and time resource management for deterministic-CR-NOMA IoT systems.
  arXiv  Detail & Related papers  (2021-09-17T08:55:48Z)
• An Efficient Multi-objective Evolutionary Approach for Solving the Operation of Multi-Reservoir System Scheduling in Hydro-Power Plants [0.0]
  We propose a new mathematical modelling in which the goal is to maximize the total energy production of the hydro-power plant in a sub-daily operation. For solving the problem, we discuss the Multi-objective Evolutionary Swarm Hybridization (MESH) algorithm. MESH showed a superior performance than alternative multi-objective approaches in terms of efficiency and accuracy.
  arXiv  Detail & Related papers  (2021-07-20T18:39:09Z)
• Deep Reinforcement Learning for Long Term Hydropower Production Scheduling [0.0]
  We explore the use of deep reinforcement learning to provide strategies for long term scheduling of hydropower production. We consider a use-case where the aim is to optimise the yearly revenue given week-by-week inflows to the reservoir and electricity prices. The presented model is not ready to substitute traditional optimisation tools but demonstrates the complementary potential of reinforcement learning in the data-rich field of hydropower scheduling.
  arXiv  Detail & Related papers  (2020-12-09T13:39:09Z)
• High-Fidelity Machine Learning Approximations of Large-Scale Optimal Power Flow [49.2540510330407]
  AC-OPF is a key building block in many power system applications. Motivated by increased penetration of renewable sources, this paper explores deep learning to deliver efficient approximations to the AC-OPF.
  arXiv  Detail & Related papers  (2020-06-29T20:22:16Z)
• The multi-objective optimisation of breakwaters using evolutionary approach [62.997667081978825]
  In engineering practice, it is often necessary to increase the effectiveness of existing protective constructions for ports and coasts. In the paper, the multi-objective evolutionary approach for the breakwaters optimisation is proposed.
  arXiv  Detail & Related papers  (2020-04-06T21:48:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.