End-to-End Reinforcement Learning of Curative Curtailment with Partial Measurement Availability
- URL: http://arxiv.org/abs/2405.03262v2
- Date: Mon, 10 Jun 2024 11:04:04 GMT
- Title: End-to-End Reinforcement Learning of Curative Curtailment with Partial Measurement Availability
- Authors: Hinrikus Wolf, Luis Böttcher, Sarra Bouchkati, Philipp Lutat, Jens Breitung, Bastian Jung, Tina Möllemann, Viktor Todosijević, Jan Schiefelbein-Lach, Oliver Pohl, Andreas Ulbig, Martin Grohe,
- Abstract summary: This paper presents a novel end-to-end approach to resolving congestion in distribution grids with deep reinforcement learning.
Our architecture learns to curtail power and set appropriate reactive power to determine a non-congested and, thus, feasible grid state.
Decisions can also be made on real grids that guarantee sufficient quality for congestion-free grid operation.
- Score: 2.633467695303875
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In the course of the energy transition, the expansion of generation and consumption will change, and many of these technologies, such as PV systems, electric cars and heat pumps, will influence the power flow, especially in the distribution grids. Scalable methods that can make decisions for each grid connection are needed to enable congestion-free grid operation in the distribution grids. This paper presents a novel end-to-end approach to resolving congestion in distribution grids with deep reinforcement learning. Our architecture learns to curtail power and set appropriate reactive power to determine a non-congested and, thus, feasible grid state. State-of-the-art methods such as the optimal power flow (OPF) demand high computational costs and detailed measurements of every bus in a grid. In contrast, the presented method enables decisions under sparse information with just some buses observable in the grid. Distribution grids are generally not yet fully digitized and observable, so this method can be used for decision-making on the majority of low-voltage grids. On a real low-voltage grid the approach resolves 100\% of violations in the voltage band and 98.8\% of asset overloads. The results show that decisions can also be made on real grids that guarantee sufficient quality for congestion-free grid operation.
Related papers
- A Perspective on Foundation Models for the Electric Power Grid [53.02072064670517]
Foundation models (FMs) currently dominate news headlines.
We argue that an FM learning from diverse grid data and topologies could unlock transformative capabilities.
We discuss a power grid FM concept, namely GridFM, based on graph neural networks and show how different downstream tasks benefit.
arXiv Detail & Related papers (2024-07-12T17:09:47Z) - Graph Reinforcement Learning in Power Grids: A Survey [1.3124421498970822]
Deep learning approaches to overcome the lack of flexibility of traditional methods in power grids use cases.
The application of GNNs is particularly promising due to their ability to learn from graph-structured data present in power grids.
This review analyses the ability of GRL to capture the inherent graph structure of power grids to improve representation learning and decision making in different power grid use cases.
arXiv Detail & Related papers (2024-07-05T14:07:15Z) - GP CC-OPF: Gaussian Process based optimization tool for
Chance-Constrained Optimal Power Flow [54.94701604030199]
The Gaussian Process (GP) based Chance-Constrained Optimal Flow (CC-OPF) is an open-source Python code for economic dispatch (ED) problem in power grids.
The developed tool presents a novel data-driven approach based on the CC-OP model for solving the large regression problem with a trade-off between complexity and accuracy.
arXiv Detail & Related papers (2023-02-16T17:59:06Z) - Distributed Energy Management and Demand Response in Smart Grids: A
Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems.
In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
arXiv Detail & Related papers (2022-11-29T01:18:58Z) - Deep Reinforcement Learning Microgrid Optimization Strategy Considering
Priority Flexible Demand Side [6.129841305145217]
A microgrid is mainly faced with the problems of small-scale volatility, uncertainty, intermittency and demand-side uncertainty of DERs.
The traditional microgrid has a single form and cannot meet the flexible energy dispatch between the complex demand side and the microgrid.
This paper considers the response priority of each unit component of TCLs and ESSs on the basis of the overall environment operation of the microgrid.
arXiv Detail & Related papers (2022-11-11T01:43:10Z) - Power Grid Congestion Management via Topology Optimization with
AlphaZero [0.27998963147546135]
We propose an AlphaZero-based grid topology optimization agent as a non-costly, carbon-free congestion management alternative.
Our approach ranked 1st in the WCCI 2022 Learning to Run a Power Network (L2RPN) competition.
arXiv Detail & Related papers (2022-11-10T14:39:28Z) - Unsupervised Optimal Power Flow Using Graph Neural Networks [172.33624307594158]
We use a graph neural network to learn a nonlinear parametrization between the power demanded and the corresponding allocation.
We show through simulations that the use of GNNs in this unsupervised learning context leads to solutions comparable to standard solvers.
arXiv Detail & Related papers (2022-10-17T17:30:09Z) - Data-Driven Stochastic AC-OPF using Gaussian Processes [54.94701604030199]
Integrating a significant amount of renewables into a power grid is probably the most a way to reduce carbon emissions from power grids slow down climate change.
This paper presents an alternative data-driven approach based on the AC power flow equations that can incorporate uncertainty inputs.
The GP approach learns a simple yet non-constrained data-driven approach to close this gap to the AC power flow equations.
arXiv Detail & Related papers (2022-07-21T23:02:35Z) - Knowledge- and Data-driven Services for Energy Systems using Graph
Neural Networks [0.9809636731336702]
We propose a data- and knowledge-driven probabilistic graphical model for energy systems based on the framework of graph neural networks (GNNs)
The model can explicitly factor in domain knowledge, in the form of grid topology or physics constraints, thus resulting in sparser architectures and much smaller parameters dimensionality.
Results obtained from a real-world smart-grid demonstration project show how the GNN was used to inform grid congestion predictions and market bidding services.
arXiv Detail & Related papers (2021-03-12T13:00:01Z) - A Non-Stationary Bandit-Learning Approach to Energy-Efficient
Femto-Caching with Rateless-Coded Transmission [98.47527781626161]
We study a resource allocation problem for joint caching and transmission in small cell networks.
We then formulate the problem as to select a file from the cache together with a transmission power level for every broadcast round.
In contrast to the state-of-the-art research, the proposed approach is especially suitable for networks with time-variant statistical properties.
arXiv Detail & Related papers (2020-04-13T09:07:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.