Learning to run a Power Network Challenge: a Retrospective Analysis

• URL: http://arxiv.org/abs/2103.03104v1
• Date: Tue, 2 Mar 2021 09:52:24 GMT
• Title: Learning to run a Power Network Challenge: a Retrospective Analysis
• Authors: Antoine Marot, Benjamin Donnot, Gabriel Dulac-Arnold, Adrian Kelly, A\"idan O'Sullivan, Jan Viebahn, Mariette Awad, Isabelle Guyon, Patrick Panciatici, Camilo Romero
• Abstract summary: We have designed a L2RPN challenge to encourage the development of reinforcement learning solutions to key problems in the next-generation power networks. The main contribution of this challenge is our proposed comprehensive Grid2Op framework, and associated benchmark. We present the benchmark suite and analyse the winning solutions of the challenge, observing one super-human performance demonstration by the best agent.
• Score: 6.442347402316506
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Power networks, responsible for transporting electricity across large geographical regions, are complex infrastructures on which modern life critically depend. Variations in demand and production profiles, with increasing renewable energy integration, as well as the high voltage network technology, constitute a real challenge for human operators when optimizing electricity transportation while avoiding blackouts. Motivated to investigate the potential of Artificial Intelligence methods in enabling adaptability in power network operation, we have designed a L2RPN challenge to encourage the development of reinforcement learning solutions to key problems present in the next-generation power networks. The NeurIPS 2020 competition was well received by the international community attracting over 300 participants worldwide. The main contribution of this challenge is our proposed comprehensive Grid2Op framework, and associated benchmark, which plays realistic sequential network operations scenarios. The framework is open-sourced and easily re-usable to define new environments with its companion GridAlive ecosystem. It relies on existing non-linear physical simulators and let us create a series of perturbations and challenges that are representative of two important problems: a) the uncertainty resulting from the increased use of unpredictable renewable energy sources, and b) the robustness required with contingent line disconnections. In this paper, we provide details about the competition highlights. We present the benchmark suite and analyse the winning solutions of the challenge, observing one super-human performance demonstration by the best agent. We propose our organizational insights for a successful competition and conclude on open research avenues. We expect our work will foster research to create more sustainable solutions for power network operations.

Related papers

• Optimal Power Grid Operations with Foundation Models [0.0]
  We propose the use of AI Foundation Models (FMs) and advances in Graph Neural Networks to efficiently exploit poorly available grid data for different downstream tasks. For capturing the grid's underlying physics, we believe that building a self-supervised model learning the power flow dynamics is a critical first step towards developing an FM for the power grid.
  arXiv  Detail & Related papers  (2024-09-03T09:06:13Z)
• SafePowerGraph: Safety-aware Evaluation of Graph Neural Networks for Transmission Power Grids [55.35059657148395]
  We present SafePowerGraph, the first simulator-agnostic, safety-oriented framework and benchmark for Graph Neural Networks (GNNs) in power systems (PS) operations. SafePowerGraph integrates multiple PF and OPF simulators and assesses GNN performance under diverse scenarios, including energy price variations and power line outages.
  arXiv  Detail & Related papers  (2024-07-17T09:01:38Z)
• Multi-Agent Reinforcement Learning for Energy Networks: Computational Challenges, Progress and Open Problems [14.10715615781625]
  Multi-agent reinforcement learning can support the decentralization and decarbonization of energy networks. This is achieved by specifying key computational challenges in managing energy networks, reviewing recent research progress on addressing them, and highlighting open challenges that may be addressed using MARL.
  arXiv  Detail & Related papers  (2024-04-24T01:35:27Z)
• Causal Reasoning: Charting a Revolutionary Course for Next-Generation AI-Native Wireless Networks [63.246437631458356]
  Next-generation wireless networks (e.g., 6G) will be artificial intelligence (AI)-native. This article introduces a novel framework for building AI-native wireless networks; grounded in the emerging field of causal reasoning. We highlight several wireless networking challenges that can be addressed by causal discovery and representation.
  arXiv  Detail & Related papers  (2023-09-23T00:05:39Z)
• Adaptive Resource Allocation for Virtualized Base Stations in O-RAN with Online Learning [60.17407932691429]
  Open Radio Access Network systems, with their base stations (vBSs), offer operators the benefits of increased flexibility, reduced costs, vendor diversity, and interoperability. We propose an online learning algorithm that balances the effective throughput and vBS energy consumption, even under unforeseeable and "challenging'' environments. We prove the proposed solutions achieve sub-linear regret, providing zero average optimality gap even in challenging environments.
  arXiv  Detail & Related papers  (2023-09-04T17:30:21Z)
• PowRL: A Reinforcement Learning Framework for Robust Management of Power Networks [2.9822184411723645]
  This paper presents a reinforcement learning framework, PowRL, to mitigate the effects of unexpected network events. PowRL is benchmarked on a variety of competition datasets hosted by the L2RPN (Learning to Run a Power Network)
  arXiv  Detail & Related papers  (2022-12-05T16:22:12Z)
• Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
  This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
  arXiv  Detail & Related papers  (2022-11-29T01:18:58Z)
• Evaluating Distribution System Reliability with Hyperstructures Graph Convolutional Nets [74.51865676466056]
  We show how graph convolutional networks and hyperstructures representation learning framework can be employed for accurate, reliable, and computationally efficient distribution grid planning. Our numerical experiments show that the proposed Hyper-GCNNs approach yields substantial gains in computational efficiency.
  arXiv  Detail & Related papers  (2022-11-14T01:29:09Z)
• Power Grid Congestion Management via Topology Optimization with AlphaZero [0.27998963147546135]
  We propose an AlphaZero-based grid topology optimization agent as a non-costly, carbon-free congestion management alternative. Our approach ranked 1st in the WCCI 2022 Learning to Run a Power Network (L2RPN) competition.
  arXiv  Detail & Related papers  (2022-11-10T14:39:28Z)
• Reinforcement learning for Energies of the future and carbon neutrality: a Challenge Design [0.0]
  This challenge belongs to a series started in 2019 under the name "Learning to run a power network" (L2RPN) We introduce new more realistic scenarios proposed by RTE to reach carbon neutrality by 2050. We provide a baseline using state-of-the-art reinforcement learning algorithm to stimulate the future participants.
  arXiv  Detail & Related papers  (2022-07-21T06:56:46Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.