Fair Reinforcement Learning Algorithm for PV Active Control in LV Distribution Networks

• URL: http://arxiv.org/abs/2409.09074v1
• Date: Mon, 9 Sep 2024 10:51:08 GMT
• Title: Fair Reinforcement Learning Algorithm for PV Active Control in LV Distribution Networks
• Authors: Maurizio Vassallo, Amina Benzerga, Alireza Bahmanyar, Damien Ernst,
• Abstract summary: The adoption of distributed energy resources has presented new and complex challenges for power network control. With the significant energy production from PV panels, voltage issues in the network have become a problem. Reducing the active power output of PV panels can be perceived as unfair to some customers, discouraging future installations. A reinforcement learning technique is proposed to address voltage issues in a distribution network, while considering fairness in active power curtailment.
• Score: 1.75493501156941
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The increasing adoption of distributed energy resources, particularly photovoltaic (PV) panels, has presented new and complex challenges for power network control. With the significant energy production from PV panels, voltage issues in the network have become a problem. Currently, PV smart inverters (SIs) are used to mitigate the voltage problems by controlling their active power generation and reactive power injection or absorption. However, reducing the active power output of PV panels can be perceived as unfair to some customers, discouraging future installations. To solve this issue, in this paper, a reinforcement learning technique is proposed to address voltage issues in a distribution network, while considering fairness in active power curtailment among customers. The feasibility of the proposed approach is explored through experiments, demonstrating its ability to effectively control voltage in a fair and efficient manner.

Related papers

• Bayesian Reinforcement Learning for Automatic Voltage Control under Cyber-Induced Uncertainty [0.533024001730262]
  This work introduces a Bayesian Reinforcement Learning (BRL) approach for power system control problems. It focuses on sustained voltage control under uncertainty in a cyber-adversarial environment. BRL techniques assist in automatically finding a threshold for exploration and exploitation in various RL techniques.
  arXiv  Detail & Related papers  (2023-05-25T20:58:08Z)
• Model-Free Approach to Fair Solar PV Curtailment Using Reinforcement Learning [6.175137568373435]
  Currently, PV inverters prevent damage to electronics by curtailing energy production in response to overvoltage. This disproportionately affects households at the far end of the feeder, leading to an unfair allocation of the potential value of energy produced. This paper investigates reinforcement learning, which gradually optimize a fair PV curtailment strategy by interacting with the system.
  arXiv  Detail & Related papers  (2022-12-13T12:54:10Z)
• Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
  This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
  arXiv  Detail & Related papers  (2022-11-29T01:18:58Z)
• Stabilizing Voltage in Power Distribution Networks via Multi-Agent Reinforcement Learning with Transformer [128.19212716007794]
  We propose a Transformer-based Multi-Agent Actor-Critic framework (T-MAAC) to stabilize voltage in power distribution networks. In addition, we adopt a novel auxiliary-task training process tailored to the voltage control task, which improves the sample efficiency.
  arXiv  Detail & Related papers  (2022-06-08T07:48:42Z)
• Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networks [2.992389186393994]
  The emerging trend of decarbonisation is placing excessive stress on power distribution networks. Active voltage control is seen as a promising solution to relieve power congestion and improve voltage quality without extra hardware investment. This paper formulates the active voltage control problem in the framework of Dec-POMDP and establishes an open-source environment.
  arXiv  Detail & Related papers  (2021-10-27T09:31:22Z)
• Improving Robustness of Reinforcement Learning for Power System Control with Adversarial Training [71.7750435554693]
  We show that several state-of-the-art RL agents proposed for power system control are vulnerable to adversarial attacks. Specifically, we use an adversary Markov Decision Process to learn an attack policy, and demonstrate the potency of our attack. We propose to use adversarial training to increase the robustness of RL agent against attacks and avoid infeasible operational decisions.
  arXiv  Detail & Related papers  (2021-10-18T00:50:34Z)
• Enforcing Policy Feasibility Constraints through Differentiable Projection for Energy Optimization [57.88118988775461]
  We propose PROjected Feasibility (PROF) to enforce convex operational constraints within neural policies. We demonstrate PROF on two applications: energy-efficient building operation and inverter control.
  arXiv  Detail & Related papers  (2021-05-19T01:58:10Z)
• A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids [58.666456917115056]
  This paper presents a Reinforcement Learning based energy market for a prosumer dominated microgrid. The proposed market model facilitates a real-time and demanddependent dynamic pricing environment, which reduces grid costs and improves the economic benefits for prosumers.
  arXiv  Detail & Related papers  (2020-09-23T02:17:51Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.