Collective Large-scale Wind Farm Multivariate Power Output Control Based on Hierarchical Communication Multi-Agent Proximal Policy Optimization

• URL: http://arxiv.org/abs/2305.10161v1
• Date: Wed, 17 May 2023 12:26:08 GMT
• Title: Collective Large-scale Wind Farm Multivariate Power Output Control Based on Hierarchical Communication Multi-Agent Proximal Policy Optimization
• Authors: Yubao Zhang, Xin Chen, Sumei Gong, Haojie Chen
• Abstract summary: Wind power is becoming an increasingly important source of renewable energy worldwide. Wind farm power control faces significant challenges due to the high system complexity inherent in these farms. A novel communication-based multi-agent deep reinforcement learning large-scale wind farm multivariate control is proposed to handle this challenge.
• Score: 5.062455071500403
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Wind power is becoming an increasingly important source of renewable energy worldwide. However, wind farm power control faces significant challenges due to the high system complexity inherent in these farms. A novel communication-based multi-agent deep reinforcement learning large-scale wind farm multivariate control is proposed to handle this challenge and maximize power output. A wind farm multivariate power model is proposed to study the influence of wind turbines (WTs) wake on power. The multivariate model includes axial induction factor, yaw angle, and tilt angle controllable variables. The hierarchical communication multi-agent proximal policy optimization (HCMAPPO) algorithm is proposed to coordinate the multivariate large-scale wind farm continuous controls. The large-scale wind farm is divided into multiple wind turbine aggregators (WTAs), and neighboring WTAs can exchange information through hierarchical communication to maximize the wind farm power output. Simulation results demonstrate that the proposed multivariate HCMAPPO can significantly increase wind farm power output compared to the traditional PID control, coordinated model-based predictive control, and multi-agent deep deterministic policy gradient algorithm. Particularly, the HCMAPPO algorithm can be trained with the environment based on the thirteen-turbine wind farm and effectively applied to larger wind farms. At the same time, there is no significant increase in the fatigue damage of the wind turbine blade from the wake control as the wind farm scale increases. The multivariate HCMAPPO control can realize the collective large-scale wind farm maximum power output.

Related papers

• Deep Reinforcement Learning for Multi-Objective Optimization: Enhancing Wind Turbine Energy Generation while Mitigating Noise Emissions [0.4218593777811082]
  We develop a torque-pitch control framework using deep reinforcement learning for wind turbines. We employ a double deep Q-learning, coupled to a blade element momentum solver, to enable precise control over wind turbine parameters.
  arXiv  Detail & Related papers  (2024-07-18T09:21:51Z)
• Function Approximation for Reinforcement Learning Controller for Energy from Spread Waves [69.9104427437916]
  Multi-generator Wave Energy Converters (WEC) must handle multiple simultaneous waves coming from different directions called spread waves. These complex devices need controllers with multiple objectives of energy capture efficiency, reduction of structural stress to limit maintenance, and proactive protection against high waves. In this paper, we explore different function approximations for the policy and critic networks in modeling the sequential nature of the system dynamics.
  arXiv  Detail & Related papers  (2024-04-17T02:04:10Z)
• Multi-Agent Reinforcement Learning for Power Grid Topology Optimization [45.74830585715129]
  This paper presents a hierarchical multi-agent reinforcement learning (MARL) framework tailored for expansive action spaces. Experimental results indicate the MARL framework's competitive performance with single-agent RL methods. We also compare different RL algorithms for lower-level agents alongside different policies for higher-order agents.
  arXiv  Detail & Related papers  (2023-10-04T06:37:43Z)
• Long-term Wind Power Forecasting with Hierarchical Spatial-Temporal Transformer [112.12271800369741]
  Wind power is attracting increasing attention around the world due to its renewable, pollution-free, and other advantages. Accurate wind power forecasting (WPF) can effectively reduce power fluctuations in power system operations. Existing methods are mainly designed for short-term predictions and lack effective spatial-temporal feature augmentation.
  arXiv  Detail & Related papers  (2023-05-30T04:03:15Z)
• Skip Training for Multi-Agent Reinforcement Learning Controller for Industrial Wave Energy Converters [94.84709449845352]
  Recent Wave Energy Converters (WEC) are equipped with multiple legs and generators to maximize energy generation. Traditional controllers have shown limitations to capture complex wave patterns and the controllers must efficiently maximize the energy capture. This paper introduces a Multi-Agent Reinforcement Learning controller (MARL), which outperforms the traditionally used spring damper controller.
  arXiv  Detail & Related papers  (2022-09-13T00:20:31Z)
• Integrating wind variability to modelling wind-ramp events using a non-binary ramp function and deep learning models [0.0]
  We discuss limitations of current predictive practices and explore the use of Machine Learning methods to enhance wind ramp event classification and prediction. We additionally outline a design for a novel approach to wind ramp prediction, in which high-resolution wind fields are incorporated to the modelling of wind power.
  arXiv  Detail & Related papers  (2022-08-31T10:40:35Z)
• Stabilizing Voltage in Power Distribution Networks via Multi-Agent Reinforcement Learning with Transformer [128.19212716007794]
  We propose a Transformer-based Multi-Agent Actor-Critic framework (T-MAAC) to stabilize voltage in power distribution networks. In addition, we adopt a novel auxiliary-task training process tailored to the voltage control task, which improves the sample efficiency.
  arXiv  Detail & Related papers  (2022-06-08T07:48:42Z)
• Measuring Wind Turbine Health Using Drifting Concepts [55.87342698167776]
  We propose two new approaches for the analysis of wind turbine health. The first method aims at evaluating the decrease or increase in relatively high and low power production. The second method evaluates the overall drift of the extracted concepts.
  arXiv  Detail & Related papers  (2021-12-09T14:04:55Z)
• Scalable Optimization for Wind Farm Control using Coordination Graphs [5.56699571220921]
  A wind farm controller is required to match the farm's power production with a power demand imposed by the grid operator. This is a non-trivial optimization problem, as complex dependencies exist between the wind turbines. We propose a new learning method for wind farm control that leverages the sparse wind farm structure to factorize the optimization problem.
  arXiv  Detail & Related papers  (2021-01-19T20:12:30Z)
• Generation expansion planning in the presence of wind power plants using a genetic algorithm model [0.0]
  The purpose of generation expansion planning (GEP) is to enhance construction planning and reduce the costs of installing different types of power plants. This paper proposes a method based on Genetic Algorithm (GA) for GEP in the presence of wind power plants.
  arXiv  Detail & Related papers  (2020-07-07T07:20:15Z)
• Hybrid Neuro-Evolutionary Method for Predicting Wind Turbine Power Output [6.411829871947649]
  We use historical data in the supervisory control and data acquisition (SCADA) systems as input to estimate the power output from an onshore wind farm in Sweden. With the prior knowledge that the underlying wind patterns are highly non-linear and diverse, we combine a self-adaptive differential evolution (SaDE) algorithm. We show that our approach outperforms its counterparts.
  arXiv  Detail & Related papers  (2020-04-02T04:22:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.