Load constrained wind farm flow control through multi-objective multi-agent reinforcement learning

• URL: http://arxiv.org/abs/2604.22795v1
• Date: Mon, 13 Apr 2026 12:39:26 GMT
• Title: Load constrained wind farm flow control through multi-objective multi-agent reinforcement learning
• Abstract summary: This study presents a multi-agent reinforcement learning (MARL) framework for load-constrained wind farm flow control (WFFC)<n>The framework is implemented within the WindGym environment using the DYNAMIKS flow solver with Dynamic Wake Meandering (DWM) model to capture non-stationary wake physics.<n>Results indicate that the MARL agents successfully learn collaborative policies that prioritise power gain while actively retreating from high-DEL control strategies.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This study presents a multi-agent reinforcement learning (MARL) framework for load-constrained wind farm flow control (WFFC). While wake steering can enhance total wind farm power, it often introduces increased structural loads on downstream turbines. To address this, we integrate an Independent Soft Actor-Critic (I-SAC) architecture with a data-driven, local inflow sector-averaged surrogate model to provide real-time estimates of Damage Equivalent Loads (DELs). By incorporating these estimates into a shaped reward function, turbine-specific agents are trained to maximize power production while adhering to specific load-increase thresholds ($Δ_{max}$) of 10%, 20%, and 30% relative to a baseline controller. The framework is implemented within the WindGym environment using the DYNAMIKS flow solver with Dynamic Wake Meandering (DWM) model to capture non-stationary wake physics. Results indicate that the MARL agents successfully learn collaborative policies that prioritise power gain while actively retreating from high-DEL control strategies.

Related papers

• PhaseLoRA: Control-Regime-Conditioned Low-Rank Adaptation for Continuous-Action Vision-Language-Action Policies [74.07190331264488]
  We propose a lightweight LoRA parameterization that conditions adaptation at each action-chunk prediction step.<n>PhaseLoRA modulates the LoRA left factor in the action expert, allowing the effective low-rank update direction to vary over time.<n>Results establish within-trajectory conditioning as an effective lightweight PEFT axis for continuous-action VLA policies.
  arXiv  Detail & Related papers  (2026-08-15T15:32:08Z)
• Joint Air Traffic Flow and Capacity Management via Answer Set Programming [64.47906587579985]
  We introduce a joint ATFCM model with an encoding in Answer Set Programming (ASP)<n>Our results indicate that the ASP model outperforms the MIP model.<n>While DAC has the largest improvement on solving performance compared to rerouting, unrestricted variants of DAC or rerouting lead to search space thrashing.
  arXiv  Detail & Related papers  (2026-06-22T07:58:54Z)
• Hierarchical RL-MPC Control for Dynamic Wake Steering in Wind Farms [0.0]
  This paper presents a hierarchical framework that combines reinforcement learning with model predictive control, where an RL agent learns compensatory state estimates for an MPC controller, rather than directly controlling turbines.<n>Compared to direct RL control, the hybrid architecture maintains superior safety characteristics during training while achieving comparable performance with more stable control actions.
  arXiv  Detail & Related papers  (2026-04-13T12:57:38Z)
• Physics-infused Learning for Aerial Manipulator in Winds and Near-Wall Environments [3.895172208362693]
  Aerial manipulation (AM) expands UAV capabilities beyond passive observation to contact-based operations at high altitudes and in otherwise inaccessible environments.<n>This paper integrates a physics-based blade-element model with a learning-based residual force estimator, along with a rotor-speed allocation strategy for disturbance compensation, resulting in a unified control framework.<n>Results demonstrate improved disturbance estimation and trajectory-tracking accuracy over conventional approaches, enabling robust wall-contact execution under challenging aerodynamic conditions.
  arXiv  Detail & Related papers  (2026-03-08T22:08:15Z)
• DFPO: Scaling Value Modeling via Distributional Flow towards Robust and Generalizable LLM Post-Training [94.568675548967]
  Training reinforcement learning (RL) systems in real-world environments remains challenging due to noisy supervision and poor out-of-domain generalization.<n>Recent distributional RL methods improve robustness by modeling values with multiple quantile points, but they still learn each quantile independently as a scalar.<n>We propose DFPO, a robust distributional RL framework that models values as continuous flows across time steps.
  arXiv  Detail & Related papers  (2026-02-05T17:07:42Z)
• RISER: Orchestrating Latent Reasoning Skills for Adaptive Activation Steering [62.63376387138257]
  We propose a plug-and-play intervention framework that adaptively steers large language models (LLMs) reasoning in activation space.<n>RISER constructs a library of reusable reasoning vectors and employs a lightweight Router to dynamically compose them for each input.<n>The Router is optimized via reinforcement learning under task-level rewards, activating latent cognitive primitives in an emergent and compositional manner.
  arXiv  Detail & Related papers  (2026-01-14T08:04:33Z)
• Physics-informed Neural-operator Predictive Control for Drag Reduction in Turbulent Flows [109.99020160824553]
  We propose an efficient deep reinforcement learning framework for modeling and control of turbulent flows.<n>It is model-based RL for predictive control (PC), where both the policy and the observer models for turbulence control are learned jointly.<n>We find that PINO-PC achieves a drag reduction of 39.0% under a bulk-velocity Reynolds number of 15,000, outperforming previous fluid control methods by more than 32%.
  arXiv  Detail & Related papers  (2025-10-03T00:18:26Z)
• Reinforcement Learning Increases Wind Farm Power Production by Enabling Closed-Loop Collaborative Control [0.0]
  Traditional wind farm control operates each turbine independently to maximize individual power output.<n> coordinated wake steering across the entire farm can substantially increase the combined wind farm energy production.<n>First reinforcement learning controller integrated directly with high-fidelity large-eddy simulation.<n>Results establish dynamic flow-responsive control as a transformative approach to wind farm optimization.
  arXiv  Detail & Related papers  (2025-06-25T15:53:12Z)
• How to craft a deep reinforcement learning policy for wind farm flow control [3.9614347845645383]
  Wake effects between turbines can significantly reduce overall energy production in wind farms.<n>Existing machine learning approaches are limited to quasi-static wind conditions or small wind farms.<n>This work presents a new deep reinforcement learning methodology to develop a wake steering policy.
  arXiv  Detail & Related papers  (2025-06-06T16:07:05Z)
• Function Approximation for Reinforcement Learning Controller for Energy from Spread Waves [69.9104427437916]
  Multi-generator Wave Energy Converters (WEC) must handle multiple simultaneous waves coming from different directions called spread waves. These complex devices need controllers with multiple objectives of energy capture efficiency, reduction of structural stress to limit maintenance, and proactive protection against high waves. In this paper, we explore different function approximations for the policy and critic networks in modeling the sequential nature of the system dynamics.
  arXiv  Detail & Related papers  (2024-04-17T02:04:10Z)
• Modeling Wind Turbine Performance and Wake Interactions with Machine Learning [0.0]
  Different machine learning (ML) models are trained on SCADA and meteorological data collected at an onshore wind farm. ML methods for data quality control and pre-processing are applied to the data set under investigation. A hybrid model is found to achieve high accuracy for modeling wind turbine power capture.
  arXiv  Detail & Related papers  (2022-12-02T23:07:05Z)
• Skip Training for Multi-Agent Reinforcement Learning Controller for Industrial Wave Energy Converters [94.84709449845352]
  Recent Wave Energy Converters (WEC) are equipped with multiple legs and generators to maximize energy generation. Traditional controllers have shown limitations to capture complex wave patterns and the controllers must efficiently maximize the energy capture. This paper introduces a Multi-Agent Reinforcement Learning controller (MARL), which outperforms the traditionally used spring damper controller.
  arXiv  Detail & Related papers  (2022-09-13T00:20:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.