Prediction-Free, Real-Time Flexible Control of Tidal Lagoons through Proximal Policy Optimisation: A Case Study for the Swansea Lagoon

• URL: http://arxiv.org/abs/2106.10360v1
• Date: Fri, 18 Jun 2021 21:34:12 GMT
• Title: Prediction-Free, Real-Time Flexible Control of Tidal Lagoons through Proximal Policy Optimisation: A Case Study for the Swansea Lagoon
• Authors: T\'ulio Marcondes Moreira (1), Jackson Geraldo de Faria Jr (1), Pedro O.S. Vaz de Melo (1), Luiz Chaimowicz (1) and Gilberto Medeiros-Ribeiro (1) ((1) Universidade Federal de Minas Gerais, Belo Horizonte, Brazil)
• Abstract summary: We propose a novel optimised operation of tidal lagoons with proximal policy optimisation through Unity ML-Agents. We show that our approach is successful in maximising energy generation through an optimised operational policy of turbines and sluices.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Tidal range structures have been considered for large scale electricity generation for their potential ability to produce reasonable predictable energy without the emission of greenhouse gases. Once the main forcing components for driving the tides have deterministic dynamics, the available energy in a given tidal power plant has been estimated, through analytical and numerical optimisation routines, as a mostly predictable event. This constraint imposes state-of-art flexible operation methods to rely on tidal predictions (concurrent with measured data and up to a multiple of half-tidal cycles into the future) to infer best operational strategies for tidal lagoons, with the additional cost of requiring to run optimisation routines for every new tide. In this paper, we propose a novel optimised operation of tidal lagoons with proximal policy optimisation through Unity ML-Agents. We compare this technique with 6 different operation optimisation approaches (baselines) devised from the literature, utilising the Swansea Bay Tidal Lagoon as a case study. We show that our approach is successful in maximising energy generation through an optimised operational policy of turbines and sluices, yielding competitive results with state-of-the-art methods of optimisation, regardless of test data used, requiring training once and performing real-time flexible control with measured ocean data only.

Related papers

• Leveraging free energy in pretraining model selection for improved fine-tuning [4.005483185111992]
  We introduce a free energy criterion that quantifies a checkpoint's adaptability by measuring the concentration of nearby favorable parameters for the downstream task. We provide empirical evidence that the free energy criterion reliably correlates with improved fine-tuning performance.
  arXiv  Detail & Related papers  (2024-10-08T01:50:21Z)
• Forecast-PEFT: Parameter-Efficient Fine-Tuning for Pre-trained Motion Forecasting Models [68.23649978697027]
  Forecast-PEFT is a fine-tuning strategy that freezes the majority of the model's parameters, focusing adjustments on newly introduced prompts and adapters. Our experiments show that Forecast-PEFT outperforms traditional full fine-tuning methods in motion prediction tasks. Forecast-FT further improves prediction performance, evidencing up to a 9.6% enhancement over conventional baseline methods.
  arXiv  Detail & Related papers  (2024-07-28T19:18:59Z)
• Hybrid Reinforcement Learning for Optimizing Pump Sustainability in Real-World Water Distribution Networks [55.591662978280894]
  This article addresses the pump-scheduling optimization problem to enhance real-time control of real-world water distribution networks (WDNs) Our primary objectives are to adhere to physical operational constraints while reducing energy consumption and operational costs. Traditional optimization techniques, such as evolution-based and genetic algorithms, often fall short due to their lack of convergence guarantees.
  arXiv  Detail & Related papers  (2023-10-13T21:26:16Z)
• A Novel Hybrid Algorithm for Optimized Solutions in Ocean Renewable Energy Industry: Enhancing Power Take-Off Parameters and Site Selection Procedure of Wave Energy Converters [0.0]
  Ocean renewable energy, particularly wave energy, has emerged as a pivotal component for diversifying the global energy portfolio. This study delves into the optimization of power take-off (PTO) parameters and the site selection process for an offshore oscillating surge wave energy converter (OSWEC) By employing the HC-EGWO method, we achieved an upswing of up to 3.31% in power output compared to other methods.
  arXiv  Detail & Related papers  (2023-09-19T13:30:17Z)
• Model-based Causal Bayesian Optimization [74.78486244786083]
  We introduce the first algorithm for Causal Bayesian Optimization with Multiplicative Weights (CBO-MW) We derive regret bounds for CBO-MW that naturally depend on graph-related quantities. Our experiments include a realistic demonstration of how CBO-MW can be used to learn users' demand patterns in a shared mobility system.
  arXiv  Detail & Related papers  (2023-07-31T13:02:36Z)
• Theoretically Guaranteed Policy Improvement Distilled from Model-Based Planning [64.10794426777493]
  Model-based reinforcement learning (RL) has demonstrated remarkable successes on a range of continuous control tasks. Recent practices tend to distill optimized action sequences into an RL policy during the training phase. We develop an approach to distill from model-based planning to the policy.
  arXiv  Detail & Related papers  (2023-07-24T16:52:31Z)
• Reparameterized Policy Learning for Multimodal Trajectory Optimization [61.13228961771765]
  We investigate the challenge of parametrizing policies for reinforcement learning in high-dimensional continuous action spaces. We propose a principled framework that models the continuous RL policy as a generative model of optimal trajectories. We present a practical model-based RL method, which leverages the multimodal policy parameterization and learned world model.
  arXiv  Detail & Related papers  (2023-07-20T09:05:46Z)
• Comparison and Evaluation of Methods for a Predict+Optimize Problem in Renewable Energy [42.00952788334554]
  This paper presents the findings of the IEEE-CIS Technical Challenge on Predict+ for Renewable Energy Scheduling," held in 2021. We present a comparison and evaluation of the seven highest-ranked solutions in the competition. The winning method predicted different scenarios and optimized over all scenarios using a sample average approximation method.
  arXiv  Detail & Related papers  (2022-12-21T02:34:12Z)
• Deep learning based closed-loop optimization of geothermal reservoir production [0.0]
  We propose a closed-loop optimization framework, based on deep learning surrogates, for the well control optimization of geothermal reservoirs. We construct a hybrid convolution-recurrent neural network surrogate, which combines the convolution neural network (CNN) and long short-term memory (LSTM) recurrent network. We show that the proposed framework can achieve efficient and effective real-time optimization and data assimilation in the geothermal reservoir production process.
  arXiv  Detail & Related papers  (2022-04-15T14:37:28Z)
• Optimal Reservoir Operations using Long Short-Term Memory Network [3.680403821470857]
  Real-time inflow forecast helps in efficient operation of water resources. This work proposes a naive anomaly detection algorithm baseline based on LSTM. Experiments are run on data from Bhakra Dam Reservoir in India.
  arXiv  Detail & Related papers  (2021-09-07T18:16:22Z)
• Where is the Grass Greener? Revisiting Generalized Policy Iteration for Offline Reinforcement Learning [81.15016852963676]
  We re-implement state-of-the-art baselines in the offline RL regime under a fair, unified, and highly factorized framework. We show that when a given baseline outperforms its competing counterparts on one end of the spectrum, it never does on the other end.
  arXiv  Detail & Related papers  (2021-07-03T11:00:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.