Transferable Energy Storage Bidder

• URL: http://arxiv.org/abs/2301.01233v2
• Date: Thu, 1 Jun 2023 15:49:24 GMT
• Title: Transferable Energy Storage Bidder
• Authors: Yousuf Baker, Ningkun Zheng, Bolun Xu
• Abstract summary: This paper presents a novel, versatile, and transferable approach combining model-based optimization with a convolutional long short-term memory network for energy storage. We test our proposed approach using historical prices from New York State, showing it achieves state-of-the-art results. We also test a transfer learning approach by pre-training the bidding model using New York data and applying it to arbitrage in Queensland, Australia.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Energy storage resources must consider both price uncertainties and their physical operating characteristics when participating in wholesale electricity markets. This is a challenging problem as electricity prices are highly volatile, and energy storage has efficiency losses, power, and energy constraints. This paper presents a novel, versatile, and transferable approach combining model-based optimization with a convolutional long short-term memory network for energy storage to respond to or bid into wholesale electricity markets. We test our proposed approach using historical prices from New York State, showing it achieves state-of-the-art results, achieving between 70% to near 90% profit ratio compared to perfect foresight cases, in both price response and wholesale market bidding setting with various energy storage durations. We also test a transfer learning approach by pre-training the bidding model using New York data and applying it to arbitrage in Queensland, Australia. The result shows transfer learning achieves exceptional arbitrage profitability with as little as three days of local training data, demonstrating its significant advantage over training from scratch in scenarios with very limited data availability.

Related papers

• Optimizing Quantile-based Trading Strategies in Electricity Arbitrage [0.0]
  This study delves into the optimization of day-ahead and balancing market trading, leveraging quantile-based forecasts. Our findings underscore the profit potential of simultaneous participation in both day-ahead and balancing markets. Despite increased costs and narrower profit margins associated with higher-volume trading, the implementation of high-frequency strategies plays a significant role in maximizing profits.
  arXiv  Detail & Related papers  (2024-06-19T21:27:12Z)
• Temporal-Aware Deep Reinforcement Learning for Energy Storage Bidding in Energy and Contingency Reserve Markets [13.03742132147551]
  We develop a novel BESS joint bidding strategy that utilizes deep reinforcement learning (DRL) to bid in the spot and contingency frequency control ancillary services markets. Unlike conventional "black-box" DRL model, our approach is more interpretable and provides valuable insights into the temporal bidding behavior of BESS.
  arXiv  Detail & Related papers  (2024-02-29T12:41:54Z)
• A Bargaining-based Approach for Feature Trading in Vertical Federated Learning [54.51890573369637]
  We propose a bargaining-based feature trading approach in Vertical Federated Learning (VFL) to encourage economically efficient transactions. Our model incorporates performance gain-based pricing, taking into account the revenue-based optimization objectives of both parties.
  arXiv  Detail & Related papers  (2024-02-23T10:21:07Z)
• High-dimensional Bid Learning for Energy Storage Bidding in Energy Markets [2.1053035142861423]
  We propose a new bid representation method called Neural Network Embedded Bids (NNEBs) Our studies show that the proposed method achieves 18% higher profit than the baseline and up to 78% profit of the optimal market bidder.
  arXiv  Detail & Related papers  (2023-11-05T02:59:53Z)
• Energy Storage Price Arbitrage via Opportunity Value Function Prediction [1.8638865257327275]
  This paper proposes a novel energy storage price arbitrage algorithm combining supervised learning with dynamic programming. We generate the historical optimal opportunity value function using price data and a dynamic programming algorithm. Our method achieves 65% to 90% profit compared to perfect foresight in case studies using different energy storage models and price data from New York State.
  arXiv  Detail & Related papers  (2022-11-14T23:31:11Z)
• The impact of online machine-learning methods on long-term investment decisions and generator utilization in electricity markets [69.68068088508505]
  We investigate the impact of eleven offline and five online learning algorithms to predict the electricity demand profile over the next 24h. We show we can reduce the mean absolute error by 30% using an online algorithm when compared to the best offline algorithm. We also show that large errors in prediction accuracy have a disproportionate error on investments made over a 17-year time frame.
  arXiv  Detail & Related papers  (2021-03-07T11:28:54Z)
• Neural Fitted Q Iteration based Optimal Bidding Strategy in Real Time Reactive Power Market_1 [16.323822608442836]
  In real time electricity markets, the objective of generation companies while bidding is to maximize their profit. Similar studies in reactive power markets have not been reported so far because the network voltage operating conditions have an increased impact on reactive power markets. The assumption of a suitable probability distribution function is unrealistic, making the strategies adopted in active power markets unsuitable for learning optimal bids in reactive power market mechanisms.
  arXiv  Detail & Related papers  (2021-01-07T09:44:00Z)
• Exploring market power using deep reinforcement learning for intelligent bidding strategies [69.3939291118954]
  We find that capacity has an impact on the average electricity price in a single year. The value of $sim$25% and $sim$11% may vary between market structures and countries. We observe that the use of a market cap of approximately double the average market price has the effect of significantly decreasing this effect and maintaining a competitive market.
  arXiv  Detail & Related papers  (2020-11-08T21:07:42Z)
• Hybrid Modelling Approaches for Forecasting Energy Spot Prices in EPEC market [62.997667081978825]
  We consider several hybrid modelling approaches for forecasting energy spot prices in EPEC market. Data was given in terms of electricity prices for 2013-2014 years, and test data as a year of 2015.
  arXiv  Detail & Related papers  (2020-10-14T12:45:53Z)
• A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids [58.666456917115056]
  This paper presents a Reinforcement Learning based energy market for a prosumer dominated microgrid. The proposed market model facilitates a real-time and demanddependent dynamic pricing environment, which reduces grid costs and improves the economic benefits for prosumers.
  arXiv  Detail & Related papers  (2020-09-23T02:17:51Z)
• A Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding [69.37299910149981]
  A key component for the successful renewable energy sources integration is the usage of energy storage. We propose a novel modelling framework for the strategic participation of energy storage in the European continuous intraday market. An distributed version of the fitted Q algorithm is chosen for solving this problem due to its sample efficiency. Results indicate that the agent converges to a policy that achieves in average higher total revenues than the benchmark strategy.
  arXiv  Detail & Related papers  (2020-04-13T13:50:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.