Exploring market power using deep reinforcement learning for intelligent bidding strategies

• URL: http://arxiv.org/abs/2011.04079v1
• Date: Sun, 8 Nov 2020 21:07:42 GMT
• Title: Exploring market power using deep reinforcement learning for intelligent bidding strategies
• Authors: Alexander J. M. Kell, Matthew Forshaw, A. Stephen McGough
• Abstract summary: We find that capacity has an impact on the average electricity price in a single year. The value of $sim$25% and $sim$11% may vary between market structures and countries. We observe that the use of a market cap of approximately double the average market price has the effect of significantly decreasing this effect and maintaining a competitive market.
• Score: 69.3939291118954
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Decentralized electricity markets are often dominated by a small set of generator companies who control the majority of the capacity. In this paper, we explore the effect of the total controlled electricity capacity by a single, or group, of generator companies can have on the average electricity price. We demonstrate this through the use of ElecSim, a simulation of a country-wide energy market. We develop a strategic agent, representing a generation company, which uses a deep deterministic policy gradient reinforcement learning algorithm to bid in a uniform pricing electricity market. A uniform pricing market is one where all players are paid the highest accepted price. ElecSim is parameterized to the United Kingdom for the year 2018. This work can help inform policy on how to best regulate a market to ensure that the price of electricity remains competitive. We find that capacity has an impact on the average electricity price in a single year. If any single generator company, or a collaborating group of generator companies, control more than ${\sim}$11$\%$ of generation capacity and bid strategically, prices begin to increase by ${\sim}$25$\%$. The value of ${\sim}$25\% and ${\sim}$11\% may vary between market structures and countries. For instance, different load profiles may favour a particular type of generator or a different distribution of generation capacity. Once the capacity controlled by a generator company, which bids strategically, is higher than ${\sim}$35\%, prices increase exponentially. We observe that the use of a market cap of approximately double the average market price has the effect of significantly decreasing this effect and maintaining a competitive market. A fair and competitive electricity market provides value to consumers and enables a more competitive economy through the utilisation of electricity by both industry and consumers.

Related papers

• Evaluating the Impact of Multiple DER Aggregators on Wholesale Energy Markets: A Hybrid Mean Field Approach [2.0535683313855055]
  The integration of distributed energy resources into wholesale energy markets can greatly enhance grid flexibility, improve market efficiency, and contribute to a more sustainable energy future. We study a wholesale market model featuring multiple DER aggregators, each controlling a portfolio of DER resources and bidding into the market on behalf of the DER asset owners. We propose a reinforcement learning (RL)-based method to help each agent learn optimal strategies within the MFG framework, enhancing their ability to adapt to market conditions and uncertainties.
  arXiv  Detail & Related papers  (2024-08-27T14:56:28Z)
• A Machine Learning Framework to Deconstruct the Primary Drivers for Electricity Market Price Events [0.8192907805418581]
  Power grids are moving towards 100% renewable energy source bulk power grids. Traditional root cause analysis and statistical approaches are rendered inapplicable to analyze and infer the main drivers behind price formation. We propose a machine learning-based analysis framework to deconstruct the primary drivers for price spike events in modern electricity markets with high renewable energy.
  arXiv  Detail & Related papers  (2023-09-12T09:24:21Z)
• Understanding electricity prices beyond the merit order principle using explainable AI [0.0]
  In perfect competition, the merit order principle describes that dispatchable power plants enter the market in the order of their marginal costs. Many market models implement this principle to predict electricity prices but typically require certain assumptions and simplifications. We present an explainable machine learning model for the prices on the German day-ahead market, which substantially outperforms a benchmark model.
  arXiv  Detail & Related papers  (2022-12-09T12:18:17Z)
• Electricity Price Forecasting Model based on Gated Recurrent Units [0.0]
  This paper presents a model for electricity price forecasting based on Gated Recurrent Units. Noise in electricity price seriously reduces the efficiency and effectiveness of analysis. The proposed methodology can perform effectively in prediction of electricity price.
  arXiv  Detail & Related papers  (2022-07-28T16:49:03Z)
• Machine learning applications for electricity market agent-based models: A systematic literature review [68.8204255655161]
  Agent-based simulations are used to better understand the dynamics of the electricity market. Agent-based models provide the opportunity to integrate machine learning and artificial intelligence. We review 55 papers published between 2016 and 2021 which focus on machine learning applied to agent-based electricity market models.
  arXiv  Detail & Related papers  (2022-06-05T14:52:26Z)
• The impact of online machine-learning methods on long-term investment decisions and generator utilization in electricity markets [69.68068088508505]
  We investigate the impact of eleven offline and five online learning algorithms to predict the electricity demand profile over the next 24h. We show we can reduce the mean absolute error by 30% using an online algorithm when compared to the best offline algorithm. We also show that large errors in prediction accuracy have a disproportionate error on investments made over a 17-year time frame.
  arXiv  Detail & Related papers  (2021-03-07T11:28:54Z)
• A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids [58.666456917115056]
  This paper presents a Reinforcement Learning based energy market for a prosumer dominated microgrid. The proposed market model facilitates a real-time and demanddependent dynamic pricing environment, which reduces grid costs and improves the economic benefits for prosumers.
  arXiv  Detail & Related papers  (2020-09-23T02:17:51Z)
• An Artificial Intelligence Solution for Electricity Procurement in Forward Markets [3.828689444527739]
  This article focuses on a yearly base load product from the Belgian forward market, named calendar (CAL) It introduces a novel algorithm providing recommendations to either buy electricity now or wait for a future opportunity. On average, the proposed approach surpasses the benchmark procurement policies considered and achieves a reduction in costs of 1.65%.
  arXiv  Detail & Related papers  (2020-06-10T11:50:59Z)
• Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids [56.35173057183362]
  We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. We propose the formulation of a smart grid environment as a Markov game.
  arXiv  Detail & Related papers  (2020-05-05T07:32:40Z)
• Towards a Peer-to-Peer Energy Market: an Overview [68.8204255655161]
  This work focuses on the electric power market, comparing the status quo with the recent trend towards the increase in distributed self-generation capabilities by prosumers. We introduce a potential multi-layered architecture for a Peer-to-Peer (P2P) energy market, discussing the fundamental aspects of local production and local consumption as part of a microgrid. To give a full picture to the reader, we also scrutinise relevant elements of energy trading, such as Smart Contract and grid stability.
  arXiv  Detail & Related papers  (2020-03-02T20:32:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.