Peer-to-Peer Energy Trading in Dairy Farms using Multi-Agent Reinforcement Learning

• URL: http://arxiv.org/abs/2511.23148v1
• Date: Fri, 28 Nov 2025 12:53:10 GMT
• Title: Peer-to-Peer Energy Trading in Dairy Farms using Multi-Agent Reinforcement Learning
• Authors: Mian Ibad Ali Shah, Marcos Eduardo Cruz Victorio, Maeve Duffy, Enda Barrett, Karl Mason,
• Abstract summary: The integration of renewable energy resources in rural areas enables decentralized energy management through Peer-to-Peer (P2P) energy trading.<n>This research highlights the role of P2P trading in efficient energy distribution and its synergy with advanced optimization techniques.
• Score: 1.7616042687330642
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The integration of renewable energy resources in rural areas, such as dairy farming communities, enables decentralized energy management through Peer-to-Peer (P2P) energy trading. This research highlights the role of P2P trading in efficient energy distribution and its synergy with advanced optimization techniques. While traditional rule-based methods perform well under stable conditions, they struggle in dynamic environments. To address this, Multi-Agent Reinforcement Learning (MARL), specifically Proximal Policy Optimization (PPO) and Deep Q-Networks (DQN), is combined with community/distributed P2P trading mechanisms. By incorporating auction-based market clearing, a price advisor agent, and load and battery management, the approach achieves significant improvements. Results show that, compared to baseline models, DQN reduces electricity costs by 14.2% in Ireland and 5.16% in Finland, while increasing electricity revenue by 7.24% and 12.73%, respectively. PPO achieves the lowest peak hour demand, reducing it by 55.5% in Ireland, while DQN reduces peak hour demand by 50.0% in Ireland and 27.02% in Finland. These improvements are attributed to both MARL algorithms and P2P energy trading, which together results in electricity cost and peak hour demand reduction, and increase electricity selling revenue. This study highlights the complementary strengths of DQN, PPO, and P2P trading in achieving efficient, adaptable, and sustainable energy management in rural communities.

Related papers

• Forecast Aware Deep Reinforcement Learning for Efficient Electricity Load Scheduling in Dairy Farms [1.299941371793082]
  This study proposes a Deep Reinforcement Learning framework for efficient load scheduling in dairy farms.<n>The proposed Forecast Aware PPO incorporates short term forecasts of demand and renewable generation using hour of day and month based residual calibration.<n>For battery scheduling, PPO reduces grid imports by 13.1%, demonstrating scalability and effectiveness for sustainable energy management in modern dairy farming.
  arXiv  Detail & Related papers  (2026-01-12T22:41:26Z)
• ML-Based Bidding Price Prediction for Pay-As-Bid Ancillary Services Markets: A Use Case in the German Control Reserve Market [45.62331048595689]
  This paper presents a methodology for forecasting bidding prices in pay-as-bid ancillary service markets, focusing on the German control reserve market.<n>We evaluate various machine learning models, including Support Vector Regression, Decision Trees, and k-Nearest Neighbors, and compare their performance against benchmark models.<n>Our analysis demonstrates that the proposed approach improves potential revenues by 27.43 % to 37.31 % compared to baseline models.
  arXiv  Detail & Related papers  (2025-03-21T15:21:43Z)
• Reinforcement Learning Enabled Peer-to-Peer Energy Trading for Dairy Farms [1.2289361708127877]
  This study aims to decrease dairy farms' dependence on traditional electricity grids by enabling the sale of surplus renewable energy in Peer-to-Peer markets. The Multi-Agent Peer-to-Peer Dairy Farm Energy Simulator (MAPDES) has been developed, providing a platform to experiment with Reinforcement Learning techniques. The simulations demonstrate significant cost savings, including a 43% reduction in electricity expenses, a 42% decrease in peak demand, and a 1.91% increase in energy sales.
  arXiv  Detail & Related papers  (2024-05-21T12:19:17Z)
• Decentralized Coordination of Distributed Energy Resources through Local Energy Markets and Deep Reinforcement Learning [1.8434042562191815]
  Transactive energy, facilitated through local energy markets, offers a decentralized, indirect demand response solution. This study uses DRL agents to automate end-user participation in a local energy market, where agents act independently to minimize individual energy bills. Results reveal a strong link between bill reduction and decreased net load variability, assessed across metrics such as ramping rate, load factor, and peak demand.
  arXiv  Detail & Related papers  (2024-04-19T19:03:33Z)
• Peer-to-Peer Energy Trading of Solar and Energy Storage: A Networked Multiagent Reinforcement Learning Approach [5.671124014371425]
  We propose multi-agent reinforcement learning (MARL) frameworks to help automate consumers' bidding and management of their solar PV and energy storage resources. We show how the MARL frameworks can integrate physical network constraints to realize voltage control, hence ensuring physical feasibility of the P2P energy trading.
  arXiv  Detail & Related papers  (2024-01-25T05:05:55Z)
• A Multi-Agent Systems Approach for Peer-to-Peer Energy Trading in Dairy Farming [3.441021278275805]
  We propose the Multi-Agent Peer-to-Peer Dairy Farm Energy Simulator (MAPDES) to enable dairy farms to participate in peer-to-peer markets. Our strategy reduces electricity costs and peak demand by approximately 30% and 24% respectively, while increasing energy sales by 37% compared to the baseline scenario.
  arXiv  Detail & Related papers  (2023-08-21T13:22:20Z)
• Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
  This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
  arXiv  Detail & Related papers  (2022-11-29T01:18:58Z)
• The impact of online machine-learning methods on long-term investment decisions and generator utilization in electricity markets [69.68068088508505]
  We investigate the impact of eleven offline and five online learning algorithms to predict the electricity demand profile over the next 24h. We show we can reduce the mean absolute error by 30% using an online algorithm when compared to the best offline algorithm. We also show that large errors in prediction accuracy have a disproportionate error on investments made over a 17-year time frame.
  arXiv  Detail & Related papers  (2021-03-07T11:28:54Z)
• Exploring market power using deep reinforcement learning for intelligent bidding strategies [69.3939291118954]
  We find that capacity has an impact on the average electricity price in a single year. The value of $sim$25% and $sim$11% may vary between market structures and countries. We observe that the use of a market cap of approximately double the average market price has the effect of significantly decreasing this effect and maintaining a competitive market.
  arXiv  Detail & Related papers  (2020-11-08T21:07:42Z)
• A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids [58.666456917115056]
  This paper presents a Reinforcement Learning based energy market for a prosumer dominated microgrid. The proposed market model facilitates a real-time and demanddependent dynamic pricing environment, which reduces grid costs and improves the economic benefits for prosumers.
  arXiv  Detail & Related papers  (2020-09-23T02:17:51Z)
• Towards a Peer-to-Peer Energy Market: an Overview [68.8204255655161]
  This work focuses on the electric power market, comparing the status quo with the recent trend towards the increase in distributed self-generation capabilities by prosumers. We introduce a potential multi-layered architecture for a Peer-to-Peer (P2P) energy market, discussing the fundamental aspects of local production and local consumption as part of a microgrid. To give a full picture to the reader, we also scrutinise relevant elements of energy trading, such as Smart Contract and grid stability.
  arXiv  Detail & Related papers  (2020-03-02T20:32:10Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.