MARL for Decentralized Electric Vehicle Charging Coordination with V2V Energy Exchange

• URL: http://arxiv.org/abs/2308.14111v1
• Date: Sun, 27 Aug 2023 14:06:21 GMT
• Title: MARL for Decentralized Electric Vehicle Charging Coordination with V2V Energy Exchange
• Authors: Jiarong Fan, Hao Wang, Ariel Liebman
• Abstract summary: This paper addresses the EV charging coordination by considering vehicle-to-vehicle (V2V) energy exchange. We propose a Multi-Agent Reinforcement Learning (MARL) approach to coordinate EV charging with V2V energy exchange.
• Score: 5.442116840518914
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Effective energy management of electric vehicle (EV) charging stations is critical to supporting the transport sector's sustainable energy transition. This paper addresses the EV charging coordination by considering vehicle-to-vehicle (V2V) energy exchange as the flexibility to harness in EV charging stations. Moreover, this paper takes into account EV user experiences, such as charging satisfaction and fairness. We propose a Multi-Agent Reinforcement Learning (MARL) approach to coordinate EV charging with V2V energy exchange while considering uncertainties in the EV arrival time, energy price, and solar energy generation. The exploration capability of MARL is enhanced by introducing parameter noise into MARL's neural network models. Experimental results demonstrate the superior performance and scalability of our proposed method compared to traditional optimization baselines. The decentralized execution of the algorithm enables it to effectively deal with partial system faults in the charging station.

Related papers

• Electric Vehicles coordination for grid balancing using multi-objective Harris Hawks Optimization [0.0]
  The rise of renewables coincides with the shift towards Electrical Vehicles (EVs) posing technical and operational challenges for the energy balance of the local grid. Coordinating power flow from multiple EVs into the grid requires sophisticated algorithms and load-balancing strategies. This paper proposes an EVs fleet coordination model for the day ahead aiming to ensure a reliable energy supply and maintain a stable local grid.
  arXiv  Detail & Related papers  (2023-11-24T15:50:37Z)
• Charge Manipulation Attacks Against Smart Electric Vehicle Charging Stations and Deep Learning-based Detection Mechanisms [49.37592437398933]
  "Smart" electric vehicle charging stations (EVCSs) will be a key step toward achieving green transportation. We investigate charge manipulation attacks (CMAs) against EV charging, in which an attacker manipulates the information exchanged during smart charging operations. We propose an unsupervised deep learning-based mechanism to detect CMAs by monitoring the parameters involved in EV charging.
  arXiv  Detail & Related papers  (2023-10-18T18:38:59Z)
• Recent Progress in Energy Management of Connected Hybrid Electric Vehicles Using Reinforcement Learning [6.851787321368938]
  The shift towards electrifying transportation aims to curb environmental concerns related to fossil fuel consumption. The evolution of energy management systems (EMS) from HEVs to connected hybrid electric vehicles (CHEVs) represent a pivotal shift. This review bridges the gap, highlighting challenges, advancements, and potential contributions of RL-based solutions for future sustainable transportation systems.
  arXiv  Detail & Related papers  (2023-08-28T14:12:52Z)
• Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks [42.04263644600909]
  Multi-agent deep reinforcement learning (MADRL) has proven its effectiveness in EV charging control. Existing MADRL-based approaches fail to consider the natural power flow of EV charging/discharging in the distribution network. This paper proposes a novel approach that combines multi-EV charging/discharging with a radial distribution network (RDN) operating under optimal power flow.
  arXiv  Detail & Related papers  (2023-08-17T05:34:46Z)
• Deep Reinforcement Learning-Based Battery Conditioning Hierarchical V2G Coordination for Multi-Stakeholder Benefits [3.4529246211079645]
  This study proposes a multi-stakeholder hierarchical V2G coordination based on deep reinforcement learning (DRL) and the Proof of Stake algorithm. The multi-stakeholders include the power grid, EV aggregators (EVAs), and users, and the proposed strategy can achieve multi-stakeholder benefits.
  arXiv  Detail & Related papers  (2023-08-01T01:19:56Z)
• Solar Power driven EV Charging Optimization with Deep Reinforcement Learning [6.936743119804558]
  Decentralized energy resources, such as Electric Vehicles (EV) and solar photovoltaic systems (PV), are continuously integrated in residential power systems. This paper aims to address the challenge of domestic EV charging while prioritizing clean, solar energy consumption.
  arXiv  Detail & Related papers  (2022-11-17T11:52:27Z)
• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• An Energy Consumption Model for Electrical Vehicle Networks via Extended Federated-learning [50.85048976506701]
  This paper proposes a novel solution to range anxiety based on a federated-learning model. It is capable of estimating battery consumption and providing energy-efficient route planning for vehicle networks.
  arXiv  Detail & Related papers  (2021-11-13T15:03:44Z)
• Fed-BEV: A Federated Learning Framework for Modelling Energy Consumption of Battery Electric Vehicles [5.817576247456001]
  Battery electric vehicles (BEVs) exclusively use chemical energy stored in their battery packs for propulsion. We propose a novel framework for modelling energy consumption for BEVs (Fed-BEV) More specifically, a group of BEVs involved in the Fed-BEV framework can learn from each other to jointly enhance their energy consumption model.
  arXiv  Detail & Related papers  (2021-08-05T01:56:09Z)
• Risk Adversarial Learning System for Connected and Autonomous Vehicle Charging [43.42105971560163]
  We study the design of a rational decision support system (RDSS) for a connected and autonomous vehicle charging infrastructure (CAV-CI) In the considered CAV-CI, the distribution system operator (DSO) deploys electric vehicle supply equipment (EVSE) to provide an EV charging facility for human-driven connected vehicles (CVs) and autonomous vehicles (AVs) The charging request by the human-driven EV becomes irrational when it demands more energy and charging period than its actual need. We propose a novel risk adversarial multi-agent learning system (ALS) for CAV-CI to solve
  arXiv  Detail & Related papers  (2021-08-02T02:38:15Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.