Agent-Based Decentralized Energy Management of EV Charging Station with Solar Photovoltaics via Multi-Agent Reinforcement Learning

• URL: http://arxiv.org/abs/2505.18750v1
• Date: Sat, 24 May 2025 15:34:37 GMT
• Title: Agent-Based Decentralized Energy Management of EV Charging Station with Solar Photovoltaics via Multi-Agent Reinforcement Learning
• Authors: Jiarong Fan, Chenghao Huang, Hao Wang,
• Abstract summary: The adoption of Electric Vehicles (EVs) keeps increasing, making energy management of EV charging stations critically important.<n>Previous studies have managed to reduce energy cost of EV charging while maintaining grid stability.<n>We propose a novel Multi-Agent Reinforcement Learning (MARL) approach treating each charger to be an agent and coordinate all the agents in the EV charging station with solar photovoltaics.
• Score: 4.9855485718502015
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In the pursuit of energy net zero within smart cities, transportation electrification plays a pivotal role. The adoption of Electric Vehicles (EVs) keeps increasing, making energy management of EV charging stations critically important. While previous studies have managed to reduce energy cost of EV charging while maintaining grid stability, they often overlook the robustness of EV charging management against uncertainties of various forms, such as varying charging behaviors and possible faults in faults in some chargers. To address the gap, a novel Multi-Agent Reinforcement Learning (MARL) approach is proposed treating each charger to be an agent and coordinate all the agents in the EV charging station with solar photovoltaics in a more realistic scenario, where system faults may occur. A Long Short-Term Memory (LSTM) network is incorporated in the MARL algorithm to extract temporal features from time-series. Additionally, a dense reward mechanism is designed for training the agents in the MARL algorithm to improve EV charging experience. Through validation on a real-world dataset, we show that our approach is robust against system uncertainties and faults and also effective in minimizing EV charging costs and maximizing charging service satisfaction.

Related papers

• Profiling Electric Vehicles via Early Charging Voltage Patterns [56.4040698609393]
  Electric Vehicles (EVs) are rapidly gaining adoption as a sustainable alternative to fuel-powered vehicles.<n>Recent results showed that attackers may steal energy through tailored relay attacks.<n>One countermeasure is leveraging the EV's fingerprint on the current exchanged during charging.
  arXiv  Detail & Related papers  (2025-06-09T12:57:37Z)
• Uncertainty-Aware Critic Augmentation for Hierarchical Multi-Agent EV Charging Control [9.96602699887327]
  We propose HUCA, a novel real-time charging control for regulating energy demands for both the building and EVs.<n>HUCA employs hierarchical actor-critic networks to dynamically reduce electricity costs in buildings, accounting for the needs of EV charging in the dynamic pricing scenario.<n> Experiments on real-world electricity datasets under both simulated certain and uncertain departure scenarios demonstrate that HUCA outperforms baselines in terms of total electricity costs.
  arXiv  Detail & Related papers  (2024-12-23T23:45:45Z)
• Charge Manipulation Attacks Against Smart Electric Vehicle Charging Stations and Deep Learning-based Detection Mechanisms [49.37592437398933]
  "Smart" electric vehicle charging stations (EVCSs) will be a key step toward achieving green transportation. We investigate charge manipulation attacks (CMAs) against EV charging, in which an attacker manipulates the information exchanged during smart charging operations. We propose an unsupervised deep learning-based mechanism to detect CMAs by monitoring the parameters involved in EV charging.
  arXiv  Detail & Related papers  (2023-10-18T18:38:59Z)
• MARL for Decentralized Electric Vehicle Charging Coordination with V2V Energy Exchange [5.442116840518914]
  This paper addresses the EV charging coordination by considering vehicle-to-vehicle (V2V) energy exchange. We propose a Multi-Agent Reinforcement Learning (MARL) approach to coordinate EV charging with V2V energy exchange.
  arXiv  Detail & Related papers  (2023-08-27T14:06:21Z)
• An Efficient Distributed Multi-Agent Reinforcement Learning for EV Charging Network Control [2.5477011559292175]
  We introduce a decentralized Multi-agent Reinforcement Learning (MARL) charging framework that prioritizes the preservation of privacy for EV owners. Our results demonstrate that the CTDE framework improves the performance of the charging network by reducing the network costs.
  arXiv  Detail & Related papers  (2023-08-24T16:53:52Z)
• Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks [42.04263644600909]
  Multi-agent deep reinforcement learning (MADRL) has proven its effectiveness in EV charging control. Existing MADRL-based approaches fail to consider the natural power flow of EV charging/discharging in the distribution network. This paper proposes a novel approach that combines multi-EV charging/discharging with a radial distribution network (RDN) operating under optimal power flow.
  arXiv  Detail & Related papers  (2023-08-17T05:34:46Z)
• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• Learning to Operate an Electric Vehicle Charging Station Considering Vehicle-grid Integration [4.855689194518905]
  We propose a novel centralized allocation and decentralized execution (CADE) reinforcement learning (RL) framework to maximize the charging station's profit. In the centralized allocation process, EVs are allocated to either the waiting or charging spots. In the decentralized execution process, each charger makes its own charging/discharging decision while learning the action-value functions from a shared replay memory. Numerical results show that the proposed CADE framework is both computationally efficient and scalable, and significantly outperforms the baseline model predictive control (MPC)
  arXiv  Detail & Related papers  (2021-11-01T23:10:28Z)
• Risk Adversarial Learning System for Connected and Autonomous Vehicle Charging [43.42105971560163]
  We study the design of a rational decision support system (RDSS) for a connected and autonomous vehicle charging infrastructure (CAV-CI) In the considered CAV-CI, the distribution system operator (DSO) deploys electric vehicle supply equipment (EVSE) to provide an EV charging facility for human-driven connected vehicles (CVs) and autonomous vehicles (AVs) The charging request by the human-driven EV becomes irrational when it demands more energy and charging period than its actual need. We propose a novel risk adversarial multi-agent learning system (ALS) for CAV-CI to solve
  arXiv  Detail & Related papers  (2021-08-02T02:38:15Z)
• Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids [56.35173057183362]
  We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. We propose the formulation of a smart grid environment as a Markov game.
  arXiv  Detail & Related papers  (2020-05-05T07:32:40Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.