Reinforcement Learning for Hybrid Charging Stations Planning and Operation Considering Fixed and Mobile Chargers

• URL: http://arxiv.org/abs/2506.16764v2
• Date: Sun, 10 Aug 2025 17:48:58 GMT
• Title: Reinforcement Learning for Hybrid Charging Stations Planning and Operation Considering Fixed and Mobile Chargers
• Authors: Yanchen Zhu, Honghui Zou, Chufan Liu, Yuyu Luo, Yuankai Wu, Yuxuan Liang,
• Abstract summary: Vehicle electrification relies on efficient and adaptable charging infrastructure.<n>Fixed-location charging stations often suffer from underutilization or congestion due to fluctuating demand, while mobile chargers offer flexibility by relocating as needed.<n>This paper studies the optimal planning and operation of hybrid charging infrastructures that combine both fixed and mobile chargers within urban road networks.
• Score: 16.831541035603557
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The success of vehicle electrification relies on efficient and adaptable charging infrastructure. Fixed-location charging stations often suffer from underutilization or congestion due to fluctuating demand, while mobile chargers offer flexibility by relocating as needed. This paper studies the optimal planning and operation of hybrid charging infrastructures that combine both fixed and mobile chargers within urban road networks. We formulate the Hybrid Charging Station Planning and Operation (HCSPO) problem, jointly optimizing the placement of fixed stations and the scheduling of mobile chargers. A charging demand prediction model based on Model Predictive Control (MPC) supports dynamic decision-making. To solve the HCSPO problem, we propose a deep reinforcement learning approach enhanced with heuristic scheduling. Experiments on real-world urban scenarios show that our method improves infrastructure availability - achieving up to 244.4% increase in coverage - and reduces user inconvenience with up to 79.8% shorter waiting times, compared to existing solutions.

Related papers

• Resilient Charging Infrastructure via Decentralized Coordination of Electric Vehicles at Scale [37.56003520528009]
  Existing decentralized approaches struggle under severe contingencies, such as station outages or unexpected surges in charging requests.<n>We propose a novel collective learning-based coordination framework that allows EVs to balance individual comfort on their selections against system-wide efficiency.<n>In the framework, EVs are recommended for adaptive charging behaviors that shift priority between comfort and efficiency.
  arXiv  Detail & Related papers  (2025-11-26T00:32:23Z)
• Safe and Sustainable Electric Bus Charging Scheduling with Constrained Hierarchical DRL [43.715336081857394]
  Electric Buses (EBs) with renewable energy sources such as photovoltaic (PV) panels is a promising approach to promote sustainable and low-carbon public transportation.<n>We propose a safe Deep Reinforcement Learning framework for solving the EB Charging Scheduling Problem (EBCSP) under multi-source uncertainties.<n>We develop a novel HDRL algorithm, namely Double ActorCritic MultiAgent Proximal Policy Optimization Lagrangian (DACMAPPO-Lagrangian)
  arXiv  Detail & Related papers  (2025-11-25T20:00:02Z)
• Enhanced Evolutionary Multi-Objective Deep Reinforcement Learning for Reliable and Efficient Wireless Rechargeable Sensor Networks [44.91945854166524]
  Wireless rechargeable sensor networks (WRSNs) with mobile charging capabilities offer a promising solution to extend network lifetime.<n>WRSNs face critical challenges from the inherent trade-off between maximizing the node survival rates and maximizing charging energy efficiency.
  arXiv  Detail & Related papers  (2025-10-24T03:30:00Z)
• Optimizing Electric Bus Charging Scheduling with Uncertainties Using Hierarchical Deep Reinforcement Learning [46.15490780173541]
  Electric Buses (EBs) represent a significant step toward sustainable development.<n>By utilizing Internet of Things (IoT) systems, charging stations can autonomously determine charging schedules based on real-time data.<n>However, optimizing EB charging schedules remains a critical challenge due to uncertainties in travel time, energy consumption, and fluctuating electricity prices.
  arXiv  Detail & Related papers  (2025-05-15T13:44:27Z)
• Joint Resource Management for Energy-efficient UAV-assisted SWIPT-MEC: A Deep Reinforcement Learning Approach [50.52139512096988]
  6G Internet of Things (IoT) networks face challenges in remote areas and disaster scenarios where ground infrastructure is unavailable.<n>This paper proposes a novel aerial unmanned vehicle (UAV)-assisted computing (MEC) system enhanced by directional antennas to provide both computational and energy support for ground edge terminals.
  arXiv  Detail & Related papers  (2025-05-06T06:46:19Z)
• Large Neighborhood Search and Bitmask Dynamic Programming for Wireless Mobile Charging Electric Vehicle Routing Problems in Medical Transportation [5.740535941960799]
  We propose the Wireless Mobile Charging Electric Vehicle Problem (WMC-EVRP)<n>This problem enables Medical Transportation Electric Vehicles (MTEVs) to be charged while traveling via Mobile Charging Carts (MCTs)<n>We develop a mathematical model and a tailored meta-heuristic algorithm that combines Bit Mask Dynamic Programming (BDP) and Large Neighborhood Search (LNS)
  arXiv  Detail & Related papers  (2025-03-11T14:11:10Z)
• Maximum flow-based formulation for the optimal location of electric vehicle charging stations [2.340830801548167]
  We propose a model for the assignment of EV charging demand to stations, framing it as a maximum flow problem. We showcase our methodology for the city of Montreal, demonstrating the scalability of our approach to handle real-world scenarios.
  arXiv  Detail & Related papers  (2023-12-10T19:49:09Z)
• Charge Manipulation Attacks Against Smart Electric Vehicle Charging Stations and Deep Learning-based Detection Mechanisms [49.37592437398933]
  "Smart" electric vehicle charging stations (EVCSs) will be a key step toward achieving green transportation. We investigate charge manipulation attacks (CMAs) against EV charging, in which an attacker manipulates the information exchanged during smart charging operations. We propose an unsupervised deep learning-based mechanism to detect CMAs by monitoring the parameters involved in EV charging.
  arXiv  Detail & Related papers  (2023-10-18T18:38:59Z)
• Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks [42.04263644600909]
  Multi-agent deep reinforcement learning (MADRL) has proven its effectiveness in EV charging control. Existing MADRL-based approaches fail to consider the natural power flow of EV charging/discharging in the distribution network. This paper proposes a novel approach that combines multi-EV charging/discharging with a radial distribution network (RDN) operating under optimal power flow.
  arXiv  Detail & Related papers  (2023-08-17T05:34:46Z)
• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• Data-Driven Chance Constrained AC-OPF using Hybrid Sparse Gaussian Processes [57.70237375696411]
  The paper proposes a fast data-driven setup that uses the sparse and hybrid Gaussian processes (GP) framework to model the power flow equations with input uncertainty. We advocate the efficiency of the proposed approach by a numerical study over multiple IEEE test cases showing up to two times faster and more accurate solutions.
  arXiv  Detail & Related papers  (2022-08-30T09:27:59Z)
• Reinforcement Learning-based Placement of Charging Stations in Urban Road Networks [0.0]
  We design a novel Deep Reinforcement Learning approach to solve the charging station placement problem (PCRL) Compared to the existing infrastructure, we can reduce the waiting time by up to 97% and increase the benefit up to 497%.
  arXiv  Detail & Related papers  (2022-06-13T10:03:32Z)
• SPAP: Simultaneous Demand Prediction and Planning for Electric Vehicle Chargers in a New City [19.95343057352923]
  It is difficult to predict charging demands before the actual deployment of EV chargers for lack of operational data. We propose Simultaneous Demand Prediction And Planning (SPAP) to solve this problem. SPAP improves at most 72.5% revenue compared with the real-world charger deployment.
  arXiv  Detail & Related papers  (2021-10-18T16:42:42Z)
• Optimal Placement of Public Electric Vehicle Charging Stations Using Deep Reinforcement Learning [0.0]
  A novel application of Reinforcement Learning (RL) is able to find optimal locations for new charging stations. The proposed RL framework can be refined and applied to cities across the world to optimize charging station placement.
  arXiv  Detail & Related papers  (2021-08-17T17:25:30Z)
• Risk Adversarial Learning System for Connected and Autonomous Vehicle Charging [43.42105971560163]
  We study the design of a rational decision support system (RDSS) for a connected and autonomous vehicle charging infrastructure (CAV-CI) In the considered CAV-CI, the distribution system operator (DSO) deploys electric vehicle supply equipment (EVSE) to provide an EV charging facility for human-driven connected vehicles (CVs) and autonomous vehicles (AVs) The charging request by the human-driven EV becomes irrational when it demands more energy and charging period than its actual need. We propose a novel risk adversarial multi-agent learning system (ALS) for CAV-CI to solve
  arXiv  Detail & Related papers  (2021-08-02T02:38:15Z)
• Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning [42.31586065609373]
  Electric Vehicle (EV) has become a choice in the modern transportation system due to its environmental and energy sustainability. In many cities, EV drivers often fail to find the proper spots for charging, because of the limited charging infrastructures and the largely unbalanced charging demands. We propose a framework, named Multi-Agent Spatiotemporal-temporal ment Learning (MasterReinforce), for intelligently recommending public charging stations.
  arXiv  Detail & Related papers  (2021-02-15T06:23:59Z)
• Electric Vehicle Charging Infrastructure Planning: A Scalable Computational Framework [5.572792035859953]
  The optimal charging infrastructure planning problem over a large geospatial area is challenging due to the increasing network sizes of the transportation system and the electric grid. This paper focuses on the demonstration of a scalable computational framework for the electric vehicle charging infrastructure planning over the tightly integrated transportation and electric grid networks.
  arXiv  Detail & Related papers  (2020-11-17T16:48:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.