Reinforcement learning for hybrid charging stations planning and operation considering fixed and mobile chargers

• URL: http://arxiv.org/abs/2506.16764v1
• Date: Fri, 20 Jun 2025 05:51:02 GMT
• Title: Reinforcement learning for hybrid charging stations planning and operation considering fixed and mobile chargers
• Authors: Yanchen Zhu, Honghui Zou, Chufan Liu, Yuyu Luo, Yuankai Wu, Yuxuan Liang,
• Abstract summary: Traditional fixed-location charging stations often face issues like underutilization or congestion due to the dynamic nature of charging demand.<n>Mobile chargers have emerged as a flexible solution, capable of relocating to align with these demand fluctuations.<n>This paper addresses the optimal planning and operation of hybrid charging infrastructures, integrating both fixed and mobile chargers within urban road networks.
• Score: 16.831541035603557
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The success of vehicle electrification, which brings significant societal and environmental benefits, is contingent upon the availability of efficient and adaptable charging infrastructure. Traditional fixed-location charging stations often face issues like underutilization or congestion due to the dynamic nature of charging demand. Mobile chargers have emerged as a flexible solution, capable of relocating to align with these demand fluctuations. This paper addresses the optimal planning and operation of hybrid charging infrastructures, integrating both fixed and mobile chargers within urban road networks. We introduce the Hybrid Charging Station Planning and Operation (HCSPO) problem, which simultaneously optimizes the location and configuration of fixed charging stations and schedules mobile chargers for dynamic operations. Our approach incorporates a charging demand prediction model grounded in Model Predictive Control (MPC) to enhance decision-making. To solve the HCSPO problem, we propose a deep reinforcement learning method, augmented with heuristic scheduling techniques, to effectively bridge the planning of fixed chargers with the real-time operation of mobile chargers. Extensive case studies using real-world urban scenarios demonstrate that our method significantly improves the availability of charging infrastructure and reduces user inconvenience compared to existing solutions and baselines.

Related papers

• Optimizing Electric Bus Charging Scheduling with Uncertainties Using Hierarchical Deep Reinforcement Learning [46.15490780173541]
  Electric Buses (EBs) represent a significant step toward sustainable development.<n>By utilizing Internet of Things (IoT) systems, charging stations can autonomously determine charging schedules based on real-time data.<n>However, optimizing EB charging schedules remains a critical challenge due to uncertainties in travel time, energy consumption, and fluctuating electricity prices.
  arXiv  Detail & Related papers  (2025-05-15T13:44:27Z)
• Joint Resource Management for Energy-efficient UAV-assisted SWIPT-MEC: A Deep Reinforcement Learning Approach [50.52139512096988]
  6G Internet of Things (IoT) networks face challenges in remote areas and disaster scenarios where ground infrastructure is unavailable.<n>This paper proposes a novel aerial unmanned vehicle (UAV)-assisted computing (MEC) system enhanced by directional antennas to provide both computational and energy support for ground edge terminals.
  arXiv  Detail & Related papers  (2025-05-06T06:46:19Z)
• Large Neighborhood Search and Bitmask Dynamic Programming for Wireless Mobile Charging Electric Vehicle Routing Problems in Medical Transportation [5.740535941960799]
  We propose the Wireless Mobile Charging Electric Vehicle Problem (WMC-EVRP)<n>This problem enables Medical Transportation Electric Vehicles (MTEVs) to be charged while traveling via Mobile Charging Carts (MCTs)<n>We develop a mathematical model and a tailored meta-heuristic algorithm that combines Bit Mask Dynamic Programming (BDP) and Large Neighborhood Search (LNS)
  arXiv  Detail & Related papers  (2025-03-11T14:11:10Z)
• Maximum flow-based formulation for the optimal location of electric vehicle charging stations [2.340830801548167]
  We propose a model for the assignment of EV charging demand to stations, framing it as a maximum flow problem. We showcase our methodology for the city of Montreal, demonstrating the scalability of our approach to handle real-world scenarios.
  arXiv  Detail & Related papers  (2023-12-10T19:49:09Z)
• Charge Manipulation Attacks Against Smart Electric Vehicle Charging Stations and Deep Learning-based Detection Mechanisms [49.37592437398933]
  "Smart" electric vehicle charging stations (EVCSs) will be a key step toward achieving green transportation. We investigate charge manipulation attacks (CMAs) against EV charging, in which an attacker manipulates the information exchanged during smart charging operations. We propose an unsupervised deep learning-based mechanism to detect CMAs by monitoring the parameters involved in EV charging.
  arXiv  Detail & Related papers  (2023-10-18T18:38:59Z)
• Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks [42.04263644600909]
  Multi-agent deep reinforcement learning (MADRL) has proven its effectiveness in EV charging control. Existing MADRL-based approaches fail to consider the natural power flow of EV charging/discharging in the distribution network. This paper proposes a novel approach that combines multi-EV charging/discharging with a radial distribution network (RDN) operating under optimal power flow.
  arXiv  Detail & Related papers  (2023-08-17T05:34:46Z)
• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• Data-Driven Chance Constrained AC-OPF using Hybrid Sparse Gaussian Processes [57.70237375696411]
  The paper proposes a fast data-driven setup that uses the sparse and hybrid Gaussian processes (GP) framework to model the power flow equations with input uncertainty. We advocate the efficiency of the proposed approach by a numerical study over multiple IEEE test cases showing up to two times faster and more accurate solutions.
  arXiv  Detail & Related papers  (2022-08-30T09:27:59Z)
• Reinforcement Learning-based Placement of Charging Stations in Urban Road Networks [0.0]
  We design a novel Deep Reinforcement Learning approach to solve the charging station placement problem (PCRL) Compared to the existing infrastructure, we can reduce the waiting time by up to 97% and increase the benefit up to 497%.
  arXiv  Detail & Related papers  (2022-06-13T10:03:32Z)
• SPAP: Simultaneous Demand Prediction and Planning for Electric Vehicle Chargers in a New City [19.95343057352923]
  It is difficult to predict charging demands before the actual deployment of EV chargers for lack of operational data. We propose Simultaneous Demand Prediction And Planning (SPAP) to solve this problem. SPAP improves at most 72.5% revenue compared with the real-world charger deployment.
  arXiv  Detail & Related papers  (2021-10-18T16:42:42Z)
• Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning [42.31586065609373]
  Electric Vehicle (EV) has become a choice in the modern transportation system due to its environmental and energy sustainability. In many cities, EV drivers often fail to find the proper spots for charging, because of the limited charging infrastructures and the largely unbalanced charging demands. We propose a framework, named Multi-Agent Spatiotemporal-temporal ment Learning (MasterReinforce), for intelligently recommending public charging stations.
  arXiv  Detail & Related papers  (2021-02-15T06:23:59Z)
• Electric Vehicle Charging Infrastructure Planning: A Scalable Computational Framework [5.572792035859953]
  The optimal charging infrastructure planning problem over a large geospatial area is challenging due to the increasing network sizes of the transportation system and the electric grid. This paper focuses on the demonstration of a scalable computational framework for the electric vehicle charging infrastructure planning over the tightly integrated transportation and electric grid networks.
  arXiv  Detail & Related papers  (2020-11-17T16:48:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.