Reinforcement Learning-based Placement of Charging Stations in Urban Road Networks

• URL: http://arxiv.org/abs/2206.06011v1
• Date: Mon, 13 Jun 2022 10:03:32 GMT
• Title: Reinforcement Learning-based Placement of Charging Stations in Urban Road Networks
• Authors: Leonie von Wahl (1), Nicolas Tempelmeier (1), Ashutosh Sao (2) and Elena Demidova (3) ((1) Volkswagen Group, (2) L3S Research Center, University of Hannover, (3) Data Science & Intelligent Systems Group (DSIS), University of Bonn)
• Abstract summary: We design a novel Deep Reinforcement Learning approach to solve the charging station placement problem (PCRL) Compared to the existing infrastructure, we can reduce the waiting time by up to 97% and increase the benefit up to 497%.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The transition from conventional mobility to electromobility largely depends on charging infrastructure availability and optimal placement.This paper examines the optimal placement of charging stations in urban areas. We maximise the charging infrastructure supply over the area and minimise waiting, travel, and charging times while setting budget constraints. Moreover, we include the possibility of charging vehicles at home to obtain a more refined estimation of the actual charging demand throughout the urban area. We formulate the Placement of Charging Stations problem as a non-linear integer optimisation problem that seeks the optimal positions for charging stations and the optimal number of charging piles of different charging types. We design a novel Deep Reinforcement Learning approach to solve the charging station placement problem (PCRL). Extensive experiments on real-world datasets show how the PCRL reduces the waiting and travel time while increasing the benefit of the charging plan compared to five baselines. Compared to the existing infrastructure, we can reduce the waiting time by up to 97% and increase the benefit up to 497%.

Related papers

• Maximum flow-based formulation for the optimal location of electric vehicle charging stations [2.340830801548167]
  We propose a model for the assignment of EV charging demand to stations, framing it as a maximum flow problem. We showcase our methodology for the city of Montreal, demonstrating the scalability of our approach to handle real-world scenarios.
  arXiv  Detail & Related papers  (2023-12-10T19:49:09Z)
• Resource Constrained Vehicular Edge Federated Learning with Highly Mobile Connected Vehicles [41.02566275644629]
  We propose a vehicular edge federated learning (VEFL) solution, where an edge server leverages highly mobile connected vehicles' (CVs') onboard central processing units ( CPUs) and local datasets to train a global model. We devise joint VEFL and radio access technology (RAT) parameters optimization problems under delay, energy and cost constraints to maximize the probability of successful reception of the locally trained models.
  arXiv  Detail & Related papers  (2022-10-27T14:33:06Z)
• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• Web Mining to Inform Locations of Charging Stations for Electric Vehicles [18.25327009053813]
  Electric vehicle (EV) owners have a certain limited willingness to walk between charging stations and points-of-interest (POIs) We propose the use of web mining: we characterize the influence of different POIs from OpenStreetMap on the utilization of charging stations. We present a tailored interpretable model that takes into account the full spatial distributions of both the POIs and the charging stations.
  arXiv  Detail & Related papers  (2022-03-10T17:00:18Z)
• Learning to Operate an Electric Vehicle Charging Station Considering Vehicle-grid Integration [4.855689194518905]
  We propose a novel centralized allocation and decentralized execution (CADE) reinforcement learning (RL) framework to maximize the charging station's profit. In the centralized allocation process, EVs are allocated to either the waiting or charging spots. In the decentralized execution process, each charger makes its own charging/discharging decision while learning the action-value functions from a shared replay memory. Numerical results show that the proposed CADE framework is both computationally efficient and scalable, and significantly outperforms the baseline model predictive control (MPC)
  arXiv  Detail & Related papers  (2021-11-01T23:10:28Z)
• SPAP: Simultaneous Demand Prediction and Planning for Electric Vehicle Chargers in a New City [19.95343057352923]
  It is difficult to predict charging demands before the actual deployment of EV chargers for lack of operational data. We propose Simultaneous Demand Prediction And Planning (SPAP) to solve this problem. SPAP improves at most 72.5% revenue compared with the real-world charger deployment.
  arXiv  Detail & Related papers  (2021-10-18T16:42:42Z)
• Optimizing a domestic battery and solar photovoltaic system with deep reinforcement learning [69.68068088508505]
  A lowering in the cost of batteries and solar PV systems has led to a high uptake of solar battery home systems. In this work, we use the deep deterministic policy algorithm to optimise the charging and discharging behaviour of a battery within such a system.
  arXiv  Detail & Related papers  (2021-09-10T10:59:14Z)
• Optimal Placement of Public Electric Vehicle Charging Stations Using Deep Reinforcement Learning [0.0]
  A novel application of Reinforcement Learning (RL) is able to find optimal locations for new charging stations. The proposed RL framework can be refined and applied to cities across the world to optimize charging station placement.
  arXiv  Detail & Related papers  (2021-08-17T17:25:30Z)
• Risk Adversarial Learning System for Connected and Autonomous Vehicle Charging [43.42105971560163]
  We study the design of a rational decision support system (RDSS) for a connected and autonomous vehicle charging infrastructure (CAV-CI) In the considered CAV-CI, the distribution system operator (DSO) deploys electric vehicle supply equipment (EVSE) to provide an EV charging facility for human-driven connected vehicles (CVs) and autonomous vehicles (AVs) The charging request by the human-driven EV becomes irrational when it demands more energy and charging period than its actual need. We propose a novel risk adversarial multi-agent learning system (ALS) for CAV-CI to solve
  arXiv  Detail & Related papers  (2021-08-02T02:38:15Z)
• Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning [42.31586065609373]
  Electric Vehicle (EV) has become a choice in the modern transportation system due to its environmental and energy sustainability. In many cities, EV drivers often fail to find the proper spots for charging, because of the limited charging infrastructures and the largely unbalanced charging demands. We propose a framework, named Multi-Agent Spatiotemporal-temporal ment Learning (MasterReinforce), for intelligently recommending public charging stations.
  arXiv  Detail & Related papers  (2021-02-15T06:23:59Z)
• Deep Reinforcement Learning with Spatio-temporal Traffic Forecasting for Data-Driven Base Station Sleep Control [39.31623488192675]
  To meet the ever increasing mobile traffic demand in 5G era, base stations (BSs) have been densely deployed in radio access networks (RANs) to increase the network coverage and capacity. As the high density of BSs is designed to accommodate peak traffic, it would consume an unnecessarily large amount of energy if BSs are on during off-peak time. To save the energy consumption of cellular networks, an effective way is to deactivate some idle base stations that do not serve any traffic demand. In this paper, we develop a traffic-aware dynamic BS sleep control framework, named DeepBSC
  arXiv  Detail & Related papers  (2021-01-21T01:39:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.