Reinforcement Learning-based Placement of Charging Stations in Urban
Road Networks
- URL: http://arxiv.org/abs/2206.06011v1
- Date: Mon, 13 Jun 2022 10:03:32 GMT
- Title: Reinforcement Learning-based Placement of Charging Stations in Urban
Road Networks
- Authors: Leonie von Wahl (1), Nicolas Tempelmeier (1), Ashutosh Sao (2) and
Elena Demidova (3) ((1) Volkswagen Group, (2) L3S Research Center, University
of Hannover, (3) Data Science & Intelligent Systems Group (DSIS), University
of Bonn)
- Abstract summary: We design a novel Deep Reinforcement Learning approach to solve the charging station placement problem (PCRL)
Compared to the existing infrastructure, we can reduce the waiting time by up to 97% and increase the benefit up to 497%.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The transition from conventional mobility to electromobility largely depends
on charging infrastructure availability and optimal placement.This paper
examines the optimal placement of charging stations in urban areas. We maximise
the charging infrastructure supply over the area and minimise waiting, travel,
and charging times while setting budget constraints. Moreover, we include the
possibility of charging vehicles at home to obtain a more refined estimation of
the actual charging demand throughout the urban area. We formulate the
Placement of Charging Stations problem as a non-linear integer optimisation
problem that seeks the optimal positions for charging stations and the optimal
number of charging piles of different charging types. We design a novel Deep
Reinforcement Learning approach to solve the charging station placement problem
(PCRL). Extensive experiments on real-world datasets show how the PCRL reduces
the waiting and travel time while increasing the benefit of the charging plan
compared to five baselines. Compared to the existing infrastructure, we can
reduce the waiting time by up to 97% and increase the benefit up to 497%.
Related papers
- Maximum flow-based formulation for the optimal location of electric
vehicle charging stations [2.340830801548167]
We propose a model for the assignment of EV charging demand to stations, framing it as a maximum flow problem.
We showcase our methodology for the city of Montreal, demonstrating the scalability of our approach to handle real-world scenarios.
arXiv Detail & Related papers (2023-12-10T19:49:09Z) - Federated Reinforcement Learning for Real-Time Electric Vehicle Charging
and Discharging Control [42.17503767317918]
This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments.
A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments.
Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
arXiv Detail & Related papers (2022-10-04T08:22:46Z) - Web Mining to Inform Locations of Charging Stations for Electric
Vehicles [18.25327009053813]
Electric vehicle (EV) owners have a certain limited willingness to walk between charging stations and points-of-interest (POIs)
We propose the use of web mining: we characterize the influence of different POIs from OpenStreetMap on the utilization of charging stations.
We present a tailored interpretable model that takes into account the full spatial distributions of both the POIs and the charging stations.
arXiv Detail & Related papers (2022-03-10T17:00:18Z) - Learning to Operate an Electric Vehicle Charging Station Considering
Vehicle-grid Integration [4.855689194518905]
We propose a novel centralized allocation and decentralized execution (CADE) reinforcement learning (RL) framework to maximize the charging station's profit.
In the centralized allocation process, EVs are allocated to either the waiting or charging spots. In the decentralized execution process, each charger makes its own charging/discharging decision while learning the action-value functions from a shared replay memory.
Numerical results show that the proposed CADE framework is both computationally efficient and scalable, and significantly outperforms the baseline model predictive control (MPC)
arXiv Detail & Related papers (2021-11-01T23:10:28Z) - SPAP: Simultaneous Demand Prediction and Planning for Electric Vehicle
Chargers in a New City [19.95343057352923]
It is difficult to predict charging demands before the actual deployment of EV chargers for lack of operational data.
We propose Simultaneous Demand Prediction And Planning (SPAP) to solve this problem.
SPAP improves at most 72.5% revenue compared with the real-world charger deployment.
arXiv Detail & Related papers (2021-10-18T16:42:42Z) - Optimizing a domestic battery and solar photovoltaic system with deep
reinforcement learning [69.68068088508505]
A lowering in the cost of batteries and solar PV systems has led to a high uptake of solar battery home systems.
In this work, we use the deep deterministic policy algorithm to optimise the charging and discharging behaviour of a battery within such a system.
arXiv Detail & Related papers (2021-09-10T10:59:14Z) - Optimal Placement of Public Electric Vehicle Charging Stations Using
Deep Reinforcement Learning [0.0]
A novel application of Reinforcement Learning (RL) is able to find optimal locations for new charging stations.
The proposed RL framework can be refined and applied to cities across the world to optimize charging station placement.
arXiv Detail & Related papers (2021-08-17T17:25:30Z) - Risk Adversarial Learning System for Connected and Autonomous Vehicle
Charging [43.42105971560163]
We study the design of a rational decision support system (RDSS) for a connected and autonomous vehicle charging infrastructure (CAV-CI)
In the considered CAV-CI, the distribution system operator (DSO) deploys electric vehicle supply equipment (EVSE) to provide an EV charging facility for human-driven connected vehicles (CVs) and autonomous vehicles (AVs)
The charging request by the human-driven EV becomes irrational when it demands more energy and charging period than its actual need.
We propose a novel risk adversarial multi-agent learning system (ALS) for CAV-CI to solve
arXiv Detail & Related papers (2021-08-02T02:38:15Z) - The impact of online machine-learning methods on long-term investment
decisions and generator utilization in electricity markets [69.68068088508505]
We investigate the impact of eleven offline and five online learning algorithms to predict the electricity demand profile over the next 24h.
We show we can reduce the mean absolute error by 30% using an online algorithm when compared to the best offline algorithm.
We also show that large errors in prediction accuracy have a disproportionate error on investments made over a 17-year time frame.
arXiv Detail & Related papers (2021-03-07T11:28:54Z) - Intelligent Electric Vehicle Charging Recommendation Based on
Multi-Agent Reinforcement Learning [42.31586065609373]
Electric Vehicle (EV) has become a choice in the modern transportation system due to its environmental and energy sustainability.
In many cities, EV drivers often fail to find the proper spots for charging, because of the limited charging infrastructures and the largely unbalanced charging demands.
We propose a framework, named Multi-Agent Spatiotemporal-temporal ment Learning (MasterReinforce), for intelligently recommending public charging stations.
arXiv Detail & Related papers (2021-02-15T06:23:59Z) - Deep Learning for Radio Resource Allocation with Diverse
Quality-of-Service Requirements in 5G [53.23237216769839]
We develop a deep learning framework to approximate the optimal resource allocation policy for base stations.
We find that a fully-connected neural network (NN) cannot fully guarantee the requirements due to the approximation errors and quantization errors of the numbers of subcarriers.
Considering that the distribution of wireless channels and the types of services in the wireless networks are non-stationary, we apply deep transfer learning to update NNs in non-stationary wireless networks.
arXiv Detail & Related papers (2020-03-29T04:48:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.