CoordiQ : Coordinated Q-learning for Electric Vehicle Charging Recommendation

• URL: http://arxiv.org/abs/2102.00847v1
• Date: Thu, 28 Jan 2021 21:25:33 GMT
• Title: CoordiQ : Coordinated Q-learning for Electric Vehicle Charging Recommendation
• Authors: Carter Blum, Hao Liu, Hui Xiong
• Abstract summary: Electric vehicles have been rapidly increasing in usage, but stations to charge them have not always kept up with demand. We develop a model that allows complex representations of actions and improve outcomes for users of our system by over 30%. If implemented widely, these better recommendations can globally save over 4 million person-hours of waiting and driving each year.
• Score: 17.893474989578138
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Electric vehicles have been rapidly increasing in usage, but stations to charge them have not always kept up with demand, so efficient routing of vehicles to stations is critical to operating at maximum efficiency. Deciding which stations to recommend drivers to is a complex problem with a multitude of possible recommendations, volatile usage patterns and temporally extended consequences of recommendations. Reinforcement learning offers a powerful paradigm for solving sequential decision-making problems, but traditional methods may struggle with sample efficiency due to the high number of possible actions. By developing a model that allows complex representations of actions, we improve outcomes for users of our system by over 30% when compared to existing baselines in a simulation. If implemented widely, these better recommendations can globally save over 4 million person-hours of waiting and driving each year.

Related papers

• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• Improving Operational Efficiency In EV Ridepooling Fleets By Predictive Exploitation of Idle Times [0.0]
  We present a real-time predictive charging method for ridepooling services with a single operator, called Idle Time Exploitation (ITX) ITX predicts the periods where vehicles are idle and exploits these periods to harvest energy. It relies on Graph Convolutional Networks and a linear assignment algorithm to devise an optimal pairing of vehicles and charging stations.
  arXiv  Detail & Related papers  (2022-08-30T08:41:40Z)
• A Multi-Objective approach to the Electric Vehicle Routing Problem [0.0]
  The electric vehicle routing problem (EVRP) has garnered great interest from researchers and industrialists in an attempt to move from fuel-based vehicles to healthier and more efficient electric vehicles (EVs) Previous works target logistics and delivery-related solutions wherein a homogeneous fleet of commercial EVs have to return to the initial point after making multiple stops. We perform multi-objective optimization - minimizing the total trip time and the cumulative cost of charging.
  arXiv  Detail & Related papers  (2022-08-26T05:09:59Z)
• Unified Automatic Control of Vehicular Systems with Reinforcement Learning [64.63619662693068]
  This article contributes a streamlined methodology for vehicular microsimulation. It discovers high performance control strategies with minimal manual design. The study reveals numerous emergent behaviors resembling wave mitigation, traffic signaling, and ramp metering.
  arXiv  Detail & Related papers  (2022-07-30T16:23:45Z)
• Learning energy-efficient driving behaviors by imitating experts [75.12960180185105]
  This paper examines the role of imitation learning in bridging the gap between control strategies and realistic limitations in communication and sensing. We show that imitation learning can succeed in deriving policies that, if adopted by 5% of vehicles, may boost the energy-efficiency of networks with varying traffic conditions by 15% using only local observations.
  arXiv  Detail & Related papers  (2022-06-28T17:08:31Z)
• A new Hyper-heuristic based on Adaptive Simulated Annealing and Reinforcement Learning for the Capacitated Electric Vehicle Routing Problem [9.655068751758952]
  Electric vehicles (EVs) have been adopted in urban areas to reduce environmental pollution and global warming. There are still deficiencies in routing the trajectories of last-mile logistics that continue to impact social and economic sustainability. This paper proposes a hyper-heuristic approach called Hyper-heuristic Adaptive Simulated Annealing with Reinforcement Learning.
  arXiv  Detail & Related papers  (2022-06-07T11:10:38Z)
• Scalable Vehicle Re-Identification via Self-Supervision [66.2562538902156]
  Vehicle Re-Identification is one of the key elements in city-scale vehicle analytics systems. Many state-of-the-art solutions for vehicle re-id mostly focus on improving the accuracy on existing re-id benchmarks and often ignore computational complexity. We propose a simple yet effective hybrid solution empowered by self-supervised training which only uses a single network during inference time.
  arXiv  Detail & Related papers  (2022-05-16T12:14:42Z)
• A Reinforcement Learning Approach for Electric Vehicle Routing Problem with Vehicle-to-Grid Supply [2.6066825041242367]
  We present QuikRouteFinder that uses reinforcement learning (RL) for EV routing to overcome these challenges. Results from RL are compared against exact formulations based on mixed-integer linear program (MILP) and genetic algorithm (GA) metaheuristics.
  arXiv  Detail & Related papers  (2022-04-12T06:13:06Z)
• Value Function is All You Need: A Unified Learning Framework for Ride Hailing Platforms [57.21078336887961]
  Large ride-hailing platforms, such as DiDi, Uber and Lyft, connect tens of thousands of vehicles in a city to millions of ride demands throughout the day. We propose a unified value-based dynamic learning framework (V1D3) for tackling both tasks.
  arXiv  Detail & Related papers  (2021-05-18T19:22:24Z)
• Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning [42.31586065609373]
  Electric Vehicle (EV) has become a choice in the modern transportation system due to its environmental and energy sustainability. In many cities, EV drivers often fail to find the proper spots for charging, because of the limited charging infrastructures and the largely unbalanced charging demands. We propose a framework, named Multi-Agent Spatiotemporal-temporal ment Learning (MasterReinforce), for intelligently recommending public charging stations.
  arXiv  Detail & Related papers  (2021-02-15T06:23:59Z)
• Real-time and Large-scale Fleet Allocation of Autonomous Taxis: A Case Study in New York Manhattan Island [14.501650948647324]
  Traditional models fail to efficiently allocate the available fleet to deal with the imbalance of supply (autonomous taxis) and demand (trips) We employ a Constrained Multi-agent Markov Decision Processes (CMMDP) to model fleet allocation decisions. We also leverage a Column Generation algorithm to guarantee the efficiency and optimality in a large scale.
  arXiv  Detail & Related papers  (2020-09-06T16:00:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.