Deep Reinforcement Learning for Electric Vehicle Routing Problem with Time Windows

• URL: http://arxiv.org/abs/2010.02068v4
• Date: Fri, 13 Aug 2021 20:07:07 GMT
• Title: Deep Reinforcement Learning for Electric Vehicle Routing Problem with Time Windows
• Authors: Bo Lin, Bissan Ghaddar, Jatin Nathwani
• Abstract summary: We propose an end-to-end deep reinforcement learning framework to solve the EVRPTW. In particular, we develop an attention model incorporating the pointer network and a graph embedding technique to parameterize a policy for solving the EVRPTW. Our numerical studies show that the proposed model is able to efficiently solve EVRPTW instances of large sizes that are not solvable with any existing approaches.
• Score: 2.1399409016552347
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The past decade has seen a rapid penetration of electric vehicles (EV) in the market, more and more logistics and transportation companies start to deploy EVs for service provision. In order to model the operations of a commercial EV fleet, we utilize the EV routing problem with time windows (EVRPTW). In this research, we propose an end-to-end deep reinforcement learning framework to solve the EVRPTW. In particular, we develop an attention model incorporating the pointer network and a graph embedding technique to parameterize a stochastic policy for solving the EVRPTW. The model is then trained using policy gradient with rollout baseline. Our numerical studies show that the proposed model is able to efficiently solve EVRPTW instances of large sizes that are not solvable with any existing approaches.

Related papers

• Efficient Training of Large Vision Models via Advanced Automated Progressive Learning [96.71646528053651]
  We present an advanced automated progressive learning (AutoProg) framework for efficient training of Large Vision Models (LVMs) We introduce AutoProg-Zero, by enhancing the AutoProg framework with a novel zero-shot unfreezing schedule search. Experiments show that AutoProg accelerates ViT pre-training by up to 1.85x on ImageNet and accelerates fine-tuning of diffusion models by up to 2.86x, with comparable or even higher performance.
  arXiv  Detail & Related papers  (2024-09-06T16:24:24Z)
• Edge-DIRECT: A Deep Reinforcement Learning-based Method for Solving Heterogeneous Electric Vehicle Routing Problem with Time Window Constraints [4.852613028421959]
  This article studies the heterogeneous electric vehicle routing problem with time-window constraints (HEVRPTW) We propose a DRL-based approach, named Edge-enhanced Dual attentIon encoderR and feature-EnhanCed dual aTtention decoder (Edge-DIRECT) Experimental results based on two real-world datasets reveal that Edge-DIRECT outperforms a state-of-the-art DRL-based method and a well-established approach in solution quality and execution time.
  arXiv  Detail & Related papers  (2024-06-28T03:18:12Z)
• MOTO: Offline Pre-training to Online Fine-tuning for Model-based Robot Learning [52.101643259906915]
  We study the problem of offline pre-training and online fine-tuning for reinforcement learning from high-dimensional observations. Existing model-based offline RL methods are not suitable for offline-to-online fine-tuning in high-dimensional domains. We propose an on-policy model-based method that can efficiently reuse prior data through model-based value expansion and policy regularization.
  arXiv  Detail & Related papers  (2024-01-06T21:04:31Z)
• A Deep Q-Learning based Smart Scheduling of EVs for Demand Response in Smart Grids [0.0]
  We propose a model-free solution, leveraging Deep Q-Learning to schedule the charging and discharging activities of EVs within a microgrid. We adapted the Bellman Equation to assess the value of a state based on specific rewards for EV scheduling actions and used a neural network to estimate Q-values for available actions and the epsilon-greedy algorithm to balance exploitation and exploration to meet the target energy profile.
  arXiv  Detail & Related papers  (2024-01-05T06:04:46Z)
• Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks [42.04263644600909]
  Multi-agent deep reinforcement learning (MADRL) has proven its effectiveness in EV charging control. Existing MADRL-based approaches fail to consider the natural power flow of EV charging/discharging in the distribution network. This paper proposes a novel approach that combines multi-EV charging/discharging with a radial distribution network (RDN) operating under optimal power flow.
  arXiv  Detail & Related papers  (2023-08-17T05:34:46Z)
• COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles [54.61668577827041]
  We introduce COOPERNAUT, an end-to-end learning model that uses cross-vehicle perception for vision-based cooperative driving. Our experiments on AutoCastSim suggest that our cooperative perception driving models lead to a 40% improvement in average success rate.
  arXiv  Detail & Related papers  (2022-05-04T17:55:12Z)
• A Reinforcement Learning Approach for Electric Vehicle Routing Problem with Vehicle-to-Grid Supply [2.6066825041242367]
  We present QuikRouteFinder that uses reinforcement learning (RL) for EV routing to overcome these challenges. Results from RL are compared against exact formulations based on mixed-integer linear program (MILP) and genetic algorithm (GA) metaheuristics.
  arXiv  Detail & Related papers  (2022-04-12T06:13:06Z)
• An Energy Consumption Model for Electrical Vehicle Networks via Extended Federated-learning [50.85048976506701]
  This paper proposes a novel solution to range anxiety based on a federated-learning model. It is capable of estimating battery consumption and providing energy-efficient route planning for vehicle networks.
  arXiv  Detail & Related papers  (2021-11-13T15:03:44Z)
• Real-world Ride-hailing Vehicle Repositioning using Deep Reinforcement Learning [52.2663102239029]
  We present a new practical framework based on deep reinforcement learning and decision-time planning for real-world vehicle on idle-hailing platforms. Our approach learns ride-based state-value function using a batch training algorithm with deep value. We benchmark our algorithm with baselines in a ride-hailing simulation environment to demonstrate its superiority in improving income efficiency.
  arXiv  Detail & Related papers  (2021-03-08T05:34:05Z)
• A Reinforcement Learning Approach for Rebalancing Electric Vehicle Sharing Systems [3.0553868534759725]
  This paper proposes a reinforcement learning approach for nightly offline rebalancing operations in freefloating electric vehicle sharing systems (FFEVSS) Due to sparse demand in a network, FFEVSS require relocation of electrical vehicles (EVs) to charging stations and demander nodes, which is typically done by a group of drivers. We consider a reinforcement learning framework for the problem, in which a central controller determines the routing policies of a fleet of multiple shuttles.
  arXiv  Detail & Related papers  (2020-10-05T22:24:36Z)
• Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach [88.45509934702913]
  We design a navigation policy for multiple unmanned aerial vehicles (UAVs) where mobile base stations (BSs) are deployed. We incorporate different contextual information such as energy and age of information (AoI) constraints to ensure the data freshness at the ground BS. By applying the proposed trained model, an effective real-time trajectory policy for the UAV-BSs captures the observable network states over time.
  arXiv  Detail & Related papers  (2020-02-21T07:29:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.