V2I Connectivity-Based Dynamic Queue-Jump Lane for Emergency Vehicles: A Deep Reinforcement Learning Approach

• URL: http://arxiv.org/abs/2008.00335v2
• Date: Sat, 29 May 2021 17:53:17 GMT
• Title: V2I Connectivity-Based Dynamic Queue-Jump Lane for Emergency Vehicles: A Deep Reinforcement Learning Approach
• Authors: Haoran Su, Kejian Shi, Li Jin and Joseph Y.J. Chow
• Abstract summary: A main reason behind EMV service delay is the lack of communication and cooperation between vehicles blocking EMVs. We consider the establishment of dynamic queue jump lanes (DQJLs) based on real-time coordination of connected vehicles. We propose a deep neural network-based reinforcement learning algorithm that efficiently computes the optimal coordination instructions.
• Score: 3.39322931607753
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Emergency vehicle (EMV) service is a key function of cities and is exceedingly challenging due to urban traffic congestion. A main reason behind EMV service delay is the lack of communication and cooperation between vehicles blocking EMVs. In this paper, we study the improvement of EMV service under V2I connectivity. We consider the establishment of dynamic queue jump lanes (DQJLs) based on real-time coordination of connected vehicles. We develop a novel Markov decision process formulation for the DQJL problem, which explicitly accounts for the uncertainty of drivers' reaction to approaching EMVs. We propose a deep neural network-based reinforcement learning algorithm that efficiently computes the optimal coordination instructions. We also validate our approach on a micro-simulation testbed using Simulation of Urban Mobility (SUMO). Validation results show that with our proposed methodology, the centralized control system saves approximately 15\% EMV passing time than the benchmark system.

Related papers

• MOB-FL: Mobility-Aware Federated Learning for Intelligent Connected Vehicles [21.615151912285835]
  We consider a base station coordinating nearby ICVs to train a neural network in a collaborative yet distributed manner. Due to the mobility of vehicles, the connections between the base station and ICVs are short-lived. We propose an accelerated FL-ICV framework, by optimizing the duration of each training round and the number of local iterations.
  arXiv  Detail & Related papers  (2022-12-07T08:53:53Z)
• Reinforcement Learning for Joint V2I Network Selection and Autonomous Driving Policies [14.518558523319518]
  Vehicle-to-Infrastructure (V2I) communication is becoming critical for the enhanced reliability of autonomous vehicles (AVs) It is critical to simultaneously optimize the AVs' network selection and driving policies in order to minimize road collisions. We develop a reinforcement learning framework to characterize efficient network selection and autonomous driving policies.
  arXiv  Detail & Related papers  (2022-08-03T04:33:02Z)
• Learning energy-efficient driving behaviors by imitating experts [75.12960180185105]
  This paper examines the role of imitation learning in bridging the gap between control strategies and realistic limitations in communication and sensing. We show that imitation learning can succeed in deriving policies that, if adopted by 5% of vehicles, may boost the energy-efficiency of networks with varying traffic conditions by 15% using only local observations.
  arXiv  Detail & Related papers  (2022-06-28T17:08:31Z)
• EMVLight: a Multi-agent Reinforcement Learning Framework for an Emergency Vehicle Decentralized Routing and Traffic Signal Control System [4.622745478006317]
  Emergency vehicles (EMVs) play a crucial role in responding to time-critical calls such as medical emergencies and fire outbreaks in urban areas. Existing methods for EMV dispatch typically optimize routes based on historical traffic-flow data and design traffic signal pre-emption accordingly. We propose EMVLight, a decentralized reinforcement learning framework for joint dynamic EMV routing and traffic signal pre-emption.
  arXiv  Detail & Related papers  (2022-06-27T16:46:20Z)
• AI-aided Traffic Control Scheme for M2M Communications in the Internet of Vehicles [61.21359293642559]
  The dynamics of traffic and the heterogeneous requirements of different IoV applications are not considered in most existing studies. We consider a hybrid traffic control scheme and use proximal policy optimization (PPO) method to tackle it.
  arXiv  Detail & Related papers  (2022-03-05T10:54:05Z)
• An Energy Consumption Model for Electrical Vehicle Networks via Extended Federated-learning [50.85048976506701]
  This paper proposes a novel solution to range anxiety based on a federated-learning model. It is capable of estimating battery consumption and providing energy-efficient route planning for vehicle networks.
  arXiv  Detail & Related papers  (2021-11-13T15:03:44Z)
• A Decentralized Reinforcement Learning Framework for Efficient Passage of Emergency Vehicles [6.748225062396441]
  Emergency vehicles (EMVs) play a critical role in a city's response to time-critical events. The existing approaches to reduce EMV travel time employ route optimization and traffic signal pre-emption. We introduce EMVLight, a framework for simultaneous dynamic routing and traffic signal control.
  arXiv  Detail & Related papers  (2021-10-30T16:13:48Z)
• A Deep Value-network Based Approach for Multi-Driver Order Dispatching [55.36656442934531]
  We propose a deep reinforcement learning based solution for order dispatching. We conduct large scale online A/B tests on DiDi's ride-dispatching platform. Results show that CVNet consistently outperforms other recently proposed dispatching methods.
  arXiv  Detail & Related papers  (2021-06-08T16:27:04Z)
• Optimizing Mixed Autonomy Traffic Flow With Decentralized Autonomous Vehicles and Multi-Agent RL [63.52264764099532]
  We study the ability of autonomous vehicles to improve the throughput of a bottleneck using a fully decentralized control scheme in a mixed autonomy setting. We apply multi-agent reinforcement algorithms to this problem and demonstrate that significant improvements in bottleneck throughput, from 20% at a 5% penetration rate to 33% at a 40% penetration rate, can be achieved.
  arXiv  Detail & Related papers  (2020-10-30T22:06:05Z)
• Dynamic Queue-Jump Lane for Emergency Vehicles under Partially Connected Settings: A Multi-Agent Deep Reinforcement Learning Approach [3.39322931607753]
  Emergency vehicle (EMV) service is a key function of cities and is exceedingly challenging due to urban traffic congestion. In this paper, we study the improvement of EMV service under V2X connectivity. We consider the establishment of dynamic queue jump lanes (DQJLs) based on real-time coordination of connected vehicles in the presence of non-connected human-driven vehicles.
  arXiv  Detail & Related papers  (2020-03-02T16:59:21Z)
• Reinforcement Learning Based Vehicle-cell Association Algorithm for Highly Mobile Millimeter Wave Communication [53.47785498477648]
  This paper investigates the problem of vehicle-cell association in millimeter wave (mmWave) communication networks. We first formulate the user state (VU) problem as a discrete non-vehicle association optimization problem. The proposed solution achieves up to 15% gains in terms sum of user complexity and 20% reduction in VUE compared to several baseline designs.
  arXiv  Detail & Related papers  (2020-01-22T08:51:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.