CVLight: Deep Reinforcement Learning for Adaptive Traffic Signal Control with Connected Vehicles

• URL: http://arxiv.org/abs/2104.10340v1
• Date: Wed, 21 Apr 2021 03:38:11 GMT
• Title: CVLight: Deep Reinforcement Learning for Adaptive Traffic Signal Control with Connected Vehicles
• Authors: Wangzhi Li, Yaxing Cai, Ujwal Dinesha, Yongjie Fu, Xuan Di
• Abstract summary: "CVLight" is a reinforcement learning scheme for adaptive traffic signal control. It uses data collected only from connected vehicles (CV) It can efficiently control multiple intersections based on CV data and can achieve a similar or even greater performance when the CV penetration rate is no less than 20%.
• Score: 0.9449650062296824
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper develops a reinforcement learning (RL) scheme for adaptive traffic signal control (ATSC), called "CVLight", that leverages data collected only from connected vehicles (CV). Seven types of RL models are proposed within this scheme that contain various state and reward representations, including incorporation of CV delay and green light duration into state and the usage of CV delay as reward. To further incorporate information of both CV and non-CV into CVLight, an algorithm based on actor-critic, A2C-Full, is proposed where both CV and non-CV information is used to train the critic network, while only CV information is used to update the policy network and execute optimal signal timing. These models are compared at an isolated intersection under various CV market penetration rates. A full model with the best performance (i.e., minimum average travel delay per vehicle) is then selected and applied to compare with state-of-the-art benchmarks under different levels of traffic demands, turning proportions, and dynamic traffic demands, respectively. Two case studies are performed on an isolated intersection and a corridor with three consecutive intersections located in Manhattan, New York, to further demonstrate the effectiveness of the proposed algorithm under real-world scenarios. Compared to other baseline models that use all vehicle information, the trained CVLight agent can efficiently control multiple intersections solely based on CV data and can achieve a similar or even greater performance when the CV penetration rate is no less than 20%.

Related papers

• CVVLSNet: Vehicle Location and Speed Estimation Using Partial Connected Vehicle Trajectory Data [6.928899738499268]
  Real-time estimation of vehicle locations and speeds is crucial for developing beneficial transportation applications. Recent advances in communication technologies facilitate the emergence of connected vehicles (CVs) This paper proposes a novel CV-based Vehicle Location and Speed estimation network, CVVLSNet.
  arXiv  Detail & Related papers  (2024-09-30T18:13:26Z)
• Queue-based Eco-Driving at Roundabouts with Reinforcement Learning [0.0]
  We address eco-driving at roundabouts in mixed traffic to enhance traffic flow and traffic efficiency. We develop two approaches: a rule-based and an Reinforcement Learning based eco-driving system. Results show that both approaches outperform the baseline.
  arXiv  Detail & Related papers  (2024-05-01T16:48:28Z)
• Resource Constrained Vehicular Edge Federated Learning with Highly Mobile Connected Vehicles [41.02566275644629]
  We propose a vehicular edge federated learning (VEFL) solution, where an edge server leverages highly mobile connected vehicles' (CVs') onboard central processing units ( CPUs) and local datasets to train a global model. We devise joint VEFL and radio access technology (RAT) parameters optimization problems under delay, energy and cost constraints to maximize the probability of successful reception of the locally trained models.
  arXiv  Detail & Related papers  (2022-10-27T14:33:06Z)
• Correlating sparse sensing for large-scale traffic speed estimation: A Laplacian-enhanced low-rank tensor kriging approach [76.45949280328838]
  We propose a Laplacian enhanced low-rank tensor (LETC) framework featuring both lowrankness and multi-temporal correlations for large-scale traffic speed kriging. We then design an efficient solution algorithm via several effective numeric techniques to scale up the proposed model to network-wide kriging.
  arXiv  Detail & Related papers  (2022-10-21T07:25:57Z)
• A Deep Value-network Based Approach for Multi-Driver Order Dispatching [55.36656442934531]
  We propose a deep reinforcement learning based solution for order dispatching. We conduct large scale online A/B tests on DiDi's ride-dispatching platform. Results show that CVNet consistently outperforms other recently proposed dispatching methods.
  arXiv  Detail & Related papers  (2021-06-08T16:27:04Z)
• Value Function is All You Need: A Unified Learning Framework for Ride Hailing Platforms [57.21078336887961]
  Large ride-hailing platforms, such as DiDi, Uber and Lyft, connect tens of thousands of vehicles in a city to millions of ride demands throughout the day. We propose a unified value-based dynamic learning framework (V1D3) for tackling both tasks.
  arXiv  Detail & Related papers  (2021-05-18T19:22:24Z)
• Prediction of Traffic Flow via Connected Vehicles [77.11902188162458]
  We propose a Short-term Traffic flow Prediction framework so that transportation authorities take early actions to control flow and prevent congestion. We anticipate flow at future time frames on a target road segment based on historical flow data and innovative features such as real time feeds and trajectory data provided by Connected Vehicles (CV) technology. We show how this novel approach allows advanced modelling by integrating into the forecasting of flow, the impact of various events that CV realistically encountered on segments along their trajectory.
  arXiv  Detail & Related papers  (2020-07-10T16:00:44Z)
• Approximate Cross-Validation for Structured Models [20.79997929155929]
  Gold standard evaluation technique is structured cross-validation (CV) But CV here can be prohibitively slow due to the need to re-run already-expensive learning algorithms many times. Previous work has shown approximate cross-validation (ACV) methods provide a fast and provably accurate alternative.
  arXiv  Detail & Related papers  (2020-06-23T00:06:03Z)
• Applying Deep-Learning-Based Computer Vision to Wireless Communications: Methodologies, Opportunities, and Challenges [100.45137961106069]
  Deep learning (DL) has seen great success in the computer vision (CV) field. This article introduces ideas about applying DL-based CV in wireless communications.
  arXiv  Detail & Related papers  (2020-06-10T11:37:49Z)
• Reinforcement Learning Based Vehicle-cell Association Algorithm for Highly Mobile Millimeter Wave Communication [53.47785498477648]
  This paper investigates the problem of vehicle-cell association in millimeter wave (mmWave) communication networks. We first formulate the user state (VU) problem as a discrete non-vehicle association optimization problem. The proposed solution achieves up to 15% gains in terms sum of user complexity and 20% reduction in VUE compared to several baseline designs.
  arXiv  Detail & Related papers  (2020-01-22T08:51:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.