Adaptive Frequency Green Light Optimal Speed Advisory based on Hybrid Actor-Critic Reinforcement Learning

• URL: http://arxiv.org/abs/2306.04660v2
• Date: Mon, 12 Jun 2023 08:44:55 GMT
• Title: Adaptive Frequency Green Light Optimal Speed Advisory based on Hybrid Actor-Critic Reinforcement Learning
• Authors: Ming Xu, Dongyu Zuo
• Abstract summary: GLOSA system suggests speeds to vehicles to assist them in passing through intersections during green intervals. Previous research has focused on optimizing the GLOSA algorithm, neglecting the frequency of speed advisory. We propose an Adaptive Frequency GLOSA model based on Hybrid Proximal Policy Optimization (H-PPO) method.
• Score: 2.257737378757467
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Green Light Optimal Speed Advisory (GLOSA) system suggests speeds to vehicles to assist them in passing through intersections during green intervals, thus reducing traffic congestion and fuel consumption by minimizing the number of stops and idle times at intersections. However, previous research has focused on optimizing the GLOSA algorithm, neglecting the frequency of speed advisory by the GLOSA system. Specifically, some studies provide speed advisory profile at each decision step, resulting in redundant advisory, while others calculate the optimal speed for the vehicle only once, which cannot adapt to dynamic traffic. In this paper, we propose an Adaptive Frequency GLOSA (AF-GLOSA) model based on Hybrid Proximal Policy Optimization (H-PPO) method, which employs an actor-critic architecture with a hybrid actor network. The hybrid actor network consists of a discrete actor that outputs control gap and a continuous actor that outputs acceleration profiles. Additionally, we design a novel reward function that considers both travel efficiency and fuel consumption. The AF-GLOSA model is evaluated in comparison to traditional GLOSA and learning-based GLOSA methods in a three-lane intersection with a traffic signal in SUMO. The results demonstrate that the AF-GLOSA model performs best in reducing average stop times, fuel consumption and CO2 emissions.

Related papers

• Traffic signal optimization in large-scale urban road networks: an adaptive-predictive controller using Ising models [4.408586742026574]
  We propose a control method called AMPIC that guarantees both scalability and optimality. The proposed method employs model predictive control to solve an optimal control problem at each control interval with explicit consideration of a predictive model of vehicle flow. Results show that AMPIC enables faster vehicle cruising speed with less waiting time than that achieved by classical control methods.
  arXiv  Detail & Related papers  (2024-06-06T02:20:34Z)
• Queue-based Eco-Driving at Roundabouts with Reinforcement Learning [0.0]
  We address eco-driving at roundabouts in mixed traffic to enhance traffic flow and traffic efficiency. We develop two approaches: a rule-based and an Reinforcement Learning based eco-driving system. Results show that both approaches outperform the baseline.
  arXiv  Detail & Related papers  (2024-05-01T16:48:28Z)
• DenseLight: Efficient Control for Large-scale Traffic Signals with Dense Feedback [109.84667902348498]
  Traffic Signal Control (TSC) aims to reduce the average travel time of vehicles in a road network. Most prior TSC methods leverage deep reinforcement learning to search for a control policy. We propose DenseLight, a novel RL-based TSC method that employs an unbiased reward function to provide dense feedback on policy effectiveness.
  arXiv  Detail & Related papers  (2023-06-13T05:58:57Z)
• Teal: Learning-Accelerated Optimization of WAN Traffic Engineering [68.7863363109948]
  We present Teal, a learning-based TE algorithm that leverages the parallel processing power of GPUs to accelerate TE control. To reduce the problem scale and make learning tractable, Teal employs a multi-agent reinforcement learning (RL) algorithm to independently allocate each traffic demand. Compared with other TE acceleration schemes, Teal satisfies 6--32% more traffic demand and yields 197--625x speedups.
  arXiv  Detail & Related papers  (2022-10-25T04:46:30Z)
• Correlating sparse sensing for large-scale traffic speed estimation: A Laplacian-enhanced low-rank tensor kriging approach [76.45949280328838]
  We propose a Laplacian enhanced low-rank tensor (LETC) framework featuring both lowrankness and multi-temporal correlations for large-scale traffic speed kriging. We then design an efficient solution algorithm via several effective numeric techniques to scale up the proposed model to network-wide kriging.
  arXiv  Detail & Related papers  (2022-10-21T07:25:57Z)
• Motion Planning and Control for Multi Vehicle Autonomous Racing at High Speeds [100.61456258283245]
  This paper presents a multi-layer motion planning and control architecture for autonomous racing. The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s2$.
  arXiv  Detail & Related papers  (2022-07-22T15:16:54Z)
• Cooperative Reinforcement Learning on Traffic Signal Control [3.759936323189418]
  Traffic signal control is a challenging real-world problem aiming to minimize overall travel time by coordinating vehicle movements at road intersections. Existing traffic signal control systems in use still rely heavily on oversimplified information and rule-based methods. This paper proposes a cooperative, multi-objective architecture with age-decaying weights to better estimate multiple reward terms for traffic signal control optimization.
  arXiv  Detail & Related papers  (2022-05-23T13:25:15Z)
• Safe Model-based Off-policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles [3.5259944260228977]
  This work proposes a Safe Off-policy Model-Based Reinforcement Learning algorithm for the eco-driving problem. The proposed algorithm leads to a policy with a higher average speed and a better fuel economy compared to the model-free agent.
  arXiv  Detail & Related papers  (2021-05-25T03:41:29Z)
• Data-Driven Intersection Management Solutions for Mixed Traffic of Human-Driven and Connected and Automated Vehicles [0.0]
  This dissertation proposes two solutions for urban traffic control in the presence of connected and automated vehicles. First, a centralized platoon-based controller is proposed for the cooperative intersection management problem. Second, a data-driven approach is proposed for adaptive signal control in the presence of connected vehicles.
  arXiv  Detail & Related papers  (2020-12-10T01:44:45Z)
• Mobile Cellular-Connected UAVs: Reinforcement Learning for Sky Limits [71.28712804110974]
  We propose a general novel multi-armed bandit (MAB) algorithm to reduce disconnectivity time, handover rate, and energy consumption of UAV. We show how each of these performance indicators (PIs) is improved by adopting a proper range of corresponding learning parameter.
  arXiv  Detail & Related papers  (2020-09-21T12:35:23Z)
• Reinforcement Learning Based Vehicle-cell Association Algorithm for Highly Mobile Millimeter Wave Communication [53.47785498477648]
  This paper investigates the problem of vehicle-cell association in millimeter wave (mmWave) communication networks. We first formulate the user state (VU) problem as a discrete non-vehicle association optimization problem. The proposed solution achieves up to 15% gains in terms sum of user complexity and 20% reduction in VUE compared to several baseline designs.
  arXiv  Detail & Related papers  (2020-01-22T08:51:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.