A Reinforcement Learning-based Adaptive Control Model for Future Street Planning, An Algorithm and A Case Study

• URL: http://arxiv.org/abs/2112.05434v1
• Date: Fri, 10 Dec 2021 10:32:46 GMT
• Title: A Reinforcement Learning-based Adaptive Control Model for Future Street Planning, An Algorithm and A Case Study
• Authors: Qiming Ye, Yuxiang Feng, Jing Han, Marc Stettler, Panagiotis Angeloudis
• Abstract summary: An intelligent street can learn and improve its decision-making on the right-of-way (ROW) for road users. We develop a solution based on the multi-agent Deep Deterministic Policy Gradient (MADDPG) algorithm. Our model can achieve an average reduction of 3.87% and 6.26% in street space assigned for on-street parking and vehicular operations.
• Score: 3.5368898558786768
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: With the emerging technologies in Intelligent Transportation System (ITS), the adaptive operation of road space is likely to be realised within decades. An intelligent street can learn and improve its decision-making on the right-of-way (ROW) for road users, liberating more active pedestrian space while maintaining traffic safety and efficiency. However, there is a lack of effective controlling techniques for these adaptive street infrastructures. To fill this gap in existing studies, we formulate this control problem as a Markov Game and develop a solution based on the multi-agent Deep Deterministic Policy Gradient (MADDPG) algorithm. The proposed model can dynamically assign ROW for sidewalks, autonomous vehicles (AVs) driving lanes and on-street parking areas in real-time. Integrated with the SUMO traffic simulator, this model was evaluated using the road network of the South Kensington District against three cases of divergent traffic conditions: pedestrian flow rates, AVs traffic flow rates and parking demands. Results reveal that our model can achieve an average reduction of 3.87% and 6.26% in street space assigned for on-street parking and vehicular operations. Combined with space gained by limiting the number of driving lanes, the average proportion of sidewalks to total widths of streets can significantly increase by 10.13%.

Related papers

• DenseLight: Efficient Control for Large-scale Traffic Signals with Dense Feedback [109.84667902348498]
  Traffic Signal Control (TSC) aims to reduce the average travel time of vehicles in a road network. Most prior TSC methods leverage deep reinforcement learning to search for a control policy. We propose DenseLight, a novel RL-based TSC method that employs an unbiased reward function to provide dense feedback on policy effectiveness.
  arXiv  Detail & Related papers  (2023-06-13T05:58:57Z)
• iPLAN: Intent-Aware Planning in Heterogeneous Traffic via Distributed Multi-Agent Reinforcement Learning [57.24340061741223]
  We introduce a distributed multi-agent reinforcement learning (MARL) algorithm that can predict trajectories and intents in dense and heterogeneous traffic scenarios. Our approach for intent-aware planning, iPLAN, allows agents to infer nearby drivers' intents solely from their local observations.
  arXiv  Detail & Related papers  (2023-06-09T20:12:02Z)
• Deep Reinforcement Learning to Maximize Arterial Usage during Extreme Congestion [4.934817254755007]
  We propose a Deep Reinforcement Learning (DRL) approach to reduce traffic congestion on multi-lane freeways during extreme congestion. Agent is trained to learn adaptive detouring strategies for congested freeway traffic. Agent can improve average traffic speed by 21% when compared to no-action during steep congestion.
  arXiv  Detail & Related papers  (2023-05-16T16:53:27Z)
• Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning [2.362412515574206]
  This study explores Reinforcement Learning (RL) methods for evolving ROW compositions. We implement a centralised paradigm and a distributive learning paradigm to separately perform the dynamic control on several road network configurations. Experimental results indicate that the algorithms have the potential to improve traffic flow efficiency and allocate more space for pedestrians.
  arXiv  Detail & Related papers  (2023-03-22T03:42:39Z)
• Reinforcement Learning based Cyberattack Model for Adaptive Traffic Signal Controller in Connected Transportation Systems [61.39400591328625]
  In a connected transportation system, adaptive traffic signal controllers (ATSC) utilize real-time vehicle trajectory data received from vehicles to regulate green time. This wirelessly connected ATSC increases cyber-attack surfaces and increases their vulnerability to various cyber-attack modes. One such mode is a'sybil' attack in which an attacker creates fake vehicles in the network. An RL agent is trained to learn an optimal rate of sybil vehicle injection to create congestion for an approach(s)
  arXiv  Detail & Related papers  (2022-10-31T20:12:17Z)
• Learning energy-efficient driving behaviors by imitating experts [75.12960180185105]
  This paper examines the role of imitation learning in bridging the gap between control strategies and realistic limitations in communication and sensing. We show that imitation learning can succeed in deriving policies that, if adopted by 5% of vehicles, may boost the energy-efficiency of networks with varying traffic conditions by 15% using only local observations.
  arXiv  Detail & Related papers  (2022-06-28T17:08:31Z)
• Traffic Management of Autonomous Vehicles using Policy Based Deep Reinforcement Learning and Intelligent Routing [0.26249027950824505]
  We propose a DRL-based signal control system that adjusts traffic signals according to the current congestion situation on intersections. To deal with the congestion on roads behind the intersection, we used re-routing technique to load balance the vehicles on road networks.
  arXiv  Detail & Related papers  (2022-06-28T02:46:20Z)
• Road Network Guided Fine-Grained Urban Traffic Flow Inference [108.64631590347352]
  Accurate inference of fine-grained traffic flow from coarse-grained one is an emerging yet crucial problem. We propose a novel Road-Aware Traffic Flow Magnifier (RATFM) that exploits the prior knowledge of road networks. Our method can generate high-quality fine-grained traffic flow maps.
  arXiv  Detail & Related papers  (2021-09-29T07:51:49Z)
• Emergent Road Rules In Multi-Agent Driving Environments [84.82583370858391]
  We analyze what ingredients in driving environments cause the emergence of road rules. We find that two crucial factors are noisy perception and agents' spatial density. Our results add empirical support for the social road rules that countries worldwide have agreed on for safe, efficient driving.
  arXiv  Detail & Related papers  (2020-11-21T09:43:50Z)
• Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning [6.298084785377199]
  A deep reinforcement learning (DRL)-enabled decision-making policy is constructed for autonomous vehicles to address the overtaking behaviors on the highway. A hierarchical control framework is presented to control these vehicles, which indicates the upper-level manages the driving decisions. The DDQN-based overtaking policy could accomplish highway driving tasks efficiently and safely.
  arXiv  Detail & Related papers  (2020-07-16T23:41:48Z)
• Where can I drive? A System Approach: Deep Ego Corridor Estimation for Robust Automated Driving [2.378161932344701]
  We propose to classify specifically a drivable corridor of the ego lane on pixel level with a deep learning approach. Our approach is kept computationally efficient with only 0.66 million parameters allowing its application in large scale products.
  arXiv  Detail & Related papers  (2020-04-16T13:04:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.