Reinforcement Learning-Based Control of CAV Platoon Joining Maneuvers in Mixed Traffic

• URL: http://arxiv.org/abs/2608.26860v1
• Date: Thu, 27 Aug 2026 09:27:11 GMT
• Title: Reinforcement Learning-Based Control of CAV Platoon Joining Maneuvers in Mixed Traffic
• Abstract summary: Connected and automated vehicle (CAV) platooning offers a promising approach to improving road safety and traffic capacity.<n>Reinforcement learning has strong potential for addressing control problems, but its practical deployment raises challenges related to safety and learning efficiency.<n>This paper proposes a generic modeling and simulation framework for investigating CAV platoon joining maneuvers.
• Score: 2.455444813386932
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Connected and automated vehicle (CAV) platooning offers a promising approach to improving road safety and traffic capacity. However, platoon control in real-world traffic is challenging due to uncertainty and heterogeneous driving behaviors. Reinforcement learning (RL) has strong potential for addressing such control problems, but its practical deployment raises challenges related to safety and learning efficiency. This paper proposes a generic modeling and simulation framework for investigating CAV platoon joining maneuvers and comparing deep reinforcement learning (DRL)-based control algorithms. The problem is particularly challenging in mixed-traffic environments, where CAVs coexist with human-driven vehicles exhibiting heterogeneous longitudinal and lateral behaviors. The objective is to achieve safe and efficient joining maneuvers by either incorporating penalties for risky behaviors into the learning process or using an external safety controller to constrain the learned policy. An agent-based modeling framework coupled with the Simulation of Urban MObility (SUMO) simulator is used to evaluate Deep Q-Network (DQN), Double Deep Q-Network (DDQN), and Proximal Policy Optimization (PPO). Results show that PPO outperforms DQN and DDQN, achieving a joining success rate of approximately 98 % and a collision rate below 1 %, largely due to risk-related penalties incorporated into the reward function. However, this improved performance requires more decision steps to complete the maneuver, revealing a trade-off between safety, joining effectiveness, and decision efficiency. An external safety controller effectively prevents collisions, although its interventions may reduce joining efficiency. The results highlight the importance of jointly considering safety and efficiency when designing RL-based controllers for CAV platoon joining in mixed traffic.

Related papers

• Safe Reinforcement Learning of Autonomous Highway Driving: A Unified Framework for Safety and Efficiency [2.6655248034321724]
  We propose a unified safe reinforcement learning (SRL) framework that integrates safe distance, reward machines (RM), and mixture-of-experts (MoE)<n>Experiments in two-lane traffic show that MoE-RM-SRL substantially improves safety and efficiency over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-06-12T16:32:22Z)
• Autonomous Vehicle Collision Avoidance With Racing Parameterized Deep Reinforcement Learning [73.88859384645264]
  Road traffic accidents are a leading cause of fatalities worldwide.<n>In the US, human error causes 94% of crashes, resulting in over 7,000 pedestrian fatalities and $500 billion in costs annually.<n>This paper parameterizes a Deep Reinforcement Learning (DRL) collision avoidance policy out-of-Distribution.<n>Two policies are evaluated, a default uni-direction and a reversed heading variant that navigates in the opposite direction to other cars.
  arXiv  Detail & Related papers  (2026-04-17T21:11:39Z)
• Deep reinforcement learning-based longitudinal control strategy for automated vehicles at signalised intersections [2.9398787168955116]
  This study proposes a Deep Reinforcement Learning based longitudinal vehicle control strategy at signalised intersections.<n>A comprehensive reward function has been formulated with a particular focus on distance headway-based efficiency reward.<n>Two popular DRL algorithms, Deep Deterministic Policy Gradient (DDPG) and Soft-Actor Critic (SAC) have been incorporated.
  arXiv  Detail & Related papers  (2025-05-13T18:38:42Z)
• Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework [87.7482313774741]
  Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory.<n>This paper proposes CoDrivingLLM, an interactive and learnable LLM-driven cooperative driving framework.
  arXiv  Detail & Related papers  (2024-09-19T14:36:00Z)
• A Conflicts-free, Speed-lossless KAN-based Reinforcement Learning Decision System for Interactive Driving in Roundabouts [16.714573474722282]
  This paper presents a learning-based algorithm that promotes safe and efficient driving across varying roundabout traffic conditions.<n>A deep Q-learning network is used to learn optimal strategies, while a Kolmogorov-Arnold Network (KAN) improves the AVs' environmental understanding.<n> Experimental results demonstrate that the proposed system consistently outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-08-15T16:10:25Z)
• Communication-Aware Reinforcement Learning for Cooperative Adaptive Cruise Control [15.31488551912888]
  Reinforcement Learning (RL) has proven effective in optimizing complex decision-making processes in CACC. MARL has shown remarkable potential by enabling coordinated actions among multiple CAVs. We propose Communication-Aware Reinforcement Learning (CA-RL) to address these challenges.
  arXiv  Detail & Related papers  (2024-07-12T03:28:24Z)
• CIMRL: Combining IMitation and Reinforcement Learning for Safe Autonomous Driving [45.05135725542318]
  IMitation and Reinforcement Learning (CIMRL) approach enables training driving policies in simulation through leveraging imitative motion priors and safety constraints. By combining RL and imitation, we demonstrate our method achieves state-of-the-art results in closed loop simulation and real world driving benchmarks.
  arXiv  Detail & Related papers  (2024-06-13T07:31:29Z)
• CAT: Closed-loop Adversarial Training for Safe End-to-End Driving [54.60865656161679]
  Adversarial Training (CAT) is a framework for safe end-to-end driving in autonomous vehicles. Cat aims to continuously improve the safety of driving agents by training the agent on safety-critical scenarios. Cat can effectively generate adversarial scenarios countering the agent being trained.
  arXiv  Detail & Related papers  (2023-10-19T02:49:31Z)
• Runtime Stealthy Perception Attacks against DNN-based Adaptive Cruise Control Systems [8.561553195784017]
  This paper evaluates the security of the deep neural network based ACC systems under runtime perception attacks.<n>We present a context-aware strategy for the selection of the most critical times for triggering the attacks.<n>We evaluate the effectiveness of the proposed attack using an actual vehicle, a publicly available driving dataset, and a realistic simulation platform.
  arXiv  Detail & Related papers  (2023-07-18T03:12:03Z)
• Convergence of Communications, Control, and Machine Learning for Secure and Autonomous Vehicle Navigation [78.60496411542549]
  Connected and autonomous vehicles (CAVs) can reduce human errors in traffic accidents, increase road efficiency, and execute various tasks. Reaping these benefits requires CAVs to autonomously navigate to target destinations. This article proposes solutions using the convergence of communication theory, control theory, and machine learning to enable effective and secure CAV navigation.
  arXiv  Detail & Related papers  (2023-07-05T21:38:36Z)
• Safety Correction from Baseline: Towards the Risk-aware Policy in Robotics via Dual-agent Reinforcement Learning [64.11013095004786]
  We propose a dual-agent safe reinforcement learning strategy consisting of a baseline and a safe agent. Such a decoupled framework enables high flexibility, data efficiency and risk-awareness for RL-based control. The proposed method outperforms the state-of-the-art safe RL algorithms on difficult robot locomotion and manipulation tasks.
  arXiv  Detail & Related papers  (2022-12-14T03:11:25Z)
• Evaluating Model-free Reinforcement Learning toward Safety-critical Tasks [70.76757529955577]
  This paper revisits prior work in this scope from the perspective of state-wise safe RL. We propose Unrolling Safety Layer (USL), a joint method that combines safety optimization and safety projection. To facilitate further research in this area, we reproduce related algorithms in a unified pipeline and incorporate them into SafeRL-Kit.
  arXiv  Detail & Related papers  (2022-12-12T06:30:17Z)
• Leveraging the Capabilities of Connected and Autonomous Vehicles and Multi-Agent Reinforcement Learning to Mitigate Highway Bottleneck Congestion [2.0010674945048468]
  We present an RL-based multi-agent CAV control model to operate in mixed traffic. The results suggest that even at CAV percent share of corridor traffic as low as 10%, CAVs can significantly mitigate bottlenecks in highway traffic.
  arXiv  Detail & Related papers  (2020-10-12T03:52:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.