Autonomous Vehicle Collision Avoidance With Racing Parameterized Deep Reinforcement Learning
- URL: http://arxiv.org/abs/2604.16702v1
- Date: Fri, 17 Apr 2026 21:11:39 GMT
- Title: Autonomous Vehicle Collision Avoidance With Racing Parameterized Deep Reinforcement Learning
- Abstract summary: Road traffic accidents are a leading cause of fatalities worldwide.<n>In the US, human error causes 94% of crashes, resulting in over 7,000 pedestrian fatalities and $500 billion in costs annually.<n>This paper parameterizes a Deep Reinforcement Learning (DRL) collision avoidance policy out-of-Distribution.<n>Two policies are evaluated, a default uni-direction and a reversed heading variant that navigates in the opposite direction to other cars.
- Score: 73.88859384645264
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Road traffic accidents are a leading cause of fatalities worldwide. In the US, human error causes 94% of crashes, resulting in excess of 7,000 pedestrian fatalities and $500 billion in costs annually. Autonomous Vehicles (AVs) with emergency collision avoidance systems that operate at the limits of vehicle dynamics at a high frequency, a dual constraint of nonlinear kinodynamic accuracy and computational efficiency, further enhance safety benefits during adverse weather and cybersecurity breaches, and to evade dangerous human driving when AVs and human drivers share roads. This paper parameterizes a Deep Reinforcement Learning (DRL) collision avoidance policy Out-Of-Distribution (OOD) utilizing race car overtaking, without explicit geometric mimicry reference trajectory guidance, in simulation, with a physics-informed, simulator exploit-aware reward to encode nonlinear vehicle kinodynamics. Two policies are evaluated, a default uni-direction and a reversed heading variant that navigates in the opposite direction to other cars, which both consistently outperform a Model Predictive Control and Artificial Potential Function (MPC-APF) baseline, with zero-shot transfer to proportionally scaled hardware, across three intersection collision scenarios, at 31x fewer Floating Point Operations (FLOPS) and 64x lower inference latency. The reversed heading policy outperforms the default racing overtaking policy in head-to-head collisions by 30% and the baseline by 50%, and matches the former in side collisions, where both DRL policies evade 10% greater than numerical optimal control.
Related papers
- World Engine: Towards the Era of Post-Training for Autonomous Driving [63.61277741443647]
We introduce World Engine, a generative framework that reconstructs high-fidelity interactive environments from real-world logs.<n>World Engine substantially reduces failures in rare safety-critical scenarios and yields significantly larger gains than scaling pre-training data alone.<n>When deployed on a production-scale autonomous driving system, the resulting policy reduces simulated collisions.
arXiv Detail & Related papers (2026-06-18T06:28:33Z) - Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing [73.88859384645264]
Out-Of-Distribution (OOD) generalization to various racetracks utilizes Machine Learning (ML) to encode the mathematical relation between sensor data and vehicle actuation for end-to-end control.<n>This paper presents a DRL method that parameterizes nonlinear vehicle dynamics from the spectral distribution of depth measurements with a non-geometric, physics-informed reward, to infer vehicle time-optimal and overtaking racing controls with an Artificial Neural Network (ANN)<n>The policy outperforms human demonstrations by 12% in OOD tracks on proportionally scaled hardware, by maximizing the friction circle with tire dynamics that resemble an empirical Pacejka tire model.
arXiv Detail & Related papers (2026-04-10T17:12:07Z) - Heterogeneous Self-Play for Realistic Highway Traffic Simulation [42.67401323169807]
PHASE, Policy for Heterogeneous Agent Self-play on Expressway, is a context-aware self-play framework.<n>It supports different vehicle profiles, for example, passenger cars and articulated trailer trucks, within a single policy.<n>It achieves a 96.3% success rate and reduces ADE/FDE from 6.57/12.07 m to 2.44/5.25 m relative to a prior self-play baseline.
arXiv Detail & Related papers (2026-03-31T19:39:29Z) - ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving [63.980630608984605]
This paper presents ADV-0, a closed-loop min-max optimization framework that treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game.<n>To make this tractable, we cast dynamic adversary evolution as iterative preference learning, efficiently approximating this optimum and offering an algorithm-agnostic solution to the game.<n> Experiments indicate that it effectively exposes diverse safety-critical failures and greatly enhances the generalizability of both learned policies and motion planners against unseen long-tail risks.
arXiv Detail & Related papers (2026-03-16T12:58:31Z) - How to Brake? Ethical Emergency Braking with Deep Reinforcement Learning [3.906196377005682]
We investigate how Deep Reinforcement Learning can be leveraged to improve safety in multi-vehicle-following scenarios involving emergency braking.<n>Specifically, we investigate how DRL with vehicle-to-vehicle communication can be used to ethically select an emergency breaking profile.<n>We provide a hybrid approach that combines DRL with a previously published method based on analytical expressions for selecting optimal constant deceleration.
arXiv Detail & Related papers (2025-12-11T14:40:33Z) - Ethics-Aware Safe Reinforcement Learning for Rare-Event Risk Control in Interactive Urban Driving [1.2891210250935148]
We present a hierarchical Safe Reinforcement Learning framework that augments standard driving objectives with ethics-aware cost signals.<n>A Safe RL agent is trained using a composite ethical risk cost, combining collision probability and harm severity, to generate high-level motion targets.<n>A dynamic, risk-sensitive Prioritized Experience mechanism amplifies learning from rare but critical, high-risk events.
arXiv Detail & Related papers (2025-08-19T14:24:02Z) - Adaptive Autopilot: Constrained DRL for Diverse Driving Behaviors [12.812518632907771]
This study introduces adaptive autopilot (AA), a unique framework utilizing constrained-deep reinforcement learning (C-DRL)
AA aims to safely emulate human driving to reduce the necessity for driver intervention.
arXiv Detail & Related papers (2024-07-02T13:08:01Z) - Risk-anticipatory autonomous driving strategies considering vehicles' weights, based on hierarchical deep reinforcement learning [12.014977175887767]
This study develops an autonomous driving strategy based on risk anticipation, considering the weights of surrounding vehicles.
A risk indicator integrating surrounding vehicles weights, based on the risk field theory, is proposed and incorporated into autonomous driving decisions.
An indicator, potential collision energy in conflicts, is newly proposed to evaluate the performance of the developed AV driving strategy.
arXiv Detail & Related papers (2023-12-27T06:03:34Z) - RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality [46.909086734963665]
This paper introduces RACER, a cutting-edge deep learning car-following model to predict Adaptive Cruise Control (ACC) driving behavior.<n>Unlike conventional models, RACER effectively integrates Rational Driving Constraints (RDCs), crucial tenets of actual driving.<n> RACER excels across key metrics, such as acceleration, velocity, and spacing, registering zero violations.
arXiv Detail & Related papers (2023-12-12T06:21:30Z) - Runtime Stealthy Perception Attacks against DNN-based Adaptive Cruise Control Systems [8.561553195784017]
This paper evaluates the security of the deep neural network based ACC systems under runtime perception attacks.<n>We present a context-aware strategy for the selection of the most critical times for triggering the attacks.<n>We evaluate the effectiveness of the proposed attack using an actual vehicle, a publicly available driving dataset, and a realistic simulation platform.
arXiv Detail & Related papers (2023-07-18T03:12:03Z) - Reinforcement Learning based Cyberattack Model for Adaptive Traffic
Signal Controller in Connected Transportation Systems [61.39400591328625]
In a connected transportation system, adaptive traffic signal controllers (ATSC) utilize real-time vehicle trajectory data received from vehicles to regulate green time.
This wirelessly connected ATSC increases cyber-attack surfaces and increases their vulnerability to various cyber-attack modes.
One such mode is a'sybil' attack in which an attacker creates fake vehicles in the network.
An RL agent is trained to learn an optimal rate of sybil vehicle injection to create congestion for an approach(s)
arXiv Detail & Related papers (2022-10-31T20:12:17Z) - Motion Planning and Control for Multi Vehicle Autonomous Racing at High
Speeds [100.61456258283245]
This paper presents a multi-layer motion planning and control architecture for autonomous racing.
The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s2$.
arXiv Detail & Related papers (2022-07-22T15:16:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.