Residual Policy Learning for Vehicle Control of Autonomous Racing Cars

• URL: http://arxiv.org/abs/2302.07035v2
• Date: Wed, 31 May 2023 09:34:04 GMT
• Title: Residual Policy Learning for Vehicle Control of Autonomous Racing Cars
• Abstract summary: We propose a residual vehicle controller for autonomous racing cars that learns to amend a classical controller for the path-following of racing lines. In an extensive study, performance gains of our approach are evaluated for a simulated car of the F1TENTH autonomous racing series. The evaluation for twelve replicated real-world racetracks shows that the residual controller reduces lap times by an average of 4.55 % compared to a classical controller.
• Score: 0.5156484100374059
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The development of vehicle controllers for autonomous racing is challenging because racing cars operate at their physical driving limit. Prompted by the demand for improved performance, autonomous racing research has seen the proliferation of machine learning-based controllers. While these approaches show competitive performance, their practical applicability is often limited. Residual policy learning promises to mitigate this drawback by combining classical controllers with learned residual controllers. The critical advantage of residual controllers is their high adaptability parallel to the classical controller's stable behavior. We propose a residual vehicle controller for autonomous racing cars that learns to amend a classical controller for the path-following of racing lines. In an extensive study, performance gains of our approach are evaluated for a simulated car of the F1TENTH autonomous racing series. The evaluation for twelve replicated real-world racetracks shows that the residual controller reduces lap times by an average of 4.55 % compared to a classical controller and even enables lap time gains on unknown racetracks.

Related papers

• Track-Guided Hierarchical Reinforcement Learning for Autonomous Vehicle Drifting with Minimum-Lap-Time Planning [57.68768189557651]
  In Formula 1, drivers optimize racing lines within tire grip limits to minimize lap times.<n>In rally racing, drivers intentionally break traction to drift on loose surfaces.<n>This paper proposes a planning-control framework specifically designed for MLT drifting scenario.
  arXiv  Detail & Related papers  (2026-07-31T08:50:40Z)
• Benchmarking Empirical and Learning-Based Approaches for Feedforward Steering Control in Autonomous Racing [2.183305325115666]
  Feedforward steering control is a key component of hierarchical control architectures for autonomous racing.<n>This paper presents a benchmark of two learning-based and two empirical feedforward controllers.<n>We test the feedforward controllers in a high-fidelity simulation framework based on the real-world Abu Dhabi Autonomous Racing League competition.
  arXiv  Detail & Related papers  (2026-05-20T12:44:36Z)
• Dynamic Lookahead Distance via Reinforcement Learning-Based Pure Pursuit for Autonomous Racing [0.0]
  We propose a hybrid control framework that integrates Proximal Policy Optimization with the classical Pure Pursuit controller.<n>The PPO agent maps vehicle speed and multi-horizon curvature features to an online lookahead command.<n>Experiments show that the learned policy improves lap-time performance and repeated lap completion on unseen tracks.
  arXiv  Detail & Related papers  (2026-03-30T16:09:26Z)
• Vision based driving agent for race car simulation environments [0.0]
  The paper outlines the formulation of the task of time optimal driving on a race track as a deep reinforcement learning problem. The results demonstrate human-like learning and driving behavior that utilize maximum tire grip potential.
  arXiv  Detail & Related papers  (2025-04-14T14:29:37Z)
• Learning a Stable, Safe, Distributed Feedback Controller for a Heterogeneous Platoon of Autonomous Vehicles [5.289123253466164]
  We introduce an algorithm for learning a stable, safe, distributed controller for a heterogeneous platoon. We train a controller for autonomous platooning in simulation and evaluate its performance on hardware with a platoon of four F1Tenth vehicles.
  arXiv  Detail & Related papers  (2024-04-18T19:11:34Z)
• A Tricycle Model to Accurately Control an Autonomous Racecar with Locked Differential [71.53284767149685]
  We present a novel formulation to model the effects of a locked differential on the lateral dynamics of an autonomous open-wheel racecar. We include a micro-steps discretization approach to accurately linearize the dynamics and produce a prediction suitable for real-time implementation.
  arXiv  Detail & Related papers  (2023-12-22T16:29:55Z)
• er.autopilot 1.0: The Full Autonomous Stack for Oval Racing at High Speeds [61.91756903900903]
  The Indy Autonomous Challenge (IAC) brought together nine autonomous racing teams competing at unprecedented speed and in head-to-head scenario, using independently developed software on open-wheel racecars. This paper presents the complete software architecture used by team TII EuroRacing (TII-ER), covering all the modules needed to avoid static obstacles, perform active overtakes and reach speeds above 75 m/s (270 km/h) Overall results and the performance of each module are described, as well as the lessons learned during the first two events of the competition on oval tracks, where the team placed respectively second and third.
  arXiv  Detail & Related papers  (2023-10-27T12:52:34Z)
• FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing [71.76084256567599]
  We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL) Our system, FastRLAP (faster lap), trains autonomously in the real world, without human interventions, and without requiring any simulation or expert demonstrations. The resulting policies exhibit emergent aggressive driving skills, such as timing braking and acceleration around turns and avoiding areas which impede the robot's motion, approaching the performance of a human driver using a similar first-person interface over the course of training.
  arXiv  Detail & Related papers  (2023-04-19T17:33:47Z)
• Motion Planning and Control for Multi Vehicle Autonomous Racing at High Speeds [100.61456258283245]
  This paper presents a multi-layer motion planning and control architecture for autonomous racing. The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s2$.
  arXiv  Detail & Related papers  (2022-07-22T15:16:54Z)
• Indy Autonomous Challenge -- Autonomous Race Cars at the Handling Limits [81.22616193933021]
  The team TUM Auton-omous Motorsports will participate in the Indy Autonomous Challenge in Octo-ber 2021. It will benchmark its self-driving software-stack by racing one out of ten autonomous Dallara AV-21 racecars at the Indianapolis Motor Speedway. It is an ideal testing ground for the development of autonomous driving algorithms capable of mastering the most challenging and rare situations.
  arXiv  Detail & Related papers  (2022-02-08T11:55:05Z)
• Training Electric Vehicle Charging Controllers with Imitation Learning [0.0]
  We develop a method for the training of controllers for the coordination of EV charging. In contrast to most existing works on this topic, we require the controllers to preserve the privacy of the users.
  arXiv  Detail & Related papers  (2021-07-21T14:39:55Z)
• Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learning [39.757652701917166]
  This work proposes a new learning-based method to tackle the autonomous overtaking problem. We evaluate our approach using Gran Turismo Sport -- a world-leading car racing simulator.
  arXiv  Detail & Related papers  (2021-03-26T18:06:50Z)
• Learning from Simulation, Racing in Reality [126.56346065780895]
  We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation can be successfully transferred to the real robotic setup.
  arXiv  Detail & Related papers  (2020-11-26T14:58:49Z)
• Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement Learning [39.719051858649216]
  We propose a learning-based system for autonomous car racing by leveraging a high-fidelity physical car simulation. We deploy our system in Gran Turismo Sport, a world-leading car simulator known for its realistic physics simulation of different race cars and tracks. Our trained policy achieves autonomous racing performance that goes beyond what had been achieved so far by the built-in AI.
  arXiv  Detail & Related papers  (2020-08-18T15:06:44Z)
• BayesRace: Learning to race autonomously using prior experience [20.64931380046805]
  We present a model-based planning and control framework for autonomous racing. Our approach alleviates the gap induced by simulation-based controller design by learning from on-board sensor measurements.
  arXiv  Detail & Related papers  (2020-05-10T19:15:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.