Dynamic Lookahead Distance via Reinforcement Learning-Based Pure Pursuit for Autonomous Racing

• URL: http://arxiv.org/abs/2603.28625v1
• Date: Mon, 30 Mar 2026 16:09:26 GMT
• Title: Dynamic Lookahead Distance via Reinforcement Learning-Based Pure Pursuit for Autonomous Racing
• Abstract summary: We propose a hybrid control framework that integrates Proximal Policy Optimization with the classical Pure Pursuit controller.<n>The PPO agent maps vehicle speed and multi-horizon curvature features to an online lookahead command.<n>Experiments show that the learned policy improves lap-time performance and repeated lap completion on unseen tracks.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Pure Pursuit (PP) is a widely used path-tracking algorithm in autonomous vehicles due to its simplicity and real-time performance. However, its effectiveness is sensitive to the choice of lookahead distance: shorter values improve cornering but can cause instability on straights, while longer values improve smoothness but reduce accuracy in curves. We propose a hybrid control framework that integrates Proximal Policy Optimization (PPO) with the classical Pure Pursuit controller to adjust the lookahead distance dynamically during racing. The PPO agent maps vehicle speed and multi-horizon curvature features to an online lookahead command. It is trained using Stable-Baselines3 in the F1TENTH Gym simulator with a KL penalty and learning-rate decay for stability, then deployed in a ROS2 environment to guide the controller. Experiments in simulation compare the proposed method against both fixed-lookahead Pure Pursuit and an adaptive Pure Pursuit baseline. Additional real-car experiments compare the learned controller against a fixed-lookahead Pure Pursuit controller. Results show that the learned policy improves lap-time performance and repeated lap completion on unseen tracks, while also transferring zero-shot to hardware. The learned controller adapts the lookahead by increasing it on straights and reducing it in curves, demonstrating effectiveness in augmenting a classical controller by online adaptation of a single interpretable parameter. On unseen tracks, the proposed method achieved 33.16 s on Montreal and 46.05 s on Yas Marina, while tolerating more aggressive speed-profile scaling than the baselines and achieving the best lap times among the tested settings. Initial real-car experiments further support sim-to-real transfer on a 1:10-scale autonomous racing platform

Related papers

• Track-Guided Hierarchical Reinforcement Learning for Autonomous Vehicle Drifting with Minimum-Lap-Time Planning [57.68768189557651]
  In Formula 1, drivers optimize racing lines within tire grip limits to minimize lap times.<n>In rally racing, drivers intentionally break traction to drift on loose surfaces.<n>This paper proposes a planning-control framework specifically designed for MLT drifting scenario.
  arXiv  Detail & Related papers  (2026-07-31T08:50:40Z)
• Benchmarking Empirical and Learning-Based Approaches for Feedforward Steering Control in Autonomous Racing [2.183305325115666]
  Feedforward steering control is a key component of hierarchical control architectures for autonomous racing.<n>This paper presents a benchmark of two learning-based and two empirical feedforward controllers.<n>We test the feedforward controllers in a high-fidelity simulation framework based on the real-world Abu Dhabi Autonomous Racing League competition.
  arXiv  Detail & Related papers  (2026-05-20T12:44:36Z)
• Learning to Tune Pure Pursuit in Autonomous Racing: Joint Lookahead and Steering-Gain Control with PPO [0.0]
  Pure Pursuit (PP) is widely used in autonomous racing for real-time path tracking.<n>We propose a reinforcement-learning (RL) approach that jointly chooses the lookahead Ld and a steering gain g online.<n>Across simulation and real-car tests, the proposed RL-PP controller consistently outperforms fixed-lookahead PP, velocity-scheduled adaptive PP, and an RL lookahead-only variant.
  arXiv  Detail & Related papers  (2026-02-20T17:48:21Z)
• Spatially-Aware Adaptive Trajectory Optimization with Controller-Guided Feedback for Autonomous Racing [74.83272587893508]
  We present a framework for autonomous raceline optimization that combines NURBS-based trajectory representation, CMA-ES global trajectory optimization, and controller-guided spatial feedback.<n>In simulation, our approach achieves a 17.38% lap time reduction compared to a controller parametrized with maximum static acceleration.<n>On real hardware, tested with different tire compounds ranging from high to low friction, we obtain a 7.60% lap time improvement without explicitly parametrizing friction.
  arXiv  Detail & Related papers  (2026-02-17T15:10:44Z)
• Autonomous Vehicle Controllers From End-to-End Differentiable Simulation [57.278726604424556]
  We propose a differentiable simulator and design an analytic policy gradients (APG) approach to training AV controllers.<n>Our proposed framework brings the differentiable simulator into an end-to-end training loop, where gradients of environment dynamics serve as a useful prior to help the agent learn a more grounded policy.<n>We find significant improvements in performance and robustness to noise in the dynamics, as well as overall more intuitive human-like handling.
  arXiv  Detail & Related papers  (2024-09-12T11:50:06Z)
• A Tricycle Model to Accurately Control an Autonomous Racecar with Locked Differential [71.53284767149685]
  We present a novel formulation to model the effects of a locked differential on the lateral dynamics of an autonomous open-wheel racecar. We include a micro-steps discretization approach to accurately linearize the dynamics and produce a prediction suitable for real-time implementation.
  arXiv  Detail & Related papers  (2023-12-22T16:29:55Z)
• Residual Policy Learning for Vehicle Control of Autonomous Racing Cars [0.5156484100374059]
  We propose a residual vehicle controller for autonomous racing cars that learns to amend a classical controller for the path-following of racing lines. In an extensive study, performance gains of our approach are evaluated for a simulated car of the F1TENTH autonomous racing series. The evaluation for twelve replicated real-world racetracks shows that the residual controller reduces lap times by an average of 4.55 % compared to a classical controller.
  arXiv  Detail & Related papers  (2023-02-14T13:33:57Z)
• Tuning Path Tracking Controllers for Autonomous Cars Using Reinforcement Learning [0.0]
  This paper proposes an adaptable path tracking control system based on Reinforcement Learning (RL) for autonomous cars. The tuning of the tracker uses an educated Q-Learning algorithm to minimize the lateral and steering trajectory errors.
  arXiv  Detail & Related papers  (2023-01-09T14:17:12Z)
• Motion Planning and Control for Multi Vehicle Autonomous Racing at High Speeds [100.61456258283245]
  This paper presents a multi-layer motion planning and control architecture for autonomous racing. The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s2$.
  arXiv  Detail & Related papers  (2022-07-22T15:16:54Z)
• Learning from Simulation, Racing in Reality [126.56346065780895]
  We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation can be successfully transferred to the real robotic setup.
  arXiv  Detail & Related papers  (2020-11-26T14:58:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.