Explainable Reinforcement Learning for Formula One Race Strategy

• URL: http://arxiv.org/abs/2501.04068v1
• Date: Tue, 07 Jan 2025 13:54:19 GMT
• Title: Explainable Reinforcement Learning for Formula One Race Strategy
• Authors: Devin Thomas, Junqi Jiang, Avinash Kori, Aaron Russo, Steffen Winkler, Stuart Sale, Joseph McMillan, Francesco Belardinelli, Antonio Rago,
• Abstract summary: We introduce a reinforcement learning model, RSRL, to control race strategies in simulations. RSRL achieves an average finishing position of P5.33 on our test race, the 2023 Bahrain Grand Prix. We then demonstrate, in a generalisability study, how performance for one track or multiple tracks can be prioritised via training.
• Score: 8.158206540652179
• License:
• Abstract: In Formula One, teams compete to develop their cars and achieve the highest possible finishing position in each race. During a race, however, teams are unable to alter the car, so they must improve their cars' finishing positions via race strategy, i.e. optimising their selection of which tyre compounds to put on the car and when to do so. In this work, we introduce a reinforcement learning model, RSRL (Race Strategy Reinforcement Learning), to control race strategies in simulations, offering a faster alternative to the industry standard of hard-coded and Monte Carlo-based race strategies. Controlling cars with a pace equating to an expected finishing position of P5.5 (where P1 represents first place and P20 is last place), RSRL achieves an average finishing position of P5.33 on our test race, the 2023 Bahrain Grand Prix, outperforming the best baseline of P5.63. We then demonstrate, in a generalisability study, how performance for one track or multiple tracks can be prioritised via training. Further, we supplement model predictions with feature importance, decision tree-based surrogate models, and decision tree counterfactuals towards improving user trust in the model. Finally, we provide illustrations which exemplify our approach in real-world situations, drawing parallels between simulations and reality.

Related papers

• Explainable Time Series Prediction of Tyre Energy in Formula One Race Strategy [2.6667819481058928]
  Formula One (F1) race strategy takes place in a high-pressure and fast-paced environment. Two of the core decisions of race strategy are when to make pit stops and which tyre compounds to select. In this work, we trained deep learning models, using the Mercedes-AMG PETRONAS F1 team's historic race data.
  arXiv  Detail & Related papers  (2025-01-07T12:38:48Z)
• MetaFollower: Adaptable Personalized Autonomous Car Following [63.90050686330677]
  We propose an adaptable personalized car-following framework - MetaFollower. We first utilize Model-Agnostic Meta-Learning (MAML) to extract common driving knowledge from various CF events. We additionally combine Long Short-Term Memory (LSTM) and Intelligent Driver Model (IDM) to reflect temporal heterogeneity with high interpretability.
  arXiv  Detail & Related papers  (2024-06-23T15:30:40Z)
• Valeo4Cast: A Modular Approach to End-to-End Forecasting [93.86257326005726]
  Our solution ranks first in the Argoverse 2 End-to-end Forecasting Challenge, with 63.82 mAPf. We depart from the current trend of tackling this task via end-to-end training from perception to forecasting, and instead use a modular approach. We surpass forecasting results by +17.1 points over last year's winner and by +13.3 points over this year's runner-up.
  arXiv  Detail & Related papers  (2024-06-12T11:50:51Z)
• er.autopilot 1.0: The Full Autonomous Stack for Oval Racing at High Speeds [61.91756903900903]
  The Indy Autonomous Challenge (IAC) brought together nine autonomous racing teams competing at unprecedented speed and in head-to-head scenario, using independently developed software on open-wheel racecars. This paper presents the complete software architecture used by team TII EuroRacing (TII-ER), covering all the modules needed to avoid static obstacles, perform active overtakes and reach speeds above 75 m/s (270 km/h) Overall results and the performance of each module are described, as well as the lessons learned during the first two events of the competition on oval tracks, where the team placed respectively second and third.
  arXiv  Detail & Related papers  (2023-10-27T12:52:34Z)
• Mastering Nordschleife -- A comprehensive race simulation for AI strategy decision-making in motorsports [0.0]
  This paper develops a novel simulation model tailored to GT racing. By integrating the simulation with OpenAI's Gym framework, a reinforcement learning environment is created and an agent is trained. The paper contributes to the broader application of reinforcement learning in race simulations and unlocks the potential for race strategy optimization beyond FIA Formula1.
  arXiv  Detail & Related papers  (2023-06-28T10:39:31Z)
• Vehicle Dynamics Modeling for Autonomous Racing Using Gaussian Processes [0.0]
  This paper presents the most detailed analysis of the applicability of GP models for approximating vehicle dynamics for autonomous racing. We construct dynamic, and extended kinematic models for the popular F1TENTH racing platform.
  arXiv  Detail & Related papers  (2023-06-06T04:53:06Z)
• Motion Planning and Control for Multi Vehicle Autonomous Racing at High Speeds [100.61456258283245]
  This paper presents a multi-layer motion planning and control architecture for autonomous racing. The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s2$.
  arXiv  Detail & Related papers  (2022-07-22T15:16:54Z)
• An Adaptive Human Driver Model for Realistic Race Car Simulations [25.67586167621258]
  We provide a better understanding of race driver behavior and introduce an adaptive human race driver model based on imitation learning. We show that our framework can create realistic driving line distributions on unseen race tracks with almost human-like performance.
  arXiv  Detail & Related papers  (2022-03-03T18:39:50Z)
• Learning to Run with Potential-Based Reward Shaping and Demonstrations from Video Data [70.540936204654]
  "Learning to run" competition was to train a two-legged model of a humanoid body to run in a simulated race course with maximum speed. All submissions took a tabula rasa approach to reinforcement learning (RL) and were able to produce relatively fast, but not optimal running behaviour. We demonstrate how data from videos of human running can be used to shape the reward of the humanoid learning agent.
  arXiv  Detail & Related papers  (2020-12-16T09:46:58Z)
• Learning from Simulation, Racing in Reality [126.56346065780895]
  We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation can be successfully transferred to the real robotic setup.
  arXiv  Detail & Related papers  (2020-11-26T14:58:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.