DeepRacing: Parameterized Trajectories for Autonomous Racing
- URL: http://arxiv.org/abs/2005.05178v1
- Date: Wed, 6 May 2020 21:35:48 GMT
- Title: DeepRacing: Parameterized Trajectories for Autonomous Racing
- Authors: Trent Weiss, Madhur Behl
- Abstract summary: We consider the challenging problem of high speed autonomous racing in a realistic Formula One environment.
DeepRacing is a novel end-to-end framework, and a virtual testbed for training and evaluating algorithms for autonomous racing.
This virtual testbed is released under an open-source license both as a standalone C++ API and as a binding to the popular Robot Operating System 2 (ROS2) framework.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We consider the challenging problem of high speed autonomous racing in a
realistic Formula One environment. DeepRacing is a novel end-to-end framework,
and a virtual testbed for training and evaluating algorithms for autonomous
racing. The virtual testbed is implemented using the realistic F1 series of
video games, developed by Codemasters, which many Formula One drivers use for
training. This virtual testbed is released under an open-source license both as
a standalone C++ API and as a binding to the popular Robot Operating System 2
(ROS2) framework. This open-source API allows anyone to use the high fidelity
physics and photo-realistic capabilities of the F1 game as a simulator, and
without hacking any game engine code. We use this framework to evaluate several
neural network methodologies for autonomous racing. Specifically, we consider
several fully end-to-end models that directly predict steering and acceleration
commands for an autonomous race car as well as a model that predicts a list of
waypoints to follow in the car's local coordinate system, with the task of
selecting a steering/throttle angle left to a classical control algorithm. We
also present a novel method of autonomous racing by training a deep neural
network to predict a parameterized representation of a trajectory rather than a
list of waypoints. We evaluate these models performance in our open-source
simulator and show that trajectory prediction far outperforms end-to-end
driving. Additionally, we show that open-loop performance for an end-to-end
model, i.e. root-mean-square error for a model's predicted control values, does
not necessarily correlate with increased driving performance in the closed-loop
sense, i.e. actual ability to race around a track. Finally, we show that our
proposed model of parameterized trajectory prediction outperforms both
end-to-end control and waypoint prediction.
Related papers
- Autonomous Vehicle Controllers From End-to-End Differentiable Simulation [60.05963742334746]
We propose a differentiable simulator and design an analytic policy gradients (APG) approach to training AV controllers.
Our proposed framework brings the differentiable simulator into an end-to-end training loop, where gradients of environment dynamics serve as a useful prior to help the agent learn a more grounded policy.
We find significant improvements in performance and robustness to noise in the dynamics, as well as overall more intuitive human-like handling.
arXiv Detail & Related papers (2024-09-12T11:50:06Z) - A Simulation Benchmark for Autonomous Racing with Large-Scale Human Data [12.804541200469536]
This paper proposes a racing simulation platform based on the simulator Assetto Corsa to test, validate, and benchmark autonomous driving algorithms.
Our contributions include the development of this simulation platform, several state-of-the-art algorithms tailored to the racing environment, and a comprehensive dataset collected from human drivers.
arXiv Detail & Related papers (2024-07-23T17:45:16Z) - End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving [3.234017706225293]
We propose a novel game-based end-to-end learning and testing framework for autonomous vehicle highway driving.
We utilize the popular game Grand Theft Auto V to collect highway driving data.
An end-to-end architecture predicts the steering and throttle values that control the vehicle by the image of the game screen.
arXiv Detail & Related papers (2024-04-16T18:51:58Z) - FastRLAP: A System for Learning High-Speed Driving via Deep RL and
Autonomous Practicing [71.76084256567599]
We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL)
Our system, FastRLAP (faster lap), trains autonomously in the real world, without human interventions, and without requiring any simulation or expert demonstrations.
The resulting policies exhibit emergent aggressive driving skills, such as timing braking and acceleration around turns and avoiding areas which impede the robot's motion, approaching the performance of a human driver using a similar first-person interface over the course of training.
arXiv Detail & Related papers (2023-04-19T17:33:47Z) - Motion Planning and Control for Multi Vehicle Autonomous Racing at High
Speeds [100.61456258283245]
This paper presents a multi-layer motion planning and control architecture for autonomous racing.
The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s2$.
arXiv Detail & Related papers (2022-07-22T15:16:54Z) - Race Driver Evaluation at a Driving Simulator using a physical Model and
a Machine Learning Approach [1.9395755884693817]
We present a method to study and evaluate race drivers on a driver-in-the-loop simulator.
An overall performance score, a vehicle-trajectory score and a handling score are introduced to evaluate drivers.
We show that the neural network is accurate and robust with a root-mean-square error between 2-5% and can replace the optimisation based method.
arXiv Detail & Related papers (2022-01-27T07:32:32Z) - Towards Optimal Strategies for Training Self-Driving Perception Models
in Simulation [98.51313127382937]
We focus on the use of labels in the synthetic domain alone.
Our approach introduces both a way to learn neural-invariant representations and a theoretically inspired view on how to sample the data from the simulator.
We showcase our approach on the bird's-eye-view vehicle segmentation task with multi-sensor data.
arXiv Detail & Related papers (2021-11-15T18:37:43Z) - DriveGAN: Towards a Controllable High-Quality Neural Simulation [147.6822288981004]
We introduce a novel high-quality neural simulator referred to as DriveGAN.
DriveGAN achieves controllability by disentangling different components without supervision.
We train DriveGAN on multiple datasets, including 160 hours of real-world driving data.
arXiv Detail & Related papers (2021-04-30T15:30:05Z) - Learn-to-Race: A Multimodal Control Environment for Autonomous Racing [23.798765519590734]
We introduce a new environment, where agents Learn-to-Race (L2R) in simulated Formula-E style racing.
Our environment, which includes a simulator and an interfacing training framework, accurately models vehicle dynamics and racing conditions.
Next, we propose the L2R task with challenging metrics, inspired by learning-to-drive challenges, Formula-E racing, and multimodal trajectory prediction for autonomous driving.
arXiv Detail & Related papers (2021-03-22T04:03:06Z) - Real-Time Optimal Trajectory Planning for Autonomous Vehicles and Lap
Time Simulation Using Machine Learning [0.0]
This paper describes a machine learning approach to generating an accurate prediction of the racing line in real-time on desktop processing hardware.
The network is capable of predicting the racing line with a mean absolute error of +/-0.27m, meaning that the accuracy outperforms a human driver.
arXiv Detail & Related papers (2021-02-03T22:34:22Z) - Testing the Safety of Self-driving Vehicles by Simulating Perception and
Prediction [88.0416857308144]
We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps.
We directly simulate the outputs of the self-driving vehicle's perception and prediction system, enabling realistic motion planning testing.
arXiv Detail & Related papers (2020-08-13T17:20:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.