Learning from All Vehicles

• URL: http://arxiv.org/abs/2203.11934v1
• Date: Tue, 22 Mar 2022 17:59:04 GMT
• Title: Learning from All Vehicles
• Authors: Dian Chen, Philipp Kr\"ahenb\"uhl
• Abstract summary: We present a system to train driving policies from experiences collected not just from the ego-vehicle, but all vehicles that it observes. This system uses the behaviors of other agents to create more diverse driving scenarios without collecting additional data. Our method won the 2021 CARLA Autonomous Driving challenge.
• Score: 1.1947714868715738
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we present a system to train driving policies from experiences collected not just from the ego-vehicle, but all vehicles that it observes. This system uses the behaviors of other agents to create more diverse driving scenarios without collecting additional data. The main difficulty in learning from other vehicles is that there is no sensor information. We use a set of supervisory tasks to learn an intermediate representation that is invariant to the viewpoint of the controlling vehicle. This not only provides a richer signal at training time but also allows more complex reasoning during inference. Learning how all vehicles drive helps predict their behavior at test time and can avoid collisions. We evaluate this system in closed-loop driving simulations. Our system outperforms all prior methods on the public CARLA Leaderboard by a wide margin, improving driving score by 25 and route completion rate by 24 points. Our method won the 2021 CARLA Autonomous Driving challenge. Demo videos are available at https://dotchen.github.io/LAV/.

Related papers

• End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving [3.234017706225293]
  We propose a novel game-based end-to-end learning and testing framework for autonomous vehicle highway driving. We utilize the popular game Grand Theft Auto V to collect highway driving data. An end-to-end architecture predicts the steering and throttle values that control the vehicle by the image of the game screen.
  arXiv  Detail & Related papers  (2024-04-16T18:51:58Z)
• Scaling Is All You Need: Autonomous Driving with JAX-Accelerated Reinforcement Learning [9.25541290397848]
  Reinforcement learning has been demonstrated to outperform even the best humans in complex domains like video games. We conduct large-scale reinforcement learning experiments for autonomous driving. Our best performing policy reduces the failure rate by 64% while improving the rate of driving progress by 25% compared to the policies produced by state-of-the-art machine learning for autonomous driving.
  arXiv  Detail & Related papers  (2023-12-23T00:07:06Z)
• SuperDriverAI: Towards Design and Implementation for End-to-End Learning-based Autonomous Driving [0.0]
  We present an end-to-end learningbased autonomous driving system named SuperDriver AI. Deep Neural Networks (DNNs) learn the driving actions and policies from the experienced human drivers and determine the driving maneuvers to take. We have collected 150 runs for one driving scenario in Tokyo, Japan, and have shown the demonstration of SuperDriver AI with the real-world vehicle.
  arXiv  Detail & Related papers  (2023-05-14T10:13:58Z)
• FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing [71.76084256567599]
  We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL) Our system, FastRLAP (faster lap), trains autonomously in the real world, without human interventions, and without requiring any simulation or expert demonstrations. The resulting policies exhibit emergent aggressive driving skills, such as timing braking and acceleration around turns and avoiding areas which impede the robot's motion, approaching the performance of a human driver using a similar first-person interface over the course of training.
  arXiv  Detail & Related papers  (2023-04-19T17:33:47Z)
• An Intelligent Self-driving Truck System For Highway Transportation [81.12838700312308]
  In this paper, we introduce an intelligent self-driving truck system. Our presented system consists of three main components, 1) a realistic traffic simulation module for generating realistic traffic flow in testing scenarios, 2) a high-fidelity truck model which is designed and evaluated for mimicking real truck response in real-world deployment. We also deploy our proposed system on a real truck and conduct real world experiments which shows our system's capacity of mitigating sim-to-real gap.
  arXiv  Detail & Related papers  (2021-12-31T04:54:13Z)
• Vision-Based Autonomous Car Racing Using Deep Imitative Reinforcement Learning [13.699336307578488]
  Deep imitative reinforcement learning approach (DIRL) achieves agile autonomous racing using visual inputs. We validate our algorithm both in a high-fidelity driving simulation and on a real-world 1/20-scale RC-car with limited onboard computation.
  arXiv  Detail & Related papers  (2021-07-18T00:00:48Z)
• Learning to drive from a world on rails [78.28647825246472]
  We learn an interactive vision-based driving policy from pre-recorded driving logs via a model-based approach. A forward model of the world supervises a driving policy that predicts the outcome of any potential driving trajectory. Our method ranks first on the CARLA leaderboard, attaining a 25% higher driving score while using 40 times less data.
  arXiv  Detail & Related papers  (2021-05-03T05:55:30Z)
• Self-Supervised Steering Angle Prediction for Vehicle Control Using Visual Odometry [55.11913183006984]
  We show how a model can be trained to control a vehicle's trajectory using camera poses estimated through visual odometry methods. We propose a scalable framework that leverages trajectory information from several different runs using a camera setup placed at the front of a car.
  arXiv  Detail & Related papers  (2021-03-20T16:29:01Z)
• Learning Accurate and Human-Like Driving using Semantic Maps and Attention [152.48143666881418]
  This paper investigates how end-to-end driving models can be improved to drive more accurately and human-like. We exploit semantic and visual maps from HERE Technologies and augment the existing Drive360 dataset with such. Our models are trained and evaluated on the Drive360 + HERE dataset, which features 60 hours and 3000 km of real-world driving data.
  arXiv  Detail & Related papers  (2020-07-10T22:25:27Z)
• Learning by Cheating [72.9701333689606]
  We show that this challenging learning problem can be simplified by decomposing it into two stages. We use the presented approach to train a vision-based autonomous driving system that substantially outperforms the state of the art. Our approach achieves, for the first time, 100% success rate on all tasks in the original CARLA benchmark, sets a new record on the NoCrash benchmark, and reduces the frequency of infractions by an order of magnitude compared to the prior state of the art.
  arXiv  Detail & Related papers  (2019-12-27T18:59:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.