Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing

• URL: http://arxiv.org/abs/2205.02953v1
• Date: Thu, 5 May 2022 22:31:19 GMT
• Title: Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing
• Authors: Jonathan Francis, Bingqing Chen, Siddha Ganju, Sidharth Kathpal, Jyotish Poonganam, Ayush Shivani, Sahika Genc, Ivan Zhukov, Max Kumskoy, Anirudh Koul, Jean Oh and Eric Nyberg
• Abstract summary: We present the results of our autonomous racing virtual challenge, based on the newly-released Learn-to-Race (L2R) simulation framework. In this paper, we describe the new L2R Task 2.0 benchmark, with refined metrics and baseline approaches. We also provide an overview of deployment, evaluation, and rankings for the inaugural instance of the L2R Autonomous Racing Virtual Challenge.
• Score: 12.50944966521162
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present the results of our autonomous racing virtual challenge, based on the newly-released Learn-to-Race (L2R) simulation framework, which seeks to encourage interdisciplinary research in autonomous driving and to help advance the state of the art on a realistic benchmark. Analogous to racing being used to test cutting-edge vehicles, we envision autonomous racing to serve as a particularly challenging proving ground for autonomous agents as: (i) they need to make sub-second, safety-critical decisions in a complex, fast-changing environment; and (ii) both perception and control must be robust to distribution shifts, novel road features, and unseen obstacles. Thus, the main goal of the challenge is to evaluate the joint safety, performance, and generalisation capabilities of reinforcement learning agents on multi-modal perception, through a two-stage process. In the first stage of the challenge, we evaluate an autonomous agent's ability to drive as fast as possible, while adhering to safety constraints. In the second stage, we additionally require the agent to adapt to an unseen racetrack through safe exploration. In this paper, we describe the new L2R Task 2.0 benchmark, with refined metrics and baseline approaches. We also provide an overview of deployment, evaluation, and rankings for the inaugural instance of the L2R Autonomous Racing Virtual Challenge (supported by Carnegie Mellon University, Arrival Ltd., AICrowd, Amazon Web Services, and Honda Research), which officially used the new L2R Task 2.0 benchmark and received over 20,100 views, 437 active participants, 46 teams, and 733 model submissions -- from 88 unique institutions, in 28 different countries. Finally, we release leaderboard results from the challenge and provide description of the two top-ranking approaches in cross-domain model transfer, across multiple sensor configurations and simulated races.

Related papers

• er.autopilot 1.0: The Full Autonomous Stack for Oval Racing at High Speeds [61.91756903900903]
  The Indy Autonomous Challenge (IAC) brought together nine autonomous racing teams competing at unprecedented speed and in head-to-head scenario, using independently developed software on open-wheel racecars. This paper presents the complete software architecture used by team TII EuroRacing (TII-ER), covering all the modules needed to avoid static obstacles, perform active overtakes and reach speeds above 75 m/s (270 km/h) Overall results and the performance of each module are described, as well as the lessons learned during the first two events of the competition on oval tracks, where the team placed respectively second and third.
  arXiv  Detail & Related papers  (2023-10-27T12:52:34Z)
• The Waymo Open Sim Agents Challenge [37.69742145084953]
  We introduce the Open Sim Agents Challenge (WOSAC) The goal of the challenge is to stimulate the design of realistic simulators that can be used to evaluate and train a behavior model for autonomous driving. We present results for a number of different baseline simulation agent methods, and analyze several submissions to the 2023 competition.
  arXiv  Detail & Related papers  (2023-05-19T23:12:08Z)
• The 7th AI City Challenge [87.23137854688389]
  The AI City Challenge's seventh edition emphasizes two domains at the intersection of computer vision and artificial intelligence. The 2023 challenge had five tracks, which drew a record-breaking number of participation requests from 508 teams across 46 countries. The participating teams' top performances established strong baselines and even outperformed the state-of-the-art in the proposed challenge tracks.
  arXiv  Detail & Related papers  (2023-04-15T08:02:16Z)
• NeurIPS 2022 Competition: Driving SMARTS [60.948652154552136]
  Driving SMARTS is a regular competition designed to tackle problems caused by the distribution shift in dynamic interaction contexts. The proposed competition supports methodologically diverse solutions, such as reinforcement learning (RL) and offline learning methods.
  arXiv  Detail & Related papers  (2022-11-14T17:10:53Z)
• The 6th AI City Challenge [91.65782140270152]
  The 4 challenge tracks of the 2022 AI City Challenge received participation requests from 254 teams across 27 countries. The top performance of participating teams established strong baselines and even outperformed the state-of-the-art in the proposed challenge tracks.
  arXiv  Detail & Related papers  (2022-04-21T19:24:17Z)
• Indy Autonomous Challenge -- Autonomous Race Cars at the Handling Limits [81.22616193933021]
  The team TUM Auton-omous Motorsports will participate in the Indy Autonomous Challenge in Octo-ber 2021. It will benchmark its self-driving software-stack by racing one out of ten autonomous Dallara AV-21 racecars at the Indianapolis Motor Speedway. It is an ideal testing ground for the development of autonomous driving algorithms capable of mastering the most challenging and rare situations.
  arXiv  Detail & Related papers  (2022-02-08T11:55:05Z)
• Learn-to-Race: A Multimodal Control Environment for Autonomous Racing [23.798765519590734]
  We introduce a new environment, where agents Learn-to-Race (L2R) in simulated Formula-E style racing. Our environment, which includes a simulator and an interfacing training framework, accurately models vehicle dynamics and racing conditions. Next, we propose the L2R task with challenging metrics, inspired by learning-to-drive challenges, Formula-E racing, and multimodal trajectory prediction for autonomous driving.
  arXiv  Detail & Related papers  (2021-03-22T04:03:06Z)
• A Software Architecture for Autonomous Vehicles: Team LRM-B Entry in the First CARLA Autonomous Driving Challenge [49.976633450740145]
  This paper presents the architecture design for the navigation of an autonomous vehicle in a simulated urban environment. Our architecture was made towards meeting the requirements of CARLA Autonomous Driving Challenge.
  arXiv  Detail & Related papers  (2020-10-23T18:07:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.