The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competition

• URL: http://arxiv.org/abs/2109.14985v1
• Date: Thu, 30 Sep 2021 10:32:23 GMT
• Title: The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competition
• Authors: Christophe De Wagter and Federico Paredes-Vall\'es and Nilay Sheth and Guido de Croon
• Abstract summary: We present the winning solution of the first AI Robotic Racing (AIRR) Circuit. Our approach has a large focus on gate detection with an efficient deep neural segmentation network and active vision. Although our solution was the fastest and most robust, it still lost against one of the best human pilots, Gab707.
• Score: 5.379463265037841
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robotics is the next frontier in the progress of Artificial Intelligence (AI), as the real world in which robots operate represents an enormous, complex, continuous state space with inherent real-time requirements. One extreme challenge in robotics is currently formed by autonomous drone racing. Human drone racers can fly through complex tracks at speeds of up to 190 km/h. Achieving similar speeds with autonomous drones signifies tackling fundamental problems in AI under extreme restrictions in terms of resources. In this article, we present the winning solution of the first AI Robotic Racing (AIRR) Circuit, a competition consisting of four races in which all participating teams used the same drone, to which they had limited access. The core of our approach is inspired by how human pilots combine noisy observations of the race gates with their mental model of the drone's dynamics to achieve fast control. Our approach has a large focus on gate detection with an efficient deep neural segmentation network and active vision. Further, we make contributions to robust state estimation and risk-based control. This allowed us to reach speeds of ~9.2m/s in the last race, unrivaled by previous autonomous drone race competitions. Although our solution was the fastest and most robust, it still lost against one of the best human pilots, Gab707. The presented approach indicates a promising direction to close the gap with human drone pilots, forming an important step in bringing AI to the real world.

Related papers

• Towards a Robust Soft Baby Robot With Rich Interaction Ability for Advanced Machine Learning Algorithms [25.85850890842541]
  We build a robust, partially soft robotic limb with a large action space and rich sensory data stream from multiple cameras. As a proof of concept, we train two contemporary machine learning algorithms to perform a simple target-finding task.
  arXiv  Detail & Related papers  (2024-04-11T19:15:45Z)
• Multi-model fusion for Aerial Vision and Dialog Navigation based on human attention aids [69.98258892165767]
  We present an aerial navigation task for the 2023 ICCV Conversation History. We propose an effective method of fusion training of Human Attention Aided Transformer model (HAA-Transformer) and Human Attention Aided LSTM (HAA-LSTM) models.
  arXiv  Detail & Related papers  (2023-08-27T10:32:52Z)
• Exploring AI-enhanced Shared Control for an Assistive Robotic Arm [4.999814847776098]
  In particular, we explore how Artifical Intelligence (AI) can be integrated into a shared control paradigm. In particular, we focus on the consequential requirements for the interface between human and robot.
  arXiv  Detail & Related papers  (2023-06-23T14:19:56Z)
• Fleet-DAgger: Interactive Robot Fleet Learning with Scalable Human Supervision [72.4735163268491]
  Commercial and industrial deployments of robot fleets often fall back on remote human teleoperators during execution. We formalize the Interactive Fleet Learning (IFL) setting, in which multiple robots interactively query and learn from multiple human supervisors. We propose Fleet-DAgger, a family of IFL algorithms, and compare a novel Fleet-DAgger algorithm to 4 baselines in simulation.
  arXiv  Detail & Related papers  (2022-06-29T01:23:57Z)
• Indy Autonomous Challenge -- Autonomous Race Cars at the Handling Limits [81.22616193933021]
  The team TUM Auton-omous Motorsports will participate in the Indy Autonomous Challenge in Octo-ber 2021. It will benchmark its self-driving software-stack by racing one out of ten autonomous Dallara AV-21 racecars at the Indianapolis Motor Speedway. It is an ideal testing ground for the development of autonomous driving algorithms capable of mastering the most challenging and rare situations.
  arXiv  Detail & Related papers  (2022-02-08T11:55:05Z)
• Autonomous Aerial Robot for High-Speed Search and Intercept Applications [86.72321289033562]
  A fully-autonomous aerial robot for high-speed object grasping has been proposed. As an additional sub-task, our system is able to autonomously pierce balloons located in poles close to the surface. Our approach has been validated in a challenging international competition and has shown outstanding results.
  arXiv  Detail & Related papers  (2021-12-10T11:49:51Z)
• Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement Learning [39.719051858649216]
  We propose a learning-based system for autonomous car racing by leveraging a high-fidelity physical car simulation. We deploy our system in Gran Turismo Sport, a world-leading car simulator known for its realistic physics simulation of different race cars and tracks. Our trained policy achieves autonomous racing performance that goes beyond what had been achieved so far by the built-in AI.
  arXiv  Detail & Related papers  (2020-08-18T15:06:44Z)
• AlphaPilot: Autonomous Drone Racing [47.205375478625776]
  The system has successfully been deployed at the first autonomous drone racing world championship: the 2019 AlphaPilot Challenge. The proposed system has been demonstrated to successfully guide the drone through tight race courses reaching speeds up to 8m/s.
  arXiv  Detail & Related papers  (2020-05-26T15:45:05Z)
• AirSim Drone Racing Lab [56.68291351736057]
  AirSim Drone Racing Lab is a simulation framework for enabling machine learning research in this domain. Our framework enables generation of racing tracks in multiple photo-realistic environments. We used our framework to host a simulation based drone racing competition at NeurIPS 2019.
  arXiv  Detail & Related papers  (2020-03-12T08:06:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.