Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies

• URL: http://arxiv.org/abs/2006.06091v3
• Date: Sat, 4 Jul 2020 04:38:43 GMT
• Title: Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies
• Authors: Yu Huang and Yue Chen
• Abstract summary: This is a survey of autonomous driving technologies with deep learning methods. We investigate the major fields of self-driving systems, such as perception, mapping and localization, prediction, planning and control, simulation, V2X and safety etc.
• Score: 12.775642557933908
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Since DARPA Grand Challenges (rural) in 2004/05 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. Almost at the same time, deep learning has made breakthrough by several pioneers, three of them (also called fathers of deep learning), Hinton, Bengio and LeCun, won ACM Turin Award in 2019. This is a survey of autonomous driving technologies with deep learning methods. We investigate the major fields of self-driving systems, such as perception, mapping and localization, prediction, planning and control, simulation, V2X and safety etc. Due to the limited space, we focus the analysis on several key areas, i.e. 2D and 3D object detection in perception, depth estimation from cameras, multiple sensor fusion on the data, feature and task level respectively, behavior modelling and prediction of vehicle driving and pedestrian trajectories.

Related papers

• Work-in-Progress: Crash Course: Can (Under Attack) Autonomous Driving Beat Human Drivers? [60.51287814584477]
  This paper evaluates the inherent risks in autonomous driving by examining the current landscape of AVs. We develop specific claims highlighting the delicate balance between the advantages of AVs and potential security challenges in real-world scenarios.
  arXiv  Detail & Related papers  (2024-05-14T09:42:21Z)
• Deep Transfer Learning for Intelligent Vehicle Perception: a Survey [42.860260505671036]
  This paper represents the first comprehensive survey on the topic of the deep transfer learning for intelligent vehicle perception. Deep transfer learning aims to improve task performance in a new domain by leveraging the knowledge of similar tasks learned in another domain before.
  arXiv  Detail & Related papers  (2023-06-26T23:18:09Z)
• An Overview about Emerging Technologies of Autonomous Driving [12.686694414570457]
  Since DARPA started Grand Challenges in 2004 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. This paper gives an overview about technical aspects of autonomous driving technologies and open problems. We investigate the major fields of self-driving systems, such as perception, mapping and localization, prediction, planning and control, simulation, V2X and safety etc.
  arXiv  Detail & Related papers  (2023-06-23T05:36:17Z)
• SuperDriverAI: Towards Design and Implementation for End-to-End Learning-based Autonomous Driving [0.0]
  We present an end-to-end learningbased autonomous driving system named SuperDriver AI. Deep Neural Networks (DNNs) learn the driving actions and policies from the experienced human drivers and determine the driving maneuvers to take. We have collected 150 runs for one driving scenario in Tokyo, Japan, and have shown the demonstration of SuperDriver AI with the real-world vehicle.
  arXiv  Detail & Related papers  (2023-05-14T10:13:58Z)
• Policy Pre-training for End-to-end Autonomous Driving via Self-supervised Geometric Modeling [96.31941517446859]
  We propose PPGeo (Policy Pre-training via Geometric modeling), an intuitive and straightforward fully self-supervised framework curated for the policy pretraining in visuomotor driving. We aim at learning policy representations as a powerful abstraction by modeling 3D geometric scenes on large-scale unlabeled and uncalibrated YouTube driving videos. In the first stage, the geometric modeling framework generates pose and depth predictions simultaneously, with two consecutive frames as input. In the second stage, the visual encoder learns driving policy representation by predicting the future ego-motion and optimizing with the photometric error based on current visual observation only.
  arXiv  Detail & Related papers  (2023-01-03T08:52:49Z)
• Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey [0.9163827313498957]
  As the foundation of autonomous driving, the deep learning technology faces many new security risks. The academic community has proposed deep learning countermeasures against the adversarial examples and AI backdoor. This paper provides an summary of the concepts, developments and recent research in deep learning security technologies in autonomous driving.
  arXiv  Detail & Related papers  (2022-10-19T10:04:33Z)
• Indy Autonomous Challenge -- Autonomous Race Cars at the Handling Limits [81.22616193933021]
  The team TUM Auton-omous Motorsports will participate in the Indy Autonomous Challenge in Octo-ber 2021. It will benchmark its self-driving software-stack by racing one out of ten autonomous Dallara AV-21 racecars at the Indianapolis Motor Speedway. It is an ideal testing ground for the development of autonomous driving algorithms capable of mastering the most challenging and rare situations.
  arXiv  Detail & Related papers  (2022-02-08T11:55:05Z)
• KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D [67.50776195828242]
  KITTI-360 is a suburban driving dataset which comprises richer input modalities, comprehensive semantic instance annotations and accurate localization. For efficient annotation, we created a tool to label 3D scenes with bounding primitives, resulting in over 150k semantic and instance annotated images and 1B annotated 3D points. We established benchmarks and baselines for several tasks relevant to mobile perception, encompassing problems from computer vision, graphics, and robotics on the same dataset.
  arXiv  Detail & Related papers  (2021-09-28T00:41:29Z)
• One Million Scenes for Autonomous Driving: ONCE Dataset [91.94189514073354]
  We introduce the ONCE dataset for 3D object detection in the autonomous driving scenario. The data is selected from 144 driving hours, which is 20x longer than the largest 3D autonomous driving dataset available. We reproduce and evaluate a variety of self-supervised and semi-supervised methods on the ONCE dataset.
  arXiv  Detail & Related papers  (2021-06-21T12:28:08Z)
• Fine-Grained Vehicle Perception via 3D Part-Guided Visual Data Augmentation [77.60050239225086]
  We propose an effective training data generation process by fitting a 3D car model with dynamic parts to vehicles in real images. Our approach is fully automatic without any human interaction. We present a multi-task network for VUS parsing and a multi-stream network for VHI parsing.
  arXiv  Detail & Related papers  (2020-12-15T03:03:38Z)
• 3D Point Cloud Processing and Learning for Autonomous Driving [26.285659927609213]
  We present a review of 3D point cloud processing and learning for autonomous driving. LiDAR sensors collect 3D point clouds that precisely record the external surfaces of objects and scenes.
  arXiv  Detail & Related papers  (2020-03-01T22:13:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.