Hardware Accelerators in Autonomous Driving
- URL: http://arxiv.org/abs/2308.06054v1
- Date: Fri, 11 Aug 2023 10:07:33 GMT
- Title: Hardware Accelerators in Autonomous Driving
- Authors: Ken Power, Shailendra Deva, Ting Wang, Julius Li, Ciar\'an Eising
- Abstract summary: Hardware accelerators are special-purpose coprocessors that help autonomous vehicles meet performance requirements for higher levels of autonomy.
This paper provides an overview of ML accelerators with examples of their use for machine vision in autonomous vehicles.
- Score: 5.317893030884531
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Computing platforms in autonomous vehicles record large amounts of data from
many sensors, process the data through machine learning models, and make
decisions to ensure the vehicle's safe operation. Fast, accurate, and reliable
decision-making is critical. Traditional computer processors lack the power and
flexibility needed for the perception and machine vision demands of advanced
autonomous driving tasks. Hardware accelerators are special-purpose
coprocessors that help autonomous vehicles meet performance requirements for
higher levels of autonomy. This paper provides an overview of ML accelerators
with examples of their use for machine vision in autonomous vehicles. We offer
recommendations for researchers and practitioners and highlight a trajectory
for ongoing and future research in this emerging field.
Related papers
- Performance Implications of Multi-Chiplet Neural Processing Units on Autonomous Driving Perception [12.416683044819955]
We study the application of emerging chiplet-based Neural Processing Units to accelerate vehicular AI perception workloads in constrained automotive settings.
Our approach realizes 82% and 2.8x increase in throughput and processing engines utilization compared to monolithic accelerator designs.
arXiv Detail & Related papers (2024-11-24T22:59:11Z) - Efficient Motion Prediction: A Lightweight & Accurate Trajectory Prediction Model With Fast Training and Inference Speed [56.27022390372502]
We propose a new efficient motion prediction model, which achieves highly competitive benchmark results while training only a few hours on a single GPU.
Its low inference latency makes it particularly suitable for deployment in autonomous applications with limited computing resources.
arXiv Detail & Related papers (2024-09-24T14:58:27Z) - Exploring the Causality of End-to-End Autonomous Driving [57.631400236930375]
We propose a comprehensive approach to explore and analyze the causality of end-to-end autonomous driving.
Our work is the first to unveil the mystery of end-to-end autonomous driving and turn the black box into a white one.
arXiv Detail & Related papers (2024-07-09T04:56:11Z) - Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis [6.422370188350147]
We present a framework that monitors active vehicles using camera images and state information in order to determine whether vehicles are autonomous.
Essentially, it builds on the cooperation among vehicles, which share their data acquired on the road feeding a machine learning model to identify autonomous cars.
Experiments show it is possible to discriminate the two behaviors by analyzing video clips with an accuracy of 80%, which improves up to 93% when the target state information is available.
arXiv Detail & Related papers (2024-03-14T17:00:29Z) - Real-time Traffic Object Detection for Autonomous Driving [5.780326596446099]
Modern computer vision techniques tend to prioritize accuracy over efficiency.
Existing object detectors are far from being real-time.
We propose a more suitable alternative that incorporates real-time requirements.
arXiv Detail & Related papers (2024-01-31T19:12:56Z) - Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future [130.87142103774752]
This review systematically assesses over seventy open-source autonomous driving datasets.
It offers insights into various aspects, such as the principles underlying the creation of high-quality datasets.
It also delves into the scientific and technical challenges that warrant resolution.
arXiv Detail & Related papers (2023-12-06T10:46:53Z) - Applications of Computer Vision in Autonomous Vehicles: Methods, Challenges and Future Directions [2.693342141713236]
This paper reviews publications on computer vision and autonomous driving that are published during the last ten years.
In particular, we first investigate the development of autonomous driving systems and summarize these systems that are developed by the major automotive manufacturers from different countries.
Then, a comprehensive overview of computer vision applications for autonomous driving such as depth estimation, object detection, lane detection, and traffic sign recognition are discussed.
arXiv Detail & Related papers (2023-11-15T16:41:18Z) - LLM4Drive: A Survey of Large Language Models for Autonomous Driving [62.10344445241105]
Large language models (LLMs) have demonstrated abilities including understanding context, logical reasoning, and generating answers.
In this paper, we systematically review a research line about textitLarge Language Models for Autonomous Driving (LLM4AD).
arXiv Detail & Related papers (2023-11-02T07:23:33Z) - Generative AI-empowered Simulation for Autonomous Driving in Vehicular
Mixed Reality Metaverses [130.15554653948897]
In vehicular mixed reality (MR) Metaverse, distance between physical and virtual entities can be overcome.
Large-scale traffic and driving simulation via realistic data collection and fusion from the physical world is difficult and costly.
We propose an autonomous driving architecture, where generative AI is leveraged to synthesize unlimited conditioned traffic and driving data in simulations.
arXiv Detail & Related papers (2023-02-16T16:54:10Z) - Vision Paper: Causal Inference for Interpretable and Robust Machine
Learning in Mobility Analysis [71.2468615993246]
Building intelligent transportation systems requires an intricate combination of artificial intelligence and mobility analysis.
The past few years have seen rapid development in transportation applications using advanced deep neural networks.
This vision paper emphasizes research challenges in deep learning-based mobility analysis that require interpretability and robustness.
arXiv Detail & Related papers (2022-10-18T17:28:58Z) - Vision-based Driver Assistance Systems: Survey, Taxonomy and Advances [0.2698840218255534]
We survey the list of vision based advanced driver assistance systems with a consistent terminology and propose a taxonomy.
We also propose an abstract model in an attempt to formalize a top-down view of application development to scale towards autonomous driving system.
arXiv Detail & Related papers (2021-04-26T13:53:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.