Tackling Variabilities in Autonomous Driving

• URL: http://arxiv.org/abs/2104.10415v1
• Date: Wed, 21 Apr 2021 08:51:40 GMT
• Title: Tackling Variabilities in Autonomous Driving
• Authors: Yuqiong Qi and Yang Hu and Haibin Wu and Shen Li and Haiyu Mao and Xiaochun Ye and Dongrui Fan and Ninghui Sun
• Abstract summary: We propose a novel heterogeneous multi-core AI accelerator (HMAI) to provide the hardware substrate for the driving automation tasks with variability. We also propose a deep reinforcement learning (RL)-based task scheduling mechanism FlexAI, to resolve task mapping issue.
• Score: 15.374442918002813
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The state-of-the-art driving automation system demands extreme computational resources to meet rigorous accuracy and latency requirements. Though emerging driving automation computing platforms are based on ASIC to provide better performance and power guarantee, building such an accelerator-based computing platform for driving automation still present challenges. First, the workloads mix and performance requirements exposed to driving automation system present significant variability. Second, with more cameras/sensors integrated in a future fully autonomous driving vehicle, a heterogeneous multi-accelerator architecture substrate is needed that requires a design space exploration for a new form of parallelism. In this work, we aim to extensively explore the above system design challenges and these challenges motivate us to propose a comprehensive framework that synergistically handles the heterogeneous hardware accelerator design principles, system design criteria, and task scheduling mechanism. Specifically, we propose a novel heterogeneous multi-core AI accelerator (HMAI) to provide the hardware substrate for the driving automation tasks with variability. We also define system design criteria to better utilize hardware resources and achieve increased throughput while satisfying the performance and energy restrictions. Finally, we propose a deep reinforcement learning (RL)-based task scheduling mechanism FlexAI, to resolve task mapping issue. Experimental results show that with FlexAI scheduling, basically 100% tasks in each driving route can be processed by HMAI within their required period to ensure safety, and FlexAI can also maximally reduce the breaking distance up to 96% as compared to typical heuristics and guided random-search-based algorithms.

Related papers

• A Meta-Engine Framework for Interleaved Task and Motion Planning using Topological Refinements [51.54559117314768]
  Task And Motion Planning (TAMP) is the problem of finding a solution to an automated planning problem. We propose a general and open-source framework for modeling and benchmarking TAMP problems. We introduce an innovative meta-technique to solve TAMP problems involving moving agents and multiple task-state-dependent obstacles.
  arXiv  Detail & Related papers  (2024-08-11T14:57:57Z)
• Energy-frugal and Interpretable AI Hardware Design using Learning Automata [5.514795777097036]
  A new machine learning algorithm, called the Tsetlin machine, has been proposed. In this paper, we investigate methods of energy-frugal artificial intelligence hardware design. We show that frugal resource allocation can provide decisive energy reduction while also achieving robust and interpretable learning.
  arXiv  Detail & Related papers  (2023-05-19T15:11:18Z)
• Planning-oriented Autonomous Driving [60.93767791255728]
  We argue that a favorable framework should be devised and optimized in pursuit of the ultimate goal, i.e., planning of the self-driving car. We introduce Unified Autonomous Driving (UniAD), a comprehensive framework that incorporates full-stack driving tasks in one network.
  arXiv  Detail & Related papers  (2022-12-20T10:47:53Z)
• Romanus: Robust Task Offloading in Modular Multi-Sensor Autonomous Driving Systems [9.21629452868642]
  We present a methodology for robust and efficient task offloading for modular autonomous driving platforms with multi-sensor processing pipelines. Our approach is 14.99% more energy-efficient than pure local execution while achieving a 77.06% reduction in risky behavior from a robust-agnostic offloading baseline.
  arXiv  Detail & Related papers  (2022-07-18T18:22:49Z)
• Scalable Vehicle Re-Identification via Self-Supervision [66.2562538902156]
  Vehicle Re-Identification is one of the key elements in city-scale vehicle analytics systems. Many state-of-the-art solutions for vehicle re-id mostly focus on improving the accuracy on existing re-id benchmarks and often ignore computational complexity. We propose a simple yet effective hybrid solution empowered by self-supervised training which only uses a single network during inference time.
  arXiv  Detail & Related papers  (2022-05-16T12:14:42Z)
• AI-as-a-Service Toolkit for Human-Centered Intelligence in Autonomous Driving [13.575818872875637]
  This paper presents a proof-of-concept implementation of the AI-as-a-service toolkit developed within the H2020 TEACHING project. It implements an autonomous driving personalization system according to the output of an automatic driver's stress recognition algorithm.
  arXiv  Detail & Related papers  (2022-02-03T15:41:43Z)
• Autonomous Aerial Robot for High-Speed Search and Intercept Applications [86.72321289033562]
  A fully-autonomous aerial robot for high-speed object grasping has been proposed. As an additional sub-task, our system is able to autonomously pierce balloons located in poles close to the surface. Our approach has been validated in a challenging international competition and has shown outstanding results.
  arXiv  Detail & Related papers  (2021-12-10T11:49:51Z)
• Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems [7.3473356077331475]
  autonomous systems essentially require multi-modal multi-task (MMMT) learning. We first discuss the opportunities of applying MMMT techniques in autonomous systems and then discuss the unique challenges that must be solved. We formulate the MMMT model and heterogeneous hardware implementation co-design as a differentiable optimization problem.
  arXiv  Detail & Related papers  (2021-04-08T18:29:30Z)
• Machine Learning-Based Automated Design Space Exploration for Autonomous Aerial Robots [55.056709056795206]
  Building domain-specific architectures for autonomous aerial robots is challenging due to a lack of systematic methodology for designing onboard compute. We introduce a novel performance model called the F-1 roofline to help architects understand how to build a balanced computing system. To navigate the cyber-physical design space automatically, we subsequently introduce AutoPilot.
  arXiv  Detail & Related papers  (2021-02-05T03:50:54Z)
• Reconfigurable Intelligent Surface Assisted Mobile Edge Computing with Heterogeneous Learning Tasks [53.1636151439562]
  Mobile edge computing (MEC) provides a natural platform for AI applications. We present an infrastructure to perform machine learning tasks at an MEC with the assistance of a reconfigurable intelligent surface (RIS) Specifically, we minimize the learning error of all participating users by jointly optimizing transmit power of mobile users, beamforming vectors of the base station, and the phase-shift matrix of the RIS.
  arXiv  Detail & Related papers  (2020-12-25T07:08:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.