An Application-Driven Conceptualization of Corner Cases for Perception
in Highly Automated Driving
- URL: http://arxiv.org/abs/2103.03678v1
- Date: Fri, 5 Mar 2021 13:56:37 GMT
- Title: An Application-Driven Conceptualization of Corner Cases for Perception
in Highly Automated Driving
- Authors: Florian Heidecker, Jasmin Breitenstein, Kevin R\"osch, Jonas
L\"ohdefink, Maarten Bieshaar, Christoph Stiller, Tim Fingscheidt, Bernhard
Sick
- Abstract summary: We provide an application-driven view of corner cases in highly automated driving.
We extend an existing camera-focused systematization of corner cases by adding RADAR and LiDAR.
We describe an exemplary toolchain for data acquisition and processing.
- Score: 21.67019631065338
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Systems and functions that rely on machine learning (ML) are the basis of
highly automated driving. An essential task of such ML models is to reliably
detect and interpret unusual, new, and potentially dangerous situations. The
detection of those situations, which we refer to as corner cases, is highly
relevant for successfully developing, applying, and validating automotive
perception functions in future vehicles where multiple sensor modalities will
be used. A complication for the development of corner case detectors is the
lack of consistent definitions, terms, and corner case descriptions, especially
when taking into account various automotive sensors. In this work, we provide
an application-driven view of corner cases in highly automated driving. To
achieve this goal, we first consider existing definitions from the general
outlier, novelty, anomaly, and out-of-distribution detection to show relations
and differences to corner cases. Moreover, we extend an existing camera-focused
systematization of corner cases by adding RADAR (radio detection and ranging)
and LiDAR (light detection and ranging) sensors. For this, we describe an
exemplary toolchain for data acquisition and processing, highlighting the
interfaces of the corner case detection. We also define a novel level of corner
cases, the method layer corner cases, which appear due to uncertainty inherent
in the methodology or the data distribution.
Related papers
- DARTH: Holistic Test-time Adaptation for Multiple Object Tracking [87.72019733473562]
Multiple object tracking (MOT) is a fundamental component of perception systems for autonomous driving.
Despite the urge of safety in driving systems, no solution to the MOT adaptation problem to domain shift in test-time conditions has ever been proposed.
We introduce DARTH, a holistic test-time adaptation framework for MOT.
arXiv Detail & Related papers (2023-10-03T10:10:42Z) - Unsupervised Domain Adaptation for Self-Driving from Past Traversal
Features [69.47588461101925]
We propose a method to adapt 3D object detectors to new driving environments.
Our approach enhances LiDAR-based detection models using spatial quantized historical features.
Experiments on real-world datasets demonstrate significant improvements.
arXiv Detail & Related papers (2023-09-21T15:00:31Z) - Unsupervised Adaptation from Repeated Traversals for Autonomous Driving [54.59577283226982]
Self-driving cars must generalize to the end-user's environment to operate reliably.
One potential solution is to leverage unlabeled data collected from the end-users' environments.
There is no reliable signal in the target domain to supervise the adaptation process.
We show that this simple additional assumption is sufficient to obtain a potent signal that allows us to perform iterative self-training of 3D object detectors on the target domain.
arXiv Detail & Related papers (2023-03-27T15:07:55Z) - Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts,
Datasets and Metrics [77.34726150561087]
This work aims to carry out a study on the current scenario of camera and radar-based perception for ADAS and autonomous vehicles.
Concepts and characteristics related to both sensors, as well as to their fusion, are presented.
We give an overview of the Deep Learning-based detection and segmentation tasks, and the main datasets, metrics, challenges, and open questions in vehicle perception.
arXiv Detail & Related papers (2023-03-08T00:48:32Z) - A-Eye: Driving with the Eyes of AI for Corner Case Generation [0.6445605125467573]
The overall goal of this work is to enrich training data for automated driving with so called corner cases.
We present the design of a test rig to generate synthetic corner cases using a human-in-the-loop approach.
arXiv Detail & Related papers (2022-02-22T10:42:23Z) - Bayesian Autoencoders for Drift Detection in Industrial Environments [69.93875748095574]
Autoencoders are unsupervised models which have been used for detecting anomalies in multi-sensor environments.
Anomalies can come either from real changes in the environment (real drift) or from faulty sensory devices (virtual drift)
arXiv Detail & Related papers (2021-07-28T10:19:58Z) - Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object
Detection [55.12894776039135]
State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain idiosyncrasies.
We propose a novel learning approach that drastically reduces this gap by fine-tuning the detector on pseudo-labels in the target domain.
We show, on five autonomous driving datasets, that fine-tuning the detector on these pseudo-labels substantially reduces the domain gap to new driving environments.
arXiv Detail & Related papers (2021-03-26T01:18:11Z) - Corner Cases for Visual Perception in Automated Driving: Some Guidance
on Detection Approaches [25.17917252608398]
Corner cases are unexpected and unknown situations that occur while driving.
Their detection is highly safety-critical, and detection methods can be applied to vast amounts of collected data to select suitable training data.
In this work, we continue a previous systematization of corner cases on different levels by an extended set of examples for each level.
arXiv Detail & Related papers (2021-02-11T09:06:13Z) - Corner Case Generation and Analysis for Safety Assessment of Autonomous
Vehicles [3.673699859949693]
A unified framework is proposed to generate corner cases for the decision-making systems.
Deep reinforcement learning techniques are applied to learn the behavior policy of background vehicles.
With the learned policy, BVs will behave and interact with the CAVs more aggressively, resulting in more corner cases.
arXiv Detail & Related papers (2021-02-06T02:48:23Z) - Corner case data description and detection [3.4954795813842185]
Corner cases and related detection are crucial in AI quality assurance for constructing safety- and security-critical systems.
One is to enhance DL models robustness to corner case data via the adjustment on parameters/structure.
The other is to generate new corner cases for model retraining and improvement.
This paper proposes to a simple and novel study aiming at corner case data detection via a specific metric.
arXiv Detail & Related papers (2021-01-07T11:26:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.