Towards a Completeness Argumentation for Scenario Concepts

• URL: http://arxiv.org/abs/2404.01934v1
• Date: Tue, 2 Apr 2024 13:29:38 GMT
• Title: Towards a Completeness Argumentation for Scenario Concepts
• Authors: Christoph Glasmacher, Hendrik Weber, Lutz Eckstein,
• Abstract summary: This paper argues a sufficient completeness of a scenario concept using a goal structured notation. Methods are applied to a scenario concept and the inD dataset to prove the usability.
• Score: 0.2184775414778289
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Scenario-based testing has become a promising approach to overcome the complexity of real-world traffic for safety assurance of automated vehicles. Within scenario-based testing, a system under test is confronted with a set of predefined scenarios. This set shall ensure more efficient testing of an automated vehicle operating in an open context compared to real-world testing. However, the question arises if a scenario catalog can cover the open context sufficiently to allow an argumentation for sufficiently safe driving functions and how this can be proven. Within this paper, a methodology is proposed to argue a sufficient completeness of a scenario concept using a goal structured notation. Thereby, the distinction between completeness and coverage is discussed. For both, methods are proposed for a streamlined argumentation and regarding evidence. These methods are applied to a scenario concept and the inD dataset to prove the usability.

Related papers

• SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
  We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework. Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations. We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
  arXiv  Detail & Related papers  (2023-12-31T04:14:43Z)
• ASSERT: Automated Safety Scenario Red Teaming for Evaluating the Robustness of Large Language Models [65.79770974145983]
  ASSERT, Automated Safety Scenario Red Teaming, consists of three methods -- semantically aligned augmentation, target bootstrapping, and adversarial knowledge injection. We partition our prompts into four safety domains for a fine-grained analysis of how the domain affects model performance. We find statistically significant performance differences of up to 11% in absolute classification accuracy among semantically related scenarios and error rates of up to 19% absolute error in zero-shot adversarial settings.
  arXiv  Detail & Related papers  (2023-10-14T17:10:28Z)
• Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval [139.21955930418815]
  Cross-modal Retrieval methods build similarity relations between vision and language modalities by jointly learning a common representation space. However, the predictions are often unreliable due to the Aleatoric uncertainty, which is induced by low-quality data, e.g., corrupt images, fast-paced videos, and non-detailed texts. We propose a novel Prototype-based Aleatoric Uncertainty Quantification (PAU) framework to provide trustworthy predictions by quantifying the uncertainty arisen from the inherent data ambiguity.
  arXiv  Detail & Related papers  (2023-09-29T09:41:19Z)
• SOTIF-Compliant Scenario Generation Using Semi-Concrete Scenarios and Parameter Sampling [6.195203785530687]
  SOTIF standard requires scenario-based testing to verify and validate Advanced Driver Assistance Systems and Automated Driving Systems. Existing scenario generation approaches either focus on exploring or exploiting the scenario space. This paper proposes semi-concrete scenarios and parameter sampling to generate SOTIF-compliant test suites.
  arXiv  Detail & Related papers  (2023-08-14T09:25:24Z)
• Acquire Driving Scenarios Efficiently: A Framework for Prospective Assessment of Cost-Optimal Scenario Acquisition [0.1999925939110439]
  This paper proposes a methodology to quantify the cost-optimal usage of scenario generation approaches to reach a certainly complete scenario space coverage. A methodology is proposed to fit the meta model including the prediction of reachable complete coverage, quality criteria, and costs.
  arXiv  Detail & Related papers  (2023-07-21T15:26:08Z)
• Conservative Estimation of Perception Relevance of Dynamic Objects for Safe Trajectories in Automotive Scenarios [0.0]
  The concept of relevance currently remains insufficiently defined and specified. We propose a novel methodology to overcome this challenge by exemplary application to collision safety in the highway domain. We present a conservative estimation which dynamic objects are relevant for perception and need to be considered for a complete evaluation.
  arXiv  Detail & Related papers  (2023-07-20T13:43:48Z)
• Tree-Based Scenario Classification: A Formal Framework for Coverage Analysis on Test Drives of Autonomous Vehicles [0.0]
  In scenario-based testing, relevant (driving) scenarios are the basis of tests. We address the open challenges of classifying sets of scenarios and measuring coverage of theses scenarios in recorded test drives.
  arXiv  Detail & Related papers  (2023-07-11T08:30:57Z)
• Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Prior [135.78858513845233]
  STRIVE is a method to automatically generate challenging scenarios that cause a given planner to produce undesirable behavior, like collisions. To maintain scenario plausibility, the key idea is to leverage a learned model of traffic motion in the form of a graph-based conditional VAE. A subsequent optimization is used to find a "solution" to the scenario, ensuring it is useful to improve the given planner.
  arXiv  Detail & Related papers  (2021-12-09T18:03:27Z)
• ADC: Adversarial attacks against object Detection that evade Context consistency checks [55.8459119462263]
  We show that even context consistency checks can be brittle to properly crafted adversarial examples. We propose an adaptive framework to generate examples that subvert such defenses. Our results suggest that how to robustly model context and check its consistency, is still an open problem.
  arXiv  Detail & Related papers  (2021-10-24T00:25:09Z)
• Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles [86.9067793493874]
  We propose efficient mechanisms to characterize and generate testing scenarios using a state-of-the-art driving simulator. We use our method to characterize real driving data from the Next Generation Simulation (NGSIM) project. We rank the scenarios by defining metrics based on the complexity of avoiding accidents and provide insights into how the AV could have minimized the probability of incurring an accident.
  arXiv  Detail & Related papers  (2021-03-12T17:00:23Z)
• Towards an Ontology for Scenario Definition for the Assessment of Automated Vehicles: An Object-Oriented Framework [0.0]
  We develop a comprehensive and operable definition of the notion of scenario. We propose an object-oriented framework in which scenarios and their building blocks are defined as classes of objects. We provide definitions and justifications of each of the terms.
  arXiv  Detail & Related papers  (2020-01-30T08:14:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.