Expert-LaSTS: Expert-Knowledge Guided Latent Space for Traffic Scenarios

• URL: http://arxiv.org/abs/2207.09120v2
• Date: Wed, 20 Jul 2022 06:34:22 GMT
• Title: Expert-LaSTS: Expert-Knowledge Guided Latent Space for Traffic Scenarios
• Authors: Jonas Wurst, Lakshman Balasubramanian, Michael Botsch and Wolfgang Utschick
• Abstract summary: Expert-knowledge is used to define objectives that the latent representations of traffic scenarios shall fulfill. Results show the performance advantage compared to baseline methods.
• Score: 9.554569082679151
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Clustering traffic scenarios and detecting novel scenario types are required for scenario-based testing of autonomous vehicles. These tasks benefit from either good similarity measures or good representations for the traffic scenarios. In this work, an expert-knowledge aided representation learning for traffic scenarios is presented. The latent space so formed is used for successful clustering and novel scenario type detection. Expert-knowledge is used to define objectives that the latent representations of traffic scenarios shall fulfill. It is presented, how the network architecture and loss is designed from these objectives, thereby incorporating expert-knowledge. An automatic mining strategy for traffic scenarios is presented, such that no manual labeling is required. Results show the performance advantage compared to baseline methods. Additionally, extensive analysis of the latent space is performed.

Related papers

• Exploring Semantic Clustering and Similarity Search for Heterogeneous Traffic Scenario Graph [41.2584175136191]
  We first propose an expressive and flexible heterogeneous,temporal graph model for representing traffic scenarios.<n>We then propose a self-supervised method to learn a universal embedding space for scenario graphs.<n>In particular, we implement contrastive learning alongside a bootstrapping-based approach and evaluate their suitability for the scenario space.
  arXiv  Detail & Related papers  (2025-07-07T15:10:03Z)
• Assessing the Completeness of Traffic Scenario Categories for Automated Highway Driving Functions via Cluster-based Analysis [0.6291443816903801]
  This work introduces a pipeline for traffic scenario clustering and the analysis of scenario category completeness.<n>The impact of the number of categories on the completeness considerations of the traffic scenario categories is analyzed.<n>The results show an outperforming clustering performance compared to previous work.
  arXiv  Detail & Related papers  (2025-06-03T08:24:14Z)
• Generating Out-Of-Distribution Scenarios Using Language Models [58.47597351184034]
  Large Language Models (LLMs) have shown promise in autonomous driving. This paper introduces a framework for generating diverse Out-Of-Distribution (OOD) driving scenarios. We evaluate our framework through extensive simulations and introduce a new "OOD-ness" metric.
  arXiv  Detail & Related papers  (2024-11-25T16:38:17Z)
• SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
  We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework. Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations. We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
  arXiv  Detail & Related papers  (2023-12-31T04:14:43Z)
• Traffic Scene Similarity: a Graph-based Contrastive Learning Approach [4.451479907610764]
  We propose an extension to a contrastive learning approach utilizing graphs to construct a meaningful embedding space. Our approach demonstrates the continuous mapping of scenes using scene-specific features and the formation of thematically similar clusters. Based on the found clusters, similar scenes could be identified in the subsequent test process, which can lead to a reduction in redundant test runs.
  arXiv  Detail & Related papers  (2023-09-18T12:35:08Z)
• Concretization of Abstract Traffic Scene Specifications Using Metaheuristic Search [1.9307952728103126]
  As a first step towards scenario-based testing of AVs, the initial scene of a traffic scenario must be concretized. We propose a traffic scene concretization approach that places vehicles on realistic road maps such that they satisfy an set of abstract constraints. We conduct a series of experiments over three realistic road maps to compare eight configurations of our approach with three variations of the state-of-the-art Scenic tool.
  arXiv  Detail & Related papers  (2023-07-15T15:13:16Z)
• OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mapping [84.65114565766596]
  We present OpenLane-V2, the first dataset on topology reasoning for traffic scene structure. OpenLane-V2 consists of 2,000 annotated road scenes that describe traffic elements and their correlation to the lanes. We evaluate various state-of-the-art methods, and present their quantitative and qualitative results on OpenLane-V2 to indicate future avenues for investigating topology reasoning in traffic scenes.
  arXiv  Detail & Related papers  (2023-04-20T16:31:22Z)
• Toward Unsupervised Test Scenario Extraction for Automated Driving Systems from Urban Naturalistic Road Traffic Data [0.0]
  The presented method deploys an unsupervised machine learning pipeline to extract scenarios from road traffic data. It is evaluated for naturalistic road traffic data at urban intersections from the inD and the Silicon Valley Intersections datasets. Using hierarchical clustering the results show both a jump in overall accuracy of around 20% when moving from 4 to 5 clusters and a saturation effect starting at 41 clusters with an overall accuracy of 84%.
  arXiv  Detail & Related papers  (2022-02-14T10:55:14Z)
• Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Prior [135.78858513845233]
  STRIVE is a method to automatically generate challenging scenarios that cause a given planner to produce undesirable behavior, like collisions. To maintain scenario plausibility, the key idea is to leverage a learned model of traffic motion in the form of a graph-based conditional VAE. A subsequent optimization is used to find a "solution" to the scenario, ensuring it is useful to improve the given planner.
  arXiv  Detail & Related papers  (2021-12-09T18:03:27Z)
• Novelty Detection and Analysis of Traffic Scenario Infrastructures in the Latent Space of a Vision Transformer-Based Triplet Autoencoder [12.194597074511863]
  A method to detect novel traffic scenarios based on their infrastructure images is presented. An autoencoder triplet network provides latent representations for infrastructure images which are used for outlier detection. The presented method outperforms other state-of-the-art outlier detection approaches.
  arXiv  Detail & Related papers  (2021-05-05T08:24:03Z)
• Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction [71.97877759413272]
  Trajectory prediction is a safety-critical tool for autonomous vehicles to plan and execute actions. Recent methods have achieved strong performances using Multi-Choice Learning objectives like winner-takes-all (WTA) or best-of-many. Our work addresses two key challenges in trajectory prediction, learning outputs, and better predictions by imposing constraints using driving knowledge.
  arXiv  Detail & Related papers  (2021-04-16T17:58:56Z)
• Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles [86.9067793493874]
  We propose efficient mechanisms to characterize and generate testing scenarios using a state-of-the-art driving simulator. We use our method to characterize real driving data from the Next Generation Simulation (NGSIM) project. We rank the scenarios by defining metrics based on the complexity of avoiding accidents and provide insights into how the AV could have minimized the probability of incurring an accident.
  arXiv  Detail & Related papers  (2021-03-12T17:00:23Z)
• Scenario-Transferable Semantic Graph Reasoning for Interaction-Aware Probabilistic Prediction [29.623692599892365]
  Accurately predicting the possible behaviors of traffic participants is an essential capability for autonomous vehicles. We propose a novel generic representation for various driving environments by taking the advantage of semantics and domain knowledge.
  arXiv  Detail & Related papers  (2020-04-07T00:34:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.