Adaptive Splitting of Reusable Temporal Monitors for Rare Traffic Violations

• URL: http://arxiv.org/abs/2405.15771v2
• Date: Wed, 24 Jul 2024 12:56:41 GMT
• Title: Adaptive Splitting of Reusable Temporal Monitors for Rare Traffic Violations
• Authors: Craig Innes, Subramanian Ramamoorthy,
• Abstract summary: Two common issues arise when using existing techniques to produce an estimation. This paper addresses both issues by interleaving rare-event sampling techniques with online specification monitoring algorithms. We produce better estimates than Monte-Carlo and importance sampling in fewer simulations.
• Score: 23.757535844087354
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous Vehicles (AVs) are often tested in simulation to estimate the probability they will violate safety specifications. Two common issues arise when using existing techniques to produce this estimation: If violations occur rarely, simple Monte-Carlo sampling techniques can fail to produce efficient estimates; if simulation horizons are too long, importance sampling techniques (which learn proposal distributions from past simulations) can fail to converge. This paper addresses both issues by interleaving rare-event sampling techniques with online specification monitoring algorithms. We use adaptive multi-level splitting to decompose simulations into partial trajectories, then calculate the distance of those partial trajectories to failure by leveraging robustness metrics from Signal Temporal Logic (STL). By caching those partial robustness metric values, we can efficiently re-use computations across multiple sampling stages. Our experiments on an interstate lane-change scenario show our method is viable for testing simulated AV-pipelines, efficiently estimating failure probabilities for STL specifications based on real traffic rules. We produce better estimates than Monte-Carlo and importance sampling in fewer simulations.

Related papers

• Variable Selection for Comparing High-dimensional Time-Series Data [1.5824413993211348]
  An approach is proposed to select variables and time intervals where the two series are significantly different. In applications where one time series is an output from a computationally expensive simulator, the approach may be used for validating the simulator against real data. The validity and limitations of the proposed approach are investigated in synthetic data experiments.
  arXiv  Detail & Related papers  (2024-12-09T12:08:08Z)
• Querying Labeled Time Series Data with Scenario Programs [0.0]
  We propose a formal definition of what constitutes a match between a real-world labeled time series data item and a simulated scenario. We present a definition and algorithm for matching scalable beyond the autonomous vehicles domain.
  arXiv  Detail & Related papers  (2024-06-25T15:15:27Z)
• NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking [65.24988062003096]
  We present NAVSIM, a framework for benchmarking vision-based driving policies. Our simulation is non-reactive, i.e., the evaluated policy and environment do not influence each other. NAVSIM enabled a new competition held at CVPR 2024, where 143 teams submitted 463 entries, resulting in several new insights.
  arXiv  Detail & Related papers  (2024-06-21T17:59:02Z)
• Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values [67.76168547245237]
  We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies. Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-11T10:10:16Z)
• Distributionally Robust Models with Parametric Likelihood Ratios [123.05074253513935]
  Three simple ideas allow us to train models with DRO using a broader class of parametric likelihood ratios. We find that models trained with the resulting parametric adversaries are consistently more robust to subpopulation shifts when compared to other DRO approaches.
  arXiv  Detail & Related papers  (2022-04-13T12:43:12Z)
• Sampling-Based Robust Control of Autonomous Systems with Non-Gaussian Noise [59.47042225257565]
  We present a novel planning method that does not rely on any explicit representation of the noise distributions. First, we abstract the continuous system into a discrete-state model that captures noise by probabilistic transitions between states. We capture these bounds in the transition probability intervals of a so-called interval Markov decision process (iMDP)
  arXiv  Detail & Related papers  (2021-10-25T06:18:55Z)
• Approximate Bayesian Computation with Path Signatures [0.5156484100374059]
  We introduce the use of path signatures as a natural candidate feature set for constructing distances between time series data. Our experiments show that such an approach can generate more accurate approximate Bayesian posteriors than existing techniques for time series models.
  arXiv  Detail & Related papers  (2021-06-23T17:25:43Z)
• Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles [86.9067793493874]
  We propose efficient mechanisms to characterize and generate testing scenarios using a state-of-the-art driving simulator. We use our method to characterize real driving data from the Next Generation Simulation (NGSIM) project. We rank the scenarios by defining metrics based on the complexity of avoiding accidents and provide insights into how the AV could have minimized the probability of incurring an accident.
  arXiv  Detail & Related papers  (2021-03-12T17:00:23Z)
• Behavioral Model Inference of Black-box Software using Deep Neural Networks [1.6593369275241105]
  Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software. Most existing inference approaches assume access to code to collect execution sequences. We show how this approach can be used to accurately detect state changes, and how the inferred models can be successfully applied to transfer-learning scenarios.
  arXiv  Detail & Related papers  (2021-01-13T09:23:37Z)
• Simulation-efficient marginal posterior estimation with swyft: stop wasting your precious time [5.533353383316288]
  We present algorithms for nested neural likelihood-to-evidence ratio estimation and simulation reuse. Together, these algorithms enable automatic and extremely simulator efficient estimation of marginal and joint posteriors.
  arXiv  Detail & Related papers  (2020-11-27T19:00:07Z)
• SMART: Simultaneous Multi-Agent Recurrent Trajectory Prediction [72.37440317774556]
  We propose advances that address two key challenges in future trajectory prediction. multimodality in both training data and predictions and constant time inference regardless of number of agents.
  arXiv  Detail & Related papers  (2020-07-26T08:17:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.