Analyzing and Enhancing Closed-loop Stability in Reactive Simulation
- URL: http://arxiv.org/abs/2208.04559v1
- Date: Tue, 9 Aug 2022 06:31:35 GMT
- Title: Analyzing and Enhancing Closed-loop Stability in Reactive Simulation
- Authors: Wei-Jer Chang, Yeping Hu, Chenran Li, Wei Zhan, and Masayoshi Tomizuka
- Abstract summary: We propose a new reactive simulation framework to bridge the human behavior gap between simulation and real-world traffic scenarios.
We first propose a new reactive simulation framework, where the smoothness and consistency of the simulated state sequences are crucial factors to stability.
We then incorporate the kinematic vehicle model into the framework to improve the closed-loop stability of the reactive simulation.
- Score: 25.27603440925488
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Simulation has played an important role in efficiently evaluating
self-driving vehicles in terms of scalability. Existing methods mostly rely on
heuristic-based simulation, where traffic participants follow certain
human-encoded rules that fail to generate complex human behaviors. Therefore,
the reactive simulation concept is proposed to bridge the human behavior gap
between simulation and real-world traffic scenarios by leveraging real-world
data. However, these reactive models can easily generate unreasonable behaviors
after a few steps of simulation, where we regard the model as losing its
stability. To the best of our knowledge, no work has explicitly discussed and
analyzed the stability of the reactive simulation framework. In this paper, we
aim to provide a thorough stability analysis of the reactive simulation and
propose a solution to enhance the stability. Specifically, we first propose a
new reactive simulation framework, where we discover that the smoothness and
consistency of the simulated state sequences are crucial factors to stability.
We then incorporate the kinematic vehicle model into the framework to improve
the closed-loop stability of the reactive simulation. Furthermore, along with
commonly-used metrics, several novel metrics are proposed in this paper to
better analyze the simulation performance.
Related papers
- BeSimulator: A Large Language Model Powered Text-based Behavior Simulator [28.112491177744783]
We introduce BeSimulator as an attempt towards behavior simulation in the context of text-based environments.
BeSimulator can generalize across scenarios and achieve long-horizon complex simulation.
arXiv Detail & Related papers (2024-09-24T08:37:04Z) - SurroFlow: A Flow-Based Surrogate Model for Parameter Space Exploration and Uncertainty Quantification [17.175947741031674]
Existing deep learning-based surrogate models facilitate efficient data generation, but fall short in uncertainty quantification, efficient parameter space exploration, and reverse prediction.
We introduce SurroFlow, a novel normalizing flow-based surrogate model, to learn the invertible transformation between simulation parameters and simulation outputs.
Our framework significantly reduces the computational costs while enhancing the reliability and exploration capabilities of scientific surrogate models.
arXiv Detail & Related papers (2024-07-16T19:08:49Z) - SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework.
Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations.
We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
arXiv Detail & Related papers (2023-12-31T04:14:43Z) - DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via
Physics Simulation [81.11585774044848]
We present DeepSimHO, a novel deep-learning pipeline that combines forward physics simulation and backward gradient approximation with a neural network.
Our method noticeably improves the stability of the estimation and achieves superior efficiency over test-time optimization.
arXiv Detail & Related papers (2023-10-11T05:34:36Z) - Reinforcement Learning with Human Feedback for Realistic Traffic
Simulation [53.85002640149283]
Key element of effective simulation is the incorporation of realistic traffic models that align with human knowledge.
This study identifies two main challenges: capturing the nuances of human preferences on realism and the unification of diverse traffic simulation models.
arXiv Detail & Related papers (2023-09-01T19:29:53Z) - Perception Imitation: Towards Synthesis-free Simulator for Autonomous
Vehicles [45.27200446670184]
We propose a perception imitation method to simulate results of a certain perception model, and discuss a new route of autonomous driving simulator without data synthesis.
Experiments show that our method is effective to model the behavior of learning-based perception model, and can be further applied in the proposed simulation route smoothly.
arXiv Detail & Related papers (2023-04-19T01:27:02Z) - Simulation-based Bayesian inference for robotic grasping [6.218934678555297]
General robotic grippers are challenging to control because of their rich nonsmooth contact dynamics and the many sources of uncertainties due to the environment or sensor noise.
In this work, we demonstrate how to compute 6-DoF grasp poses using simulation-based Bayesian inference.
arXiv Detail & Related papers (2023-03-10T11:56:56Z) - Likelihood-Free Inference in State-Space Models with Unknown Dynamics [71.94716503075645]
We introduce a method for inferring and predicting latent states in state-space models where observations can only be simulated, and transition dynamics are unknown.
We propose a way of doing likelihood-free inference (LFI) of states and state prediction with a limited number of simulations.
arXiv Detail & Related papers (2021-11-02T12:33:42Z) - Deep Bayesian Active Learning for Accelerating Stochastic Simulation [74.58219903138301]
Interactive Neural Process (INP) is a deep active learning framework for simulations and with active learning approaches.
For active learning, we propose a novel acquisition function, Latent Information Gain (LIG), calculated in the latent space of NP based models.
The results demonstrate STNP outperforms the baselines in the learning setting and LIG achieves the state-of-the-art for active learning.
arXiv Detail & Related papers (2021-06-05T01:31:51Z) - Point Cloud Based Reinforcement Learning for Sim-to-Real and Partial
Observability in Visual Navigation [62.22058066456076]
Reinforcement Learning (RL) represents powerful tools to solve complex robotic tasks.
RL does not work directly in the real-world, which is known as the sim-to-real transfer problem.
We propose a method that learns on an observation space constructed by point clouds and environment randomization.
arXiv Detail & Related papers (2020-07-27T17:46:59Z) - DISCO: Double Likelihood-free Inference Stochastic Control [29.84276469617019]
We propose to leverage the power of modern simulators and recent techniques in Bayesian statistics for likelihood-free inference.
The posterior distribution over simulation parameters is propagated through a potentially non-analytical model of the system.
Experiments show that the controller proposed attained superior performance and robustness on classical control and robotics tasks.
arXiv Detail & Related papers (2020-02-18T05:29:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.