Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Driving

• URL: http://arxiv.org/abs/2311.11056v2
• Date: Tue, 26 Dec 2023 10:28:36 GMT
• Title: Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Driving
• Authors: Yueyuan Li, Wei Yuan, Songan Zhang, Weihao Yan, Qiyuan Shen, Chunxiang Wang, Ming Yang
• Abstract summary: There is a growing concern about the validity of algorithms developed and evaluated in simulators. This paper analyzes the evolution of simulators and explains how the functionalities and utilities have developed. Recommendations for select simulators are presented, considering factors such as accessibility, maintenance status, and quality.
• Score: 25.320362844415012
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Simulators play a crucial role in autonomous driving, offering significant time, cost, and labor savings. Over the past few years, the number of simulators for autonomous driving has grown substantially. However, there is a growing concern about the validity of algorithms developed and evaluated in simulators, indicating a need for a thorough analysis of the development status of the simulators. To bridge the gap in research, this paper analyzes the evolution of simulators and explains how the functionalities and utilities have developed. Then, the existing simulators are categorized based on their task applicability, providing researchers with a taxonomy to swiftly assess a simulator's suitability for specific tasks. Recommendations for select simulators are presented, considering factors such as accessibility, maintenance status, and quality. Recognizing potential hazards in simulators that could impact the confidence of simulation experiments, the paper dedicates substantial effort to identifying and justifying critical issues in actively maintained open-source simulators. Moreover, the paper reviews potential solutions to address these issues, serving as a guide for enhancing the credibility of simulators.

Related papers

• BeSimulator: A Large Language Model Powered Text-based Behavior Simulator [28.112491177744783]
  We introduce BeSimulator as an attempt towards behavior simulation in the context of text-based environments. BeSimulator can generalize across scenarios and achieve long-horizon complex simulation.
  arXiv  Detail & Related papers  (2024-09-24T08:37:04Z)
• KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants [3.724713116252253]
  An effective instruction-following assistant can be developed by creating a simulator that can generate useful interaction data. Previous user simulators generally lacked diversity, were mostly closed domain, and necessitated rigid schema. We introduce Kaucus, a Knowledge-Augmented User Simulator framework, to outline a process of creating diverse user simulators.
  arXiv  Detail & Related papers  (2024-01-29T06:57:02Z)
• GarchingSim: An Autonomous Driving Simulator with Photorealistic Scenes and Minimalist Workflow [24.789118651720045]
  We introduce an autonomous driving simulator with photorealistic scenes. The simulator is able to communicate with external algorithms through ROS2 or Socket.IO. We implement a highly accurate vehicle dynamics model within the simulator to enhance the realism of the vehicle's physical effects.
  arXiv  Detail & Related papers  (2024-01-28T23:26:15Z)
• Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research [76.93956925360638]
  Waymax is a new data-driven simulator for autonomous driving in multi-agent scenes. It runs entirely on hardware accelerators such as TPUs/GPUs and supports in-graph simulation for training. We benchmark a suite of popular imitation and reinforcement learning algorithms with ablation studies on different design decisions.
  arXiv  Detail & Related papers  (2023-10-12T20:49:15Z)
• Two is Better Than One: Digital Siblings to Improve Autonomous Driving Testing [10.518360486008964]
  We introduce the notion of digital siblings, a multi-simulator approach that tests a given autonomous vehicle on multiple general-purpose simulators. We empirically compare such a multi-simulator approach against a digital twin of a physical scaled autonomous vehicle on a large set of test cases. Our empirical evaluation shows that the ensemble failure predictor by the digital siblings is superior to each individual simulator at predicting the failures of the digital twin.
  arXiv  Detail & Related papers  (2023-05-14T04:10:56Z)
• Synthetic Data-Based Simulators for Recommender Systems: A Survey [55.60116686945561]
  This survey aims at providing a comprehensive overview of the recent trends in the field of modeling and simulation. We start with the motivation behind the development of frameworks implementing the simulations -- simulators. We provide a new consistent classification of existing simulators based on their functionality, approbation, and industrial effectiveness.
  arXiv  Detail & Related papers  (2022-06-22T19:33:21Z)
• DriveGAN: Towards a Controllable High-Quality Neural Simulation [147.6822288981004]
  We introduce a novel high-quality neural simulator referred to as DriveGAN. DriveGAN achieves controllability by disentangling different components without supervision. We train DriveGAN on multiple datasets, including 160 hours of real-world driving data.
  arXiv  Detail & Related papers  (2021-04-30T15:30:05Z)
• Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles [86.9067793493874]
  We propose efficient mechanisms to characterize and generate testing scenarios using a state-of-the-art driving simulator. We use our method to characterize real driving data from the Next Generation Simulation (NGSIM) project. We rank the scenarios by defining metrics based on the complexity of avoiding accidents and provide insights into how the AV could have minimized the probability of incurring an accident.
  arXiv  Detail & Related papers  (2021-03-12T17:00:23Z)
• A User's Guide to Calibrating Robotics Simulators [54.85241102329546]
  This paper proposes a set of benchmarks and a framework for the study of various algorithms aimed to transfer models and policies learnt in simulation to the real world. We conduct experiments on a wide range of well known simulated environments to characterize and offer insights into the performance of different algorithms. Our analysis can be useful for practitioners working in this area and can help make informed choices about the behavior and main properties of sim-to-real algorithms.
  arXiv  Detail & Related papers  (2020-11-17T22:24:26Z)
• Point Cloud Based Reinforcement Learning for Sim-to-Real and Partial Observability in Visual Navigation [62.22058066456076]
  Reinforcement Learning (RL) represents powerful tools to solve complex robotic tasks. RL does not work directly in the real-world, which is known as the sim-to-real transfer problem. We propose a method that learns on an observation space constructed by point clouds and environment randomization.
  arXiv  Detail & Related papers  (2020-07-27T17:46:59Z)
• LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving [1.1742615451804794]
  We introduce the LGSVL Simulator which is a high fidelity simulator for autonomous driving. The simulator engine provides end-to-end, full-stack simulation which is ready to be hooked up to Autoware and Apollo.
  arXiv  Detail & Related papers  (2020-05-07T21:57:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.