LibSignal: An Open Library for Traffic Signal Control
- URL: http://arxiv.org/abs/2211.10649v2
- Date: Wed, 29 Nov 2023 18:45:05 GMT
- Title: LibSignal: An Open Library for Traffic Signal Control
- Authors: Hao Mei, Xiaoliang Lei, Longchao Da, Bin Shi, Hua Wei
- Abstract summary: This paper introduces a library for cross-simulator comparison of reinforcement learning models in traffic signal control tasks.
It supports commonly-used simulators in traffic signal control tasks, including of Urban MObility(SUMO) and CityFlow.
This is the first time that these methods have been compared fairly under the same datasets with different simulators.
- Score: 8.290016666341755
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper introduces a library for cross-simulator comparison of
reinforcement learning models in traffic signal control tasks. This library is
developed to implement recent state-of-the-art reinforcement learning models
with extensible interfaces and unified cross-simulator evaluation metrics. It
supports commonly-used simulators in traffic signal control tasks, including
Simulation of Urban MObility(SUMO) and CityFlow, and multiple benchmark
datasets for fair comparisons. We conducted experiments to validate our
implementation of the models and to calibrate the simulators so that the
experiments from one simulator could be referential to the other. Based on the
validated models and calibrated environments, this paper compares and reports
the performance of current state-of-the-art RL algorithms across different
datasets and simulators. This is the first time that these methods have been
compared fairly under the same datasets with different simulators.
Related papers
- Autonomous Vehicle Controllers From End-to-End Differentiable Simulation [60.05963742334746]
We propose a differentiable simulator and design an analytic policy gradients (APG) approach to training AV controllers.
Our proposed framework brings the differentiable simulator into an end-to-end training loop, where gradients of environment dynamics serve as a useful prior to help the agent learn a more grounded policy.
We find significant improvements in performance and robustness to noise in the dynamics, as well as overall more intuitive human-like handling.
arXiv Detail & Related papers (2024-09-12T11:50:06Z) - SimGen: Simulator-conditioned Driving Scene Generation [50.03358485083602]
We introduce a simulator-conditioned scene generation framework called SimGen.
SimGen learns to generate diverse driving scenes by mixing data from the simulator and the real world.
It achieves superior generation quality and diversity while preserving controllability based on the text prompt and the layout pulled from a simulator.
arXiv Detail & Related papers (2024-06-13T17:58:32Z) - Correlation of Software-in-the-Loop Simulation with Physical Testing for Autonomous Driving [0.0]
This paper presents a case study on the validation of an in-house developed SIL simulation toolchain.
To align the test track runs with the SIL simulations, a synchronization approach is proposed.
Preliminary results are presented to demonstrate the effectiveness of the proposed validation process.
arXiv Detail & Related papers (2024-06-05T08:11:10Z) - CityFlowER: An Efficient and Realistic Traffic Simulator with Embedded
Machine Learning Models [25.567208505574072]
CityFlowER is an advanced simulator for efficient and realistic city-wide traffic simulation.
It pre-embeds Machine Learning models within the simulator, eliminating the need for external API interactions.
It offers unparalleled flexibility and efficiency, particularly in large-scale simulations.
arXiv Detail & Related papers (2024-02-09T01:19:41Z) - Purpose in the Machine: Do Traffic Simulators Produce Distributionally
Equivalent Outcomes for Reinforcement Learning Applications? [35.719833726363085]
This work focuses on two simulators commonly used to train reinforcement learning (RL) agents for traffic applications, CityFlow and SUMO.
A controlled virtual experiment varying driver behavior and simulation scale finds evidence against distributional equivalence in RL-relevant measures from these simulators.
While granular real-world validation generally remains infeasible, these findings suggest that traffic simulators are not a deus ex machina for RL training.
arXiv Detail & Related papers (2023-11-14T01:05:14Z) - Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous
Driving Research [76.93956925360638]
Waymax is a new data-driven simulator for autonomous driving in multi-agent scenes.
It runs entirely on hardware accelerators such as TPUs/GPUs and supports in-graph simulation for training.
We benchmark a suite of popular imitation and reinforcement learning algorithms with ablation studies on different design decisions.
arXiv Detail & Related papers (2023-10-12T20:49:15Z) - Synthetic Data-Based Simulators for Recommender Systems: A Survey [55.60116686945561]
This survey aims at providing a comprehensive overview of the recent trends in the field of modeling and simulation.
We start with the motivation behind the development of frameworks implementing the simulations -- simulators.
We provide a new consistent classification of existing simulators based on their functionality, approbation, and industrial effectiveness.
arXiv Detail & Related papers (2022-06-22T19:33:21Z) - Validation of Simulation-Based Testing: Bypassing Domain Shift with
Label-to-Image Synthesis [9.531148049378672]
We propose a novel framework consisting of a generative label-to-image synthesis model together with different transferability measures.
We validate our approach empirically on a semantic segmentation task on driving scenes.
Although the latter can distinguish between real-life and synthetic tests, in the former we observe surprisingly strong correlations of 0.7 for both cars and pedestrians.
arXiv Detail & Related papers (2021-06-10T07:23:58Z) - DriveGAN: Towards a Controllable High-Quality Neural Simulation [147.6822288981004]
We introduce a novel high-quality neural simulator referred to as DriveGAN.
DriveGAN achieves controllability by disentangling different components without supervision.
We train DriveGAN on multiple datasets, including 160 hours of real-world driving data.
arXiv Detail & Related papers (2021-04-30T15:30:05Z) - A User's Guide to Calibrating Robotics Simulators [54.85241102329546]
This paper proposes a set of benchmarks and a framework for the study of various algorithms aimed to transfer models and policies learnt in simulation to the real world.
We conduct experiments on a wide range of well known simulated environments to characterize and offer insights into the performance of different algorithms.
Our analysis can be useful for practitioners working in this area and can help make informed choices about the behavior and main properties of sim-to-real algorithms.
arXiv Detail & Related papers (2020-11-17T22:24:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.