Guided Conditional Diffusion for Controllable Traffic Simulation
- URL: http://arxiv.org/abs/2210.17366v1
- Date: Mon, 31 Oct 2022 14:44:59 GMT
- Title: Guided Conditional Diffusion for Controllable Traffic Simulation
- Authors: Ziyuan Zhong, Davis Rempe, Danfei Xu, Yuxiao Chen, Sushant Veer, Tong
Che, Baishakhi Ray, Marco Pavone
- Abstract summary: Controllable and realistic traffic simulation is critical for developing and verifying autonomous vehicles.
Data-driven approaches generate realistic and human-like behaviors, improving transfer from simulated to real-world traffic.
We develop a conditional diffusion model for controllable traffic generation (CTG) that allows users to control desired properties of trajectories at test time.
- Score: 42.198185904248994
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Controllable and realistic traffic simulation is critical for developing and
verifying autonomous vehicles. Typical heuristic-based traffic models offer
flexible control to make vehicles follow specific trajectories and traffic
rules. On the other hand, data-driven approaches generate realistic and
human-like behaviors, improving transfer from simulated to real-world traffic.
However, to the best of our knowledge, no traffic model offers both
controllability and realism. In this work, we develop a conditional diffusion
model for controllable traffic generation (CTG) that allows users to control
desired properties of trajectories at test time (e.g., reach a goal or follow a
speed limit) while maintaining realism and physical feasibility through
enforced dynamics. The key technical idea is to leverage recent advances from
diffusion modeling and differentiable logic to guide generated trajectories to
meet rules defined using signal temporal logic (STL). We further extend
guidance to multi-agent settings and enable interaction-based rules like
collision avoidance. CTG is extensively evaluated on the nuScenes dataset for
diverse and composite rules, demonstrating improvement over strong baselines in
terms of the controllability-realism tradeoff.
Related papers
- Dragtraffic: A Non-Expert Interactive and Point-Based Controllable Traffic Scene Generation Framework [13.060332582669405]
Dragtraffic is a point-based, controllable traffic scene generation framework based on conditional diffusion.
It generates realistic driving scenarios for different types of traffic agents through an adaptive mixture expert architecture.
Experiments on a real-world driving dataset show that Dragtraffic outperforms existing methods in terms of authenticity, diversity, and freedom.
arXiv Detail & Related papers (2024-04-19T04:49:28Z) - Single-Agent Actor Critic for Decentralized Cooperative Driving [17.659812774579756]
We introduce a novel asymmetric actor-critic model aimed at learning decentralized cooperative driving policies for autonomous vehicles.
Our approach employs attention neural networks with masking to handle the dynamic nature of real-world traffic flow and partial observability.
arXiv Detail & Related papers (2024-03-18T16:13:02Z) - A Holistic Framework Towards Vision-based Traffic Signal Control with
Microscopic Simulation [53.39174966020085]
Traffic signal control (TSC) is crucial for reducing traffic congestion that leads to smoother traffic flow, reduced idling time, and mitigated CO2 emissions.
In this study, we explore the computer vision approach for TSC that modulates on-road traffic flows through visual observation.
We introduce a holistic traffic simulation framework called TrafficDojo towards vision-based TSC and its benchmarking.
arXiv Detail & Related papers (2024-03-11T16:42:29Z) - SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Controllable Adversaries [94.84458417662407]
We introduce SAFE-SIM, a novel diffusion-based controllable closed-loop safety-critical simulation framework.
We develop a novel approach to simulate safety-critical scenarios through an adversarial term in the denoising process.
We validate our framework empirically using the NuScenes dataset, demonstrating improvements in both realism and controllability.
arXiv Detail & Related papers (2023-12-31T04:14:43Z) - Language-Guided Traffic Simulation via Scene-Level Diffusion [46.47977644226296]
We present CTG++, a scene-level conditional diffusion model that can be guided by language instructions.
We first propose a scene-level diffusion model equipped with atemporal backbone which generates realistic and controllable traffic.
We then harness a large language model (LLM) to convert a users query into a loss function guiding the diffusion model towards query-compliant generation.
arXiv Detail & Related papers (2023-06-10T05:20:30Z) - TrafficBots: Towards World Models for Autonomous Driving Simulation and
Motion Prediction [149.5716746789134]
We show data-driven traffic simulation can be formulated as a world model.
We present TrafficBots, a multi-agent policy built upon motion prediction and end-to-end driving.
Experiments on the open motion dataset show TrafficBots can simulate realistic multi-agent behaviors.
arXiv Detail & Related papers (2023-03-07T18:28:41Z) - Objective-aware Traffic Simulation via Inverse Reinforcement Learning [31.26257563160961]
We formulate traffic simulation as an inverse reinforcement learning problem.
We propose a parameter sharing adversarial inverse reinforcement learning model for dynamics-robust simulation learning.
Our proposed model is able to imitate a vehicle's trajectories in the real world while simultaneously recovering the reward function.
arXiv Detail & Related papers (2021-05-20T07:26:34Z) - TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors [74.67698916175614]
We propose TrafficSim, a multi-agent behavior model for realistic traffic simulation.
In particular, we leverage an implicit latent variable model to parameterize a joint actor policy.
We show TrafficSim generates significantly more realistic and diverse traffic scenarios as compared to a diverse set of baselines.
arXiv Detail & Related papers (2021-01-17T00:29:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.