ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObility

• URL: http://arxiv.org/abs/2409.09040v1
• Date: Thu, 29 Aug 2024 03:59:11 GMT
• Title: ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObility
• Authors: Shuyang Li, Talha Azfar, Ruimin Ke,
• Abstract summary: Large Language Models (LLMs) are capable of handling multi-modal input and outputs such as text, voice, images, and video. We present ChatSUMO, a LLM-based agent that integrates language processing skills to generate abstract and real-world simulation scenarios. For simulation generation, we created a real-world simulation for the city of Albany with an accuracy of 96%.
• Score: 5.111204055180423
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large Language Models (LLMs), capable of handling multi-modal input and outputs such as text, voice, images, and video, are transforming the way we process information. Beyond just generating textual responses to prompts, they can integrate with different software platforms to offer comprehensive solutions across diverse applications. In this paper, we present ChatSUMO, a LLM-based agent that integrates language processing skills to generate abstract and real-world simulation scenarios in the widely-used traffic simulator - Simulation of Urban MObility (SUMO). Our methodology begins by leveraging the LLM for user input which converts to relevant keywords needed to run python scripts. These scripts are designed to convert specified regions into coordinates, fetch data from OpenStreetMap, transform it into a road network, and subsequently run SUMO simulations with the designated traffic conditions. The outputs of the simulations are then interpreted by the LLM resulting in informative comparisons and summaries. Users can continue the interaction and generate a variety of customized scenarios without prior traffic simulation expertise. For simulation generation, we created a real-world simulation for the city of Albany with an accuracy of 96\%. ChatSUMO also realizes the customizing of edge edit, traffic light optimization, and vehicle edit by users effectively.

Related papers

• Synthesizing Post-Training Data for LLMs through Multi-Agent Simulation [48.17611255751571]
  Post-training is essential for enabling large language models to follow human instructions. We leverage multi-agent simulation to automatically generate diverse text-based scenarios. We introduce a novel scenario-driven instruction generator MATRIX-Gen for controllable and highly realistic data synthesis.
  arXiv  Detail & Related papers  (2024-10-18T08:01:39Z)
• Generating Driving Simulations via Conversation [20.757088470174452]
  We design a natural language interface to assist a non-coding domain expert in synthesising the desired scenarios and vehicle behaviours. We show that using it to convert utterances to the symbolic program is feasible, despite the very small training dataset. Human experiments show that dialogue is critical to successful simulation generation, leading to a 4.5 times higher success rate than a generation without engaging in extended conversation.
  arXiv  Detail & Related papers  (2024-10-13T13:07:31Z)
• Promptable Closed-loop Traffic Simulation [57.36568236100507]
  ProSim is a multimodal promptable closed-loop traffic simulation framework. ProSim rolls out a traffic scenario in a closed-loop manner, modeling each agent's interaction with other traffic participants. To support research on promptable traffic simulation, we create ProSim-Instruct-520k, a multimodal prompt-scenario paired driving dataset.
  arXiv  Detail & Related papers  (2024-09-09T17:59:15Z)
• On Languaging a Simulation Engine [6.17566001699186]
  Lang2Sim is a language-to-simulation framework that enables interactive navigation on languaging a simulation engine. This work establishes language model as an intelligent platform to unlock the era of languaging a simulation engine.
  arXiv  Detail & Related papers  (2024-02-26T11:01:54Z)
• CityFlowER: An Efficient and Realistic Traffic Simulator with Embedded Machine Learning Models [25.567208505574072]
  CityFlowER is an advanced simulator for efficient and realistic city-wide traffic simulation. It pre-embeds Machine Learning models within the simulator, eliminating the need for external API interactions. It offers unparalleled flexibility and efficiency, particularly in large-scale simulations.
  arXiv  Detail & Related papers  (2024-02-09T01:19:41Z)
• Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents [49.11254369459406]
  ChatSim is the first system that enables editable photo-realistic 3D driving scene simulations via natural language commands with external digital assets. ChatSim employs a novel multi-camera neural field method to generate photo-realistic outcomes.
  arXiv  Detail & Related papers  (2024-02-08T15:26:28Z)
• Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research [76.93956925360638]
  Waymax is a new data-driven simulator for autonomous driving in multi-agent scenes. It runs entirely on hardware accelerators such as TPUs/GPUs and supports in-graph simulation for training. We benchmark a suite of popular imitation and reinforcement learning algorithms with ablation studies on different design decisions.
  arXiv  Detail & Related papers  (2023-10-12T20:49:15Z)
• TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction [149.5716746789134]
  We show data-driven traffic simulation can be formulated as a world model. We present TrafficBots, a multi-agent policy built upon motion prediction and end-to-end driving. Experiments on the open motion dataset show TrafficBots can simulate realistic multi-agent behaviors.
  arXiv  Detail & Related papers  (2023-03-07T18:28:41Z)
• TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors [74.67698916175614]
  We propose TrafficSim, a multi-agent behavior model for realistic traffic simulation. In particular, we leverage an implicit latent variable model to parameterize a joint actor policy. We show TrafficSim generates significantly more realistic and diverse traffic scenarios as compared to a diverse set of baselines.
  arXiv  Detail & Related papers  (2021-01-17T00:29:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.