Driving with Regulation: Interpretable Decision-Making for Autonomous Vehicles with Retrieval-Augmented Reasoning via LLM

• URL: http://arxiv.org/abs/2410.04759v1
• Date: Mon, 7 Oct 2024 05:27:22 GMT
• Title: Driving with Regulation: Interpretable Decision-Making for Autonomous Vehicles with Retrieval-Augmented Reasoning via LLM
• Authors: Tianhui Cai, Yifan Liu, Zewei Zhou, Haoxuan Ma, Seth Z. Zhao, Zhiwen Wu, Jiaqi Ma,
• Abstract summary: This work presents an interpretable decision-making framework for autonomous vehicles. We develop a Traffic Regulation Retrieval (TRR) Agent based on Retrieval-Augmented Generation (RAG) Given the semantic complexity of the retrieved rules, we also design a reasoning module powered by a Large Language Model (LLM)
• Score: 11.725133614445093
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This work presents an interpretable decision-making framework for autonomous vehicles that integrates traffic regulations, norms, and safety guidelines comprehensively and enables seamless adaptation to different regions. While traditional rule-based methods struggle to incorporate the full scope of traffic rules, we develop a Traffic Regulation Retrieval (TRR) Agent based on Retrieval-Augmented Generation (RAG) to automatically retrieve relevant traffic rules and guidelines from extensive regulation documents and relevant records based on the ego vehicle's situation. Given the semantic complexity of the retrieved rules, we also design a reasoning module powered by a Large Language Model (LLM) to interpret these rules, differentiate between mandatory rules and safety guidelines, and assess actions on legal compliance and safety. Additionally, the reasoning is designed to be interpretable, enhancing both transparency and reliability. The framework demonstrates robust performance on both hypothesized and real-world cases across diverse scenarios, along with the ability to adapt to different regions with ease.

Related papers

• Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework [79.088116316919]
  Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. This paper proposes CoDrivingLLM, an interactive and learnable LLM-driven cooperative driving framework.
  arXiv  Detail & Related papers  (2024-09-19T14:36:00Z)
• TR2MTL: LLM based framework for Metric Temporal Logic Formalization of Traffic Rules [0.0]
  TR2MTL is a framework that employs large language models (LLMs) to automatically translate traffic rules into metric temporal logic (MTL) It is envisioned as a human-in-loop system for AV rule formalization. It can be extended to various forms of temporal logic and rules.
  arXiv  Detail & Related papers  (2024-06-09T09:55:04Z)
• Provable Traffic Rule Compliance in Safe Reinforcement Learning on the Open Sea [8.017543518311196]
  Reinforcement learning (RL) is a promising method to find motion plans for autonomous vehicles. Our approach accomplishes guaranteed rule-compliance by integrating temporal logic specifications into RL. In numerical evaluations on critical maritime traffic situations, our agent always complies with the formalized legal rules and never collides.
  arXiv  Detail & Related papers  (2024-02-13T14:59:19Z)
• Empowering Autonomous Driving with Large Language Models: A Safety Perspective [82.90376711290808]
  This paper explores the integration of Large Language Models (LLMs) into Autonomous Driving systems. LLMs are intelligent decision-makers in behavioral planning, augmented with a safety verifier shield for contextual safety learning. We present two key studies in a simulated environment: an adaptive LLM-conditioned Model Predictive Control (MPC) and an LLM-enabled interactive behavior planning scheme with a state machine.
  arXiv  Detail & Related papers  (2023-11-28T03:13:09Z)
• Guided Conditional Diffusion for Controllable Traffic Simulation [42.198185904248994]
  Controllable and realistic traffic simulation is critical for developing and verifying autonomous vehicles. Data-driven approaches generate realistic and human-like behaviors, improving transfer from simulated to real-world traffic. We develop a conditional diffusion model for controllable traffic generation (CTG) that allows users to control desired properties of trajectories at test time.
  arXiv  Detail & Related papers  (2022-10-31T14:44:59Z)
• Advising Autonomous Cars about the Rules of the Road [0.0]
  (R)ules (o)f (T)he (R)oad (A)dvisor) provides recommended and possible actions to be generated from a set of human-level rules. We use RoTRA to formalise and implement the UK "Rules of the Road"
  arXiv  Detail & Related papers  (2022-09-28T12:22:59Z)
• Towards formalization and monitoring of microscopic traffic parameters using temporal logic [1.3706331473063877]
  We develop specification-based monitoring for the analysis of traffic networks using the formal language Signal Temporal Logic. We develop monitors that identify safety-related behavior such as conforming to speed limits and maintaining appropriate headway. This work can be utilized by traffic management centers to study the traffic stream properties, identify possible hazards, and provide valuable feedback for automating the traffic monitoring systems.
  arXiv  Detail & Related papers  (2021-10-12T17:59:26Z)
• End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learning [63.56464608571663]
  Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. In this work, we focus on the implementation of a system able to navigate through intersections where only traffic signs are provided. We propose a multi-agent system using a continuous, model-free Deep Reinforcement Learning algorithm used to train a neural network for predicting both the acceleration and the steering angle at each time step.
  arXiv  Detail & Related papers  (2021-04-28T07:54:40Z)
• Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learning [55.41644538483948]
  Current approaches either do not generalize well beyond the training data or are not capable to consider a variable number of traffic participants. We propose an invariant environment representation from the perspective of the ego vehicle. We show that the agents are capable to generalize successfully to unseen scenarios, due to the abstraction.
  arXiv  Detail & Related papers  (2021-02-12T20:37:29Z)
• MetaVIM: Meta Variationally Intrinsic Motivated Reinforcement Learning for Decentralized Traffic Signal Control [54.162449208797334]
  Traffic signal control aims to coordinate traffic signals across intersections to improve the traffic efficiency of a district or a city. Deep reinforcement learning (RL) has been applied to traffic signal control recently and demonstrated promising performance where each traffic signal is regarded as an agent. We propose a novel Meta Variationally Intrinsic Motivated (MetaVIM) RL method to learn the decentralized policy for each intersection that considers neighbor information in a latent way.
  arXiv  Detail & Related papers  (2021-01-04T03:06:08Z)
• Emergent Road Rules In Multi-Agent Driving Environments [84.82583370858391]
  We analyze what ingredients in driving environments cause the emergence of road rules. We find that two crucial factors are noisy perception and agents' spatial density. Our results add empirical support for the social road rules that countries worldwide have agreed on for safe, efficient driving.
  arXiv  Detail & Related papers  (2020-11-21T09:43:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.