EvoQRE: Modeling Bounded Rationality in Safety-Critical Traffic Simulation via Evolutionary Quantal Response Equilibrium
- URL: http://arxiv.org/abs/2601.05653v1
- Date: Fri, 09 Jan 2026 09:21:36 GMT
- Title: EvoQRE: Modeling Bounded Rationality in Safety-Critical Traffic Simulation via Evolutionary Quantal Response Equilibrium
- Abstract summary: EvoQRE is a principled framework for modeling safety-critical traffic interactions.<n>It integrates a pre-trained generative world model with entropy-regularized replicator dynamics.<n>It achieves state-of-the-art realism, improved safety metrics, and controllable generation of diverse safety-critical scenarios.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Existing traffic simulation frameworks for autonomous vehicles typically rely on imitation learning or game-theoretic approaches that solve for Nash or coarse correlated equilibria, implicitly assuming perfectly rational agents. However, human drivers exhibit bounded rationality, making approximately optimal decisions under cognitive and perceptual constraints. We propose EvoQRE, a principled framework for modeling safety-critical traffic interactions as general-sum Markov games solved via Quantal Response Equilibrium (QRE) and evolutionary game dynamics. EvoQRE integrates a pre-trained generative world model with entropy-regularized replicator dynamics, capturing stochastic human behavior while maintaining equilibrium structure. We provide rigorous theoretical results, proving that the proposed dynamics converge to Logit-QRE under a two-timescale stochastic approximation with an explicit convergence rate of O(log k / k^{1/3}) under weak monotonicity assumptions. We further extend QRE to continuous action spaces using mixture-based and energy-based policy representations. Experiments on the Waymo Open Motion Dataset and nuPlan benchmark demonstrate that EvoQRE achieves state-of-the-art realism, improved safety metrics, and controllable generation of diverse safety-critical scenarios through interpretable rationality parameters.
Related papers
- Stationary Robust Mean-Field Games under Model Mismatches [3.053409604085541]
This paper develops an infinite-horizon, stationary mean-field game framework.<n>It incorporates distributional model uncertainty directly into the population-coupled dynamics.<n>Under a contractive robust-dynamics regime, we obtain explicit non-asymptotic error bounds.
arXiv Detail & Related papers (2026-06-21T16:29:25Z) - LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning [90.86828952599147]
We present LaST-R1, a novel reinforcement learning framework designed to harness "latent reasoning-before-acting" policies.<n>LaST-R1 achieves a near-perfect 99.9% average success rate on the LIBERO benchmark.<n>In real-world deployments, LaST-R1 yields up to a 22.5% average improvement over SOTA supervised fine-tuning approach.
arXiv Detail & Related papers (2026-04-30T17:59:52Z) - Data is All You Need: Markov Chain Car-Following (MC-CF) Model [3.1154297715556964]
This paper introduces a new car-following modeling category called the empirical probabilistic paradigm.<n>Within this paradigm, we propose the Markov Chain Car-Following (MC-CF) model, which represents state transitions as a Markov process.<n> Evaluation of the MC-CF model trained on the Open Motion dataset (WOMD) demonstrates that its variants significantly outperform physics-based models.
arXiv Detail & Related papers (2026-03-29T23:33:24Z) - Learning Rollout from Sampling:An R1-Style Tokenized Traffic Simulation Model [21.835465637680798]
R1Sim represents an initial attempt to explore reinforcement learning based on motion token entropy patterns.<n>We introduce an entropy-guided adaptive sampling mechanism that focuses on previously overlooked motion tokens with high uncertainty yet high potential.<n>Overall, these components enable a balanced exploration-exploitation trade-off through diverse high-uncertainty sampling and group-wise comparative estimation.
arXiv Detail & Related papers (2026-03-26T03:29:46Z) - Towards Intelligible Human-Robot Interaction: An Active Inference Approach to Occluded Pedestrian Scenarios [17.074920390913995]
sudden appearance of occluded pedestrians presents a critical safety challenge in autonomous driving.<n>Conventional rule-based or purely data-driven approaches struggle with the inherent high uncertainty of these long-tail scenarios.<n>We propose a novel framework grounded in Active Inference, which endows the agent with a human-like, belief-driven mechanism.
arXiv Detail & Related papers (2026-02-26T15:22:07Z) - SPACeR: Self-Play Anchoring with Centralized Reference Models [50.55045557371374]
Sim agent policies are realistic, human-like, fast, and scalable in multi-agent settings.<n>Recent progress in imitation learning with large diffusion-based or tokenized models has shown that behaviors can be captured directly from human driving data.<n>We propose SPACeR, a framework that leverages a pretrained tokenized autoregressive motion model as a central reference policy.
arXiv Detail & Related papers (2025-10-20T19:53:02Z) - Drift No More? Context Equilibria in Multi-Turn LLM Interactions [58.69551510148673]
contexts drift is the gradual divergence of a model's outputs from goal-consistent behavior across turns.<n>Unlike single-turn errors, drift unfolds temporally and is poorly captured by static evaluation metrics.<n>We show that multi-turn drift can be understood as a controllable equilibrium phenomenon rather than as inevitable decay.
arXiv Detail & Related papers (2025-10-09T04:48:49Z) - STARec: An Efficient Agent Framework for Recommender Systems via Autonomous Deliberate Reasoning [54.28691219536054]
We introduce STARec, a slow-thinking augmented agent framework that endows recommender systems with autonomous deliberative reasoning capabilities.<n>We develop anchored reinforcement training - a two-stage paradigm combining structured knowledge distillation from advanced reasoning models with preference-aligned reward shaping.<n>Experiments on MovieLens 1M and Amazon CDs benchmarks demonstrate that STARec achieves substantial performance gains compared with state-of-the-art baselines.
arXiv Detail & Related papers (2025-08-26T08:47:58Z) - Game-Theoretic Modeling of Vehicle Unprotected Left Turns Considering Drivers' Bounded Rationality [17.5324678856791]
We propose a novel decision-making model for vehicle unprotected left-turn scenarios.<n>Our model integrates game theory with considerations for drivers' bounded rationality.<n>Our findings contribute valuable insights into the vehicle decision-making behaviors with bounded rationality.
arXiv Detail & Related papers (2025-07-02T02:22:11Z) - Beyond Patterns: Harnessing Causal Logic for Autonomous Driving Trajectory Prediction [10.21659221112514]
We introduce a novel trajectory prediction framework that leverages causal inference to enhance predictive robustness, generalization, and accuracy.<n>Our findings highlight the potential of causal reasoning to transform trajectory prediction, paving the way for robust autonomous driving systems.
arXiv Detail & Related papers (2025-05-11T05:56:07Z) - SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework.
Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations.
We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
arXiv Detail & Related papers (2023-12-31T04:14:43Z) - Analyzing and Enhancing Closed-loop Stability in Reactive Simulation [25.27603440925488]
We propose a new reactive simulation framework to bridge the human behavior gap between simulation and real-world traffic scenarios.
We first propose a new reactive simulation framework, where the smoothness and consistency of the simulated state sequences are crucial factors to stability.
We then incorporate the kinematic vehicle model into the framework to improve the closed-loop stability of the reactive simulation.
arXiv Detail & Related papers (2022-08-09T06:31:35Z) - Efficient Model-based Multi-agent Reinforcement Learning via Optimistic
Equilibrium Computation [93.52573037053449]
H-MARL (Hallucinated Multi-Agent Reinforcement Learning) learns successful equilibrium policies after a few interactions with the environment.
We demonstrate our approach experimentally on an autonomous driving simulation benchmark.
arXiv Detail & Related papers (2022-03-14T17:24:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.