A taxonomy of strategic human interactions in traffic conflicts
- URL: http://arxiv.org/abs/2109.13367v2
- Date: Wed, 29 Sep 2021 14:41:11 GMT
- Title: A taxonomy of strategic human interactions in traffic conflicts
- Authors: Atrisha Sarkar, Kate Larson, Krzysztof Czarnecki
- Abstract summary: We develop a taxonomy for strategic interactions based on patterns of interaction in traffic conflicts.
We demonstrate a process of automatic mapping of strategies generated by a strategic planner to the categories in the taxonomy.
We evaluate two popular solution concepts used in strategic planning in AVs, QLk and Subgame perfect $epsilon$-Nash Equilibrium.
- Score: 13.415452801139843
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In order to enable autonomous vehicles (AV) to navigate busy traffic
situations, in recent years there has been a focus on game-theoretic models for
strategic behavior planning in AVs. However, a lack of common taxonomy impedes
a broader understanding of the strategies the models generate as well as the
development of safety specification to identity what strategies are safe for an
AV to execute. Based on common patterns of interaction in traffic conflicts, we
develop a taxonomy for strategic interactions along the dimensions of agents'
initial response to right-of-way rules and subsequent response to other agents'
behavior. Furthermore, we demonstrate a process of automatic mapping of
strategies generated by a strategic planner to the categories in the taxonomy,
and based on vehicle-vehicle and vehicle-pedestrian interaction simulation, we
evaluate two popular solution concepts used in strategic planning in AVs, QLk
and Subgame perfect $\epsilon$-Nash Equilibrium, with respect to those
categories.
Related papers
- Mutual-modality Adversarial Attack with Semantic Perturbation [81.66172089175346]
We propose a novel approach that generates adversarial attacks in a mutual-modality optimization scheme.
Our approach outperforms state-of-the-art attack methods and can be readily deployed as a plug-and-play solution.
arXiv Detail & Related papers (2023-12-20T05:06:01Z) - Interactive Autonomous Navigation with Internal State Inference and
Interactivity Estimation [58.21683603243387]
We propose three auxiliary tasks with relational-temporal reasoning and integrate them into the standard Deep Learning framework.
These auxiliary tasks provide additional supervision signals to infer the behavior patterns other interactive agents.
Our approach achieves robust and state-of-the-art performance in terms of standard evaluation metrics.
arXiv Detail & Related papers (2023-11-27T18:57:42Z) - Interaction-Aware Decision-Making for Autonomous Vehicles in Forced
Merging Scenario Leveraging Social Psychology Factors [7.812717451846781]
We consider a behavioral model that incorporates both social behaviors and personal objectives of the interacting drivers.
We develop a receding-horizon control-based decision-making strategy that estimates online the other drivers' intentions.
arXiv Detail & Related papers (2023-09-25T19:49:14Z) - Learning Near-Optimal Intrusion Responses Against Dynamic Attackers [0.0]
We study automated intrusion response and formulate the interaction between an attacker and a defender as an optimal stopping game.
To obtain near-optimal defender strategies, we develop a fictitious self-play algorithm that learns Nashlibria through approximation.
We argue that this approach can produce effective defender strategies for a practical IT infrastructure.
arXiv Detail & Related papers (2023-01-11T16:36:24Z) - AdvDO: Realistic Adversarial Attacks for Trajectory Prediction [87.96767885419423]
Trajectory prediction is essential for autonomous vehicles to plan correct and safe driving behaviors.
We devise an optimization-based adversarial attack framework to generate realistic adversarial trajectories.
Our attack can lead an AV to drive off road or collide into other vehicles in simulation.
arXiv Detail & Related papers (2022-09-19T03:34:59Z) - Strategic Decision-Making in the Presence of Information Asymmetry:
Provably Efficient RL with Algorithmic Instruments [55.41685740015095]
We study offline reinforcement learning under a novel model called strategic MDP.
We propose a novel algorithm, Pessimistic policy Learning with Algorithmic iNstruments (PLAN)
arXiv Detail & Related papers (2022-08-23T15:32:44Z) - Deep Interactive Motion Prediction and Planning: Playing Games with
Motion Prediction Models [162.21629604674388]
This work presents a game-theoretic Model Predictive Controller (MPC) that uses a novel interactive multi-agent neural network policy as part of its predictive model.
Fundamental to the success of our method is the design of a novel multi-agent policy network that can steer a vehicle given the state of the surrounding agents and the map information.
arXiv Detail & Related papers (2022-04-05T17:58:18Z) - Generalized dynamic cognitive hierarchy models for strategic driving
behavior [13.415452801139843]
We develop a framework of generalized dynamic cognitive hierarchy for both modelling naturalistic human driving behavior and behavior planning for autonomous vehicles.
Based on evaluation on two large naturalistic datasets, we show that automata strategies are well suited for level-0 behavior in a dynamic level-k framework.
arXiv Detail & Related papers (2021-09-20T21:49:52Z) - Learning Interaction-aware Guidance Policies for Motion Planning in
Dense Traffic Scenarios [8.484564880157148]
This paper presents a novel framework for interaction-aware motion planning in dense traffic scenarios.
We propose to learn, via deep Reinforcement Learning (RL), an interaction-aware policy providing global guidance about the cooperativeness of other vehicles.
The learned policy can reason and guide the local optimization-based planner with interactive behavior to pro-actively merge in dense traffic while remaining safe in case the other vehicles do not yield.
arXiv Detail & Related papers (2021-07-09T16:43:12Z) - What-If Motion Prediction for Autonomous Driving [58.338520347197765]
Viable solutions must account for both the static geometric context, such as road lanes, and dynamic social interactions arising from multiple actors.
We propose a recurrent graph-based attentional approach with interpretable geometric (actor-lane) and social (actor-actor) relationships.
Our model can produce diverse predictions conditioned on hypothetical or "what-if" road lanes and multi-actor interactions.
arXiv Detail & Related papers (2020-08-24T17:49:30Z) - Reinforcement Learning-Enabled Decision-Making Strategies for a
Vehicle-Cyber-Physical-System in Connected Environment [9.61519028373031]
This paper focuses on discussing the decision-making (DM) strategy for autonomous vehicles in a connected environment.
Two classical reinforcement learning (RL) algorithms, Q-learning and Dyna, are leveraged to derive the DM strategies.
The control performance of the derived DM policies in safety and efficiency is analyzed.
arXiv Detail & Related papers (2020-07-16T14:37:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.