Learning Latent Traits for Simulated Cooperative Driving Tasks
- URL: http://arxiv.org/abs/2207.09619v1
- Date: Wed, 20 Jul 2022 02:27:18 GMT
- Title: Learning Latent Traits for Simulated Cooperative Driving Tasks
- Authors: Jonathan A. DeCastro, Deepak Gopinath, Guy Rosman, Emily Sumner,
Shabnam Hakimi, Simon Stent
- Abstract summary: We build a framework capable of capturing a compact latent representation of the human in terms of their behavior and preferences.
We then build a lightweight simulation environment, HMIway-env, for modelling one form of distracted driving behavior.
We finally use this environment to quantify both the ability to discriminate drivers and the effectiveness of intervention policies.
- Score: 10.009803620912777
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: To construct effective teaming strategies between humans and AI systems in
complex, risky situations requires an understanding of individual preferences
and behaviors of humans. Previously this problem has been treated in
case-specific or data-agnostic ways. In this paper, we build a framework
capable of capturing a compact latent representation of the human in terms of
their behavior and preferences based on data from a simulated population of
drivers. Our framework leverages, to the extent available, knowledge of
individual preferences and types from samples within the population to deploy
interaction policies appropriate for specific drivers. We then build a
lightweight simulation environment, HMIway-env, for modelling one form of
distracted driving behavior, and use it to generate data for different driver
types and train intervention policies. We finally use this environment to
quantify both the ability to discriminate drivers and the effectiveness of
intervention policies.
Related papers
- IntervenGen: Interventional Data Generation for Robust and Data-Efficient Robot Imitation Learning [43.19346528232497]
A popular approach for increasing policy robustness to distribution shift is interactive imitation learning.
We propose IntervenGen, a novel data generation system that can autonomously produce a large set of corrective interventions.
We show that it can increase policy robustness by up to 39x with only 10 human interventions.
arXiv Detail & Related papers (2024-05-02T17:06:19Z) - Interactive Autonomous Navigation with Internal State Inference and
Interactivity Estimation [58.21683603243387]
We propose three auxiliary tasks with relational-temporal reasoning and integrate them into the standard Deep Learning framework.
These auxiliary tasks provide additional supervision signals to infer the behavior patterns other interactive agents.
Our approach achieves robust and state-of-the-art performance in terms of standard evaluation metrics.
arXiv Detail & Related papers (2023-11-27T18:57:42Z) - TrafficBots: Towards World Models for Autonomous Driving Simulation and
Motion Prediction [149.5716746789134]
We show data-driven traffic simulation can be formulated as a world model.
We present TrafficBots, a multi-agent policy built upon motion prediction and end-to-end driving.
Experiments on the open motion dataset show TrafficBots can simulate realistic multi-agent behaviors.
arXiv Detail & Related papers (2023-03-07T18:28:41Z) - Augmented Driver Behavior Models for High-Fidelity Simulation Study of
Crash Detection Algorithms [2.064612766965483]
We present a simulation platform for a hybrid transportation system that includes both human-driven and automated vehicles.
We decompose the human driving task and offer a modular approach to simulating a large-scale traffic scenario.
We analyze a large driving dataset to extract expressive parameters that would best describe different driving characteristics.
arXiv Detail & Related papers (2022-08-10T19:59:16Z) - Learning Interactive Driving Policies via Data-driven Simulation [125.97811179463542]
Data-driven simulators promise high data-efficiency for driving policy learning.
Small underlying datasets often lack interesting and challenging edge cases for learning interactive driving.
We propose a simulation method that uses in-painted ado vehicles for learning robust driving policies.
arXiv Detail & Related papers (2021-11-23T20:14:02Z) - Calibration of Human Driving Behavior and Preference Using Naturalistic
Traffic Data [5.926030548326619]
We show how the model can be inverted to estimate driver preferences from naturalistic traffic data.
One distinct advantage of our approach is the drastically reduced computational burden.
arXiv Detail & Related papers (2021-05-05T01:20:03Z) - Generating and Characterizing Scenarios for Safety Testing of Autonomous
Vehicles [86.9067793493874]
We propose efficient mechanisms to characterize and generate testing scenarios using a state-of-the-art driving simulator.
We use our method to characterize real driving data from the Next Generation Simulation (NGSIM) project.
We rank the scenarios by defining metrics based on the complexity of avoiding accidents and provide insights into how the AV could have minimized the probability of incurring an accident.
arXiv Detail & Related papers (2021-03-12T17:00:23Z) - TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors [74.67698916175614]
We propose TrafficSim, a multi-agent behavior model for realistic traffic simulation.
In particular, we leverage an implicit latent variable model to parameterize a joint actor policy.
We show TrafficSim generates significantly more realistic and diverse traffic scenarios as compared to a diverse set of baselines.
arXiv Detail & Related papers (2021-01-17T00:29:30Z) - Risk-Sensitive Sequential Action Control with Multi-Modal Human
Trajectory Forecasting for Safe Crowd-Robot Interaction [55.569050872780224]
We present an online framework for safe crowd-robot interaction based on risk-sensitive optimal control, wherein the risk is modeled by the entropic risk measure.
Our modular approach decouples the crowd-robot interaction into learning-based prediction and model-based control.
A simulation study and a real-world experiment show that the proposed framework can accomplish safe and efficient navigation while avoiding collisions with more than 50 humans in the scene.
arXiv Detail & Related papers (2020-09-12T02:02:52Z) - Deep Reinforcement Learning for Human-Like Driving Policies in Collision
Avoidance Tasks of Self-Driving Cars [1.160208922584163]
We introduce a model-free, deep reinforcement learning approach to generate automated human-like driving policies.
We study a static obstacle avoidance task on a two-lane highway road in simulation.
We demonstrate that our approach leads to human-like driving policies.
arXiv Detail & Related papers (2020-06-07T18:20:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.