LEADER: Learning Attention over Driving Behaviors for Planning under Uncertainty

• URL: http://arxiv.org/abs/2209.11422v1
• Date: Fri, 23 Sep 2022 05:42:04 GMT
• Title: LEADER: Learning Attention over Driving Behaviors for Planning under Uncertainty
• Authors: Mohamad H. Danesh and Panpan Cai and David Hsu
• Abstract summary: Uncertainty on human behaviors poses a significant challenge to autonomous driving in crowded urban environments. We propose an algorithm, LEarning Attention over Driving bEhavioRs, that learns to attend to critical human behaviors during planning.
• Score: 20.408934362272163
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Uncertainty on human behaviors poses a significant challenge to autonomous driving in crowded urban environments. The partially observable Markov decision processes (POMDPs) offer a principled framework for planning under uncertainty, often leveraging Monte Carlo sampling to achieve online performance for complex tasks. However, sampling also raises safety concerns by potentially missing critical events. To address this, we propose a new algorithm, LEarning Attention over Driving bEhavioRs (LEADER), that learns to attend to critical human behaviors during planning. LEADER learns a neural network generator to provide attention over human behaviors in real-time situations. It integrates the attention into a belief-space planner, using importance sampling to bias reasoning towards critical events. To train the algorithm, we let the attention generator and the planner form a min-max game. By solving the min-max game, LEADER learns to perform risk-aware planning without human labeling.

Related papers

• Estimating cognitive biases with attention-aware inverse planning [9.400837486470015]
  People's goal-directed behaviors are influenced by their cognitive biases.<n>In inverse planning, the goal is to estimate a person's attentional biases from their actions.<n>We present an approach to attention-aware inverse planning that combines deep reinforcement learning with computational cognitive modeling.
  arXiv  Detail & Related papers  (2025-10-29T20:50:04Z)
• Where, What, Why: Towards Explainable Driver Attention Prediction [28.677786362573638]
  We introduce Explainable Driver Attention Prediction, a novel task paradigm that jointly predicts spatial attention regions (where), parses attended semantics (what), and provides cognitive reasoning for attention allocation (why)<n>We propose LLada, a Large Language model-driven framework for driver attention prediction, which unifies pixel modeling, semantic parsing, and cognitive reasoning within an end-to-end architecture.<n>This work serves as a key step toward a deeper understanding of driver attention mechanisms, with significant implications for autonomous driving, intelligent driver training, and human-computer interaction.
  arXiv  Detail & Related papers  (2025-06-29T04:59:39Z)
• LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios [23.913788819453796]
  LiloDriver is a lifelong learning framework for closed-loop motion planning in long-tail autonomous driving scenarios.<n>It features a four-stage architecture including perception, scene encoding, memory-based strategy refinement, and LLM-guided reasoning.<n>Our results highlight the effectiveness of combining structured memory and LLM reasoning to enable scalable, human-like motion planning in real-world autonomous driving.
  arXiv  Detail & Related papers  (2025-05-22T18:33:08Z)
• Centaur: Robust End-to-End Autonomous Driving with Test-Time Training [84.78837437133234]
  We propose Centaur, which updates a planner's behavior via test-time training without relying on hand-engineered rules or cost functions. We develop a novel uncertainty measure, called Cluster Entropy, which is simple, interpretable, and compatible with state-of-the-art planning algorithms.
  arXiv  Detail & Related papers  (2025-03-14T17:59:41Z)
• Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities [33.853994070508485]
  We focus on Curriculum Learning (CL), Human-In-The-Loop Reinforcement Learning (HITL-RL), Active Learning (AL), and ethical principles. In CL, human experts systematically train ML models by starting with simple tasks and gradually progressing to more difficult ones. HITL-RL significantly enhances the RL process by incorporating human input through techniques like reward shaping, action injection, and interactive learning. AL streamlines the annotation process by targeting specific instances that need to be labeled with human oversight.
  arXiv  Detail & Related papers  (2024-08-22T17:02:29Z)
• Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness [34.77182116081535]
  Integrated task and motion planning (TAMP) has proven to be a valuable approach to generalizable long-horizon robotic manipulation and navigation problems. These assumptions limit the ability of the planner to gather information and make decisions that are risk-aware. We propose a strategy for TAMP with Uncertainty and Risk Awareness (TAMPURA) that is capable of efficiently solving long-horizon planning problems with initial-state and action outcome uncertainty.
  arXiv  Detail & Related papers  (2024-03-15T16:42:14Z)
• Behavioral Intention Prediction in Driving Scenes: A Survey [70.53285924851767]
  Behavioral Intention Prediction (BIP) simulates a human consideration process and fulfills the early prediction of specific behaviors. This work provides a comprehensive review of BIP from the available datasets, key factors and challenges, pedestrian-centric and vehicle-centric BIP approaches, and BIP-aware applications.
  arXiv  Detail & Related papers  (2022-11-01T11:07:37Z)
• Important Object Identification with Semi-Supervised Learning for Autonomous Driving [37.654878298744855]
  We propose a novel approach for important object identification in egocentric driving scenarios. We present a semi-supervised learning pipeline to enable the model to learn from unlimited unlabeled data. Our approach also outperforms rule-based baselines by a large margin.
  arXiv  Detail & Related papers  (2022-03-05T01:23:13Z)
• Learning to Be Cautious [71.9871661858886]
  A key challenge in the field of reinforcement learning is to develop agents that behave cautiously in novel situations. We present a sequence of tasks where cautious behavior becomes increasingly non-obvious, as well as an algorithm to demonstrate that it is possible for a system to emphlearn to be cautious.
  arXiv  Detail & Related papers  (2021-10-29T16:52:45Z)
• How To Not Drive: Learning Driving Constraints from Demonstration [0.0]
  We propose a new scheme to learn motion planning constraints from human driving trajectories. The behavioral planning is responsible for high-level decision making required to follow traffic rules. The motion planner role is to generate feasible, safe trajectories for a self-driving vehicle to follow.
  arXiv  Detail & Related papers  (2021-10-01T20:47:04Z)
• Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Models [82.34305824719101]
  Humans have a remarkable ability to make decisions by accurately reasoning about future events. We develop a general-purpose contingency planner that is learned end-to-end using high-dimensional scene observations. We show how this model can tractably learn contingencies from behavioral observations.
  arXiv  Detail & Related papers  (2021-04-21T14:30:20Z)
• IntentNet: Learning to Predict Intention from Raw Sensor Data [86.74403297781039]
  In this paper, we develop a one-stage detector and forecaster that exploits both 3D point clouds produced by a LiDAR sensor as well as dynamic maps of the environment. Our multi-task model achieves better accuracy than the respective separate modules while saving computation, which is critical to reducing reaction time in self-driving applications.
  arXiv  Detail & Related papers  (2021-01-20T00:31:52Z)
• Deep Structured Reactive Planning [94.92994828905984]
  We propose a novel data-driven, reactive planning objective for self-driving vehicles. We show that our model outperforms a non-reactive variant in successfully completing highly complex maneuvers.
  arXiv  Detail & Related papers  (2021-01-18T01:43:36Z)
• Attention-Based Planning with Active Perception [21.35365462532568]
  This paper develops a computational model of attention and an algorithm for attention-based probabilistic planning in Markov decision processes. By switching between different attention modes, the robot actively perceives task-relevant information to reduce the cost of information acquisition and processing, while achieving near-optimal task performance.
  arXiv  Detail & Related papers  (2020-11-30T19:07:28Z)
• Perceive, Attend, and Drive: Learning Spatial Attention for Safe Self-Driving [84.59201486239908]
  We propose an end-to-end self-driving network featuring a sparse attention module that learns to automatically attend to important regions of the input. The attention module specifically targets motion planning, whereas prior literature only applied attention in perception tasks.
  arXiv  Detail & Related papers  (2020-11-02T17:47:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.