Pedestrian Models for Autonomous Driving Part II: High-Level Models of Human Behavior

• URL: http://arxiv.org/abs/2003.11959v2
• Date: Mon, 20 Jul 2020 14:48:59 GMT
• Title: Pedestrian Models for Autonomous Driving Part II: High-Level Models of Human Behavior
• Authors: Fanta Camara, Nicola Bellotto, Serhan Cosar, Florian Weber, Dimitris Nathanael, Matthias Althoff, Jingyuan Wu, Johannes Ruenz, Andr\'e Dietrich, Gustav Markkula, Anna Schieben, Fabio Tango, Natasha Merat and Charles W. Fox
• Abstract summary: Planning autonomous vehicles in the presence of pedestrians requires modelling of their probable future behaviour. This survey clearly shows that, although there are good models for optimal walking behaviour, high-level psychological and social modelling of pedestrian behaviour still remains an open research question.
• Score: 12.627716603026391
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Autonomous vehicles (AVs) must share space with pedestrians, both in carriageway cases such as cars at pedestrian crossings and off-carriageway cases such as delivery vehicles navigating through crowds on pedestrianized high-streets. Unlike static obstacles, pedestrians are active agents with complex, interactive motions. Planning AV actions in the presence of pedestrians thus requires modelling of their probable future behaviour as well as detecting and tracking them. This narrative review article is Part II of a pair, together surveying the current technology stack involved in this process, organising recent research into a hierarchical taxonomy ranging from low-level image detection to high-level psychological models, from the perspective of an AV designer. This self-contained Part II covers the higher levels of this stack, consisting of models of pedestrian behaviour, from prediction of individual pedestrians' likely destinations and paths, to game-theoretic models of interactions between pedestrians and autonomous vehicles. This survey clearly shows that, although there are good models for optimal walking behaviour, high-level psychological and social modelling of pedestrian behaviour still remains an open research question that requires many conceptual issues to be clarified. Early work has been done on descriptive and qualitative models of behaviour, but much work is still needed to translate them into quantitative algorithms for practical AV control.

Related papers

• Social-Transmotion: Promptable Human Trajectory Prediction [65.80068316170613]
  Social-Transmotion is a generic Transformer-based model that exploits diverse and numerous visual cues to predict human behavior. Our approach is validated on multiple datasets, including JTA, JRDB, Pedestrians and Cyclists in Road Traffic, and ETH-UCY.
  arXiv  Detail & Related papers  (2023-12-26T18:56:49Z)
• GPT-4V Takes the Wheel: Promises and Challenges for Pedestrian Behavior Prediction [12.613528624623514]
  This research is the first to conduct both quantitative and qualitative evaluations of Vision Language Models (VLMs) in the context of pedestrian behavior prediction for autonomous driving. We evaluate GPT-4V on publicly available pedestrian datasets: JAAD and WiDEVIEW. The model achieves a 57% accuracy in a zero-shot manner, which, while impressive, is still behind the state-of-the-art domain-specific models (70%) in predicting pedestrian crossing actions.
  arXiv  Detail & Related papers  (2023-11-24T18:02:49Z)
• Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Review [3.809702129519642]
  Planning an autonomous vehicle's path in a space shared with pedestrians requires reasoning about pedestrians' future trajectories. This paper systematically reviews different methods proposed in the literature for modelling pedestrian trajectory prediction.
  arXiv  Detail & Related papers  (2023-08-11T23:58:51Z)
• Analysis over vision-based models for pedestrian action anticipation [1.1470070927586016]
  This paper focuses on using images of the pedestrian's context as an input feature. We present several paper-model architectures that utilize standard CNN and Transformer modules. We provide insights on the explainability of vision-based Transformer models in the context of pedestrian action prediction.
  arXiv  Detail & Related papers  (2023-05-27T11:30:32Z)
• Behavioral Intention Prediction in Driving Scenes: A Survey [70.53285924851767]
  Behavioral Intention Prediction (BIP) simulates a human consideration process and fulfills the early prediction of specific behaviors. This work provides a comprehensive review of BIP from the available datasets, key factors and challenges, pedestrian-centric and vehicle-centric BIP approaches, and BIP-aware applications.
  arXiv  Detail & Related papers  (2022-11-01T11:07:37Z)
• Pedestrian Stop and Go Forecasting with Hybrid Feature Fusion [87.77727495366702]
  We introduce the new task of pedestrian stop and go forecasting. Considering the lack of suitable existing datasets for it, we release TRANS, a benchmark for explicitly studying the stop and go behaviors of pedestrians in urban traffic. We build it from several existing datasets annotated with pedestrians' walking motions, in order to have various scenarios and behaviors.
  arXiv  Detail & Related papers  (2022-03-04T18:39:31Z)
• PSI: A Pedestrian Behavior Dataset for Socially Intelligent Autonomous Car [47.01116716025731]
  This paper proposes and shares another benchmark dataset called the IUPUI-CSRC Pedestrian Situated Intent (PSI) data. The first novel label is the dynamic intent changes for the pedestrians to cross in front of the ego-vehicle, achieved from 24 drivers. The second one is the text-based explanations of the driver reasoning process when estimating pedestrian intents and predicting their behaviors.
  arXiv  Detail & Related papers  (2021-12-05T15:54:57Z)
• Modeling Interactions of Autonomous Vehicles and Pedestrians with Deep Multi-Agent Reinforcement Learning for Collision Avoidance [20.542143534865154]
  In this work, we model the corresponding interaction sequence as a Markov decision process (MDP) that is solved by deep reinforcement learning (DRL) algorithms. The presented PCAM system with different levels of intelligent pedestrian behavior is benchmarked according to the agents' collision rate and the resulting traffic flow efficiency. The results show that the AV is able to completely mitigate collisions under the majority of the investigated conditions.
  arXiv  Detail & Related papers  (2021-09-30T17:06:39Z)
• Detecting 32 Pedestrian Attributes for Autonomous Vehicles [103.87351701138554]
  In this paper, we address the problem of jointly detecting pedestrians and recognizing 32 pedestrian attributes. We introduce a Multi-Task Learning (MTL) model relying on a composite field framework, which achieves both goals in an efficient way. We show competitive detection and attribute recognition results, as well as a more stable MTL training.
  arXiv  Detail & Related papers  (2020-12-04T15:10:12Z)
• What-If Motion Prediction for Autonomous Driving [58.338520347197765]
  Viable solutions must account for both the static geometric context, such as road lanes, and dynamic social interactions arising from multiple actors. We propose a recurrent graph-based attentional approach with interpretable geometric (actor-lane) and social (actor-actor) relationships. Our model can produce diverse predictions conditioned on hypothetical or "what-if" road lanes and multi-actor interactions.
  arXiv  Detail & Related papers  (2020-08-24T17:49:30Z)
• Pedestrian Models for Autonomous Driving Part I: Low-Level Models, from Sensing to Tracking [10.789792281963422]
  This narrative review article is Part I of a pair, together surveying the current technology stack involved in this process. This self-contained Part I covers the lower levels of this stack, from sensing, through detection and recognition, up to tracking of pedestrians. Technologies at these levels are found to be mature and available as foundations for use in high-level systems, such as behaviour modelling, prediction and interaction control.
  arXiv  Detail & Related papers  (2020-02-26T17:57:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.