Modeling human road crossing decisions as reward maximization with visual perception limitations

• URL: http://arxiv.org/abs/2301.11737v1
• Date: Fri, 27 Jan 2023 14:20:35 GMT
• Title: Modeling human road crossing decisions as reward maximization with visual perception limitations
• Authors: Yueyang Wang, Aravinda Ramakrishnan Srinivasan, Jussi P.P. Jokinen, Antti Oulasvirta, Gustav Markkula
• Abstract summary: We develop a model of human pedestrian crossing decisions based on computational rationality. We show that the proposed cognitive-RL model captures human-like patterns of gap acceptance and crossing initiation time. Our results suggest that this is instead a rational adaption to human perceptual limitations.
• Score: 23.561752465516047
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding the interaction between different road users is critical for road safety and automated vehicles (AVs). Existing mathematical models on this topic have been proposed based mostly on either cognitive or machine learning (ML) approaches. However, current cognitive models are incapable of simulating road user trajectories in general scenarios, and ML models lack a focus on the mechanisms generating the behavior and take a high-level perspective which can cause failures to capture important human-like behaviors. Here, we develop a model of human pedestrian crossing decisions based on computational rationality, an approach using deep reinforcement learning (RL) to learn boundedly optimal behavior policies given human constraints, in our case a model of the limited human visual system. We show that the proposed combined cognitive-RL model captures human-like patterns of gap acceptance and crossing initiation time. Interestingly, our model's decisions are sensitive to not only the time gap, but also the speed of the approaching vehicle, something which has been described as a "bias" in human gap acceptance behavior. However, our results suggest that this is instead a rational adaption to human perceptual limitations. Moreover, we demonstrate an approach to accounting for individual differences in computational rationality models, by conditioning the RL policy on the parameters of the human constraints. Our results demonstrate the feasibility of generating more human-like road user behavior by combining RL with cognitive models.

Related papers

• Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption [64.07607726562841]
  Existing multi-person human reconstruction approaches mainly focus on recovering accurate poses or avoiding penetration. In this work, we tackle the task of reconstructing closely interactive humans from a monocular video. We propose to leverage knowledge from proxemic behavior and physics to compensate the lack of visual information.
  arXiv  Detail & Related papers  (2024-04-17T11:55:45Z)
• Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perception [27.33595198576784]
  It is assumed that crossing decisions are boundedly optimal, with bounds on optimality arising from human cognitive limitations. We model mechanistically noisy human visual perception and assumed rewards in crossing, but we use reinforcement learning to learn bounded optimal behaviour policy.
  arXiv  Detail & Related papers  (2024-02-06T20:13:34Z)
• RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality [51.244807332133696]
  This paper introduces RACER, a cutting-edge deep learning car-following model to predict Adaptive Cruise Control (ACC) driving behavior. Unlike conventional models, RACER effectively integrates Rational Driving Constraints (RDCs), crucial tenets of actual driving. RACER excels across key metrics, such as acceleration, velocity, and spacing, registering zero violations.
  arXiv  Detail & Related papers  (2023-12-12T06:21:30Z)
• Modeling Boundedly Rational Agents with Latent Inference Budgets [56.24971011281947]
  We introduce a latent inference budget model (L-IBM) that models agents' computational constraints explicitly. L-IBMs make it possible to learn agent models using data from diverse populations of suboptimal actors. We show that L-IBMs match or outperform Boltzmann models of decision-making under uncertainty.
  arXiv  Detail & Related papers  (2023-12-07T03:55:51Z)
• Resolving uncertainty on the fly: Modeling adaptive driving behavior as active inference [6.935068505791817]
  Existing traffic psychology models of adaptive driving behavior either lack computational rigor or only address specific scenarios and/or behavioral phenomena. This paper proposes such a model based on active inference, a behavioral modeling framework originating in computational neuroscience. We show how human-like adaptive driving behavior emerges from the single principle of expected free energy minimization.
  arXiv  Detail & Related papers  (2023-11-10T22:40:41Z)
• AlignDiff: Aligning Diverse Human Preferences via Behavior-Customisable Diffusion Model [69.12623428463573]
  AlignDiff is a novel framework to quantify human preferences, covering abstractness, and guide diffusion planning. It can accurately match user-customized behaviors and efficiently switch from one to another. We demonstrate its superior performance on preference matching, switching, and covering compared to other baselines.
  arXiv  Detail & Related papers  (2023-10-03T13:53:08Z)
• Using Models Based on Cognitive Theory to Predict Human Behavior in Traffic: A Case Study [4.705182901389292]
  We investigate the usefulness of a novel cognitively plausible model for predicting human behavior in gap acceptance scenarios. We show that this model can compete with or even outperform well-established data-driven prediction models.
  arXiv  Detail & Related papers  (2023-05-24T14:27:00Z)
• Beyond RMSE: Do machine-learned models of road user interaction produce human-like behavior? [12.378231329297137]
  We introduce quantitative metrics to demonstrate presence of three different behavioral phenomena in a naturalistic highway driving dataset. We analyze the behavior of three machine-learned models using the same metrics.
  arXiv  Detail & Related papers  (2022-06-22T14:04:39Z)
• STAR: Sparse Transformer-based Action Recognition [61.490243467748314]
  This work proposes a novel skeleton-based human action recognition model with sparse attention on the spatial dimension and segmented linear attention on the temporal dimension of data. Experiments show that our model can achieve comparable performance while utilizing much less trainable parameters and achieve high speed in training and inference.
  arXiv  Detail & Related papers  (2021-07-15T02:53:11Z)
• Solution Concepts in Hierarchical Games under Bounded Rationality with Applications to Autonomous Driving [8.500525426182115]
  We create game theoretic models of driving behaviour using hierarchical games. We evaluate the behaviour models on the basis of model fit to naturalistic data, as well as their predictive capacity. Our results suggest that among the behaviour models evaluated, at the level of maneuvers, modeling driving behaviour as an adaptation of the Quantal level-k model with level-0 behaviour modelled as pure rule-following provides the best fit to naturalistic driving behaviour.
  arXiv  Detail & Related papers  (2020-09-21T17:13:50Z)
• Weak Human Preference Supervision For Deep Reinforcement Learning [48.03929962249475]
  The current reward learning from human preferences could be used to resolve complex reinforcement learning (RL) tasks without access to a reward function. We propose a weak human preference supervision framework, for which we developed a human preference scaling model. Our established human-demonstration estimator requires human feedback only for less than 0.01% of the agent's interactions with the environment.
  arXiv  Detail & Related papers  (2020-07-25T10:37:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.