Towards Driver Behavior Understanding: Weakly-Supervised Risk Perception in Driving Scenes

• URL: http://arxiv.org/abs/2603.05926v1
• Date: Fri, 06 Mar 2026 05:40:13 GMT
• Title: Towards Driver Behavior Understanding: Weakly-Supervised Risk Perception in Driving Scenes
• Abstract summary: RAID comprises 4,691 annotated video clips, covering diverse traffic scenarios with labels for driver's intended maneuver, road topology, risk situations (e.g., crossing pedestrians), driver responses, and pedestrian attentiveness.<n>We propose a weakly supervised risk object identification framework that models the relationship between driver's intended maneuver and responses to identify potential risk sources.
• Score: 21.684666974039086
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Achieving zero-collision mobility remains a key objective for intelligent vehicle systems, which requires understanding driver risk perception-a complex cognitive process shaped by voluntary response of the driver to external stimuli and the attentiveness of surrounding road users towards the ego-vehicle. To support progress in this area, we introduce RAID (Risk Assessment In Driving scenes)-a large-scale dataset specifically curated for research on driver risk perception and contextual risk assessment. RAID comprises 4,691 annotated video clips, covering diverse traffic scenarios with labels for driver's intended maneuver, road topology, risk situations (e.g., crossing pedestrians), driver responses, and pedestrian attentiveness. Leveraging RAID, we propose a weakly supervised risk object identification framework that models the relationship between driver's intended maneuver and responses to identify potential risk sources. Additionally, we analyze the role of pedestrian attention in estimating risk and demonstrate the value of the proposed dataset. Experimental evaluations demonstrate that our method achieves 20.6% and 23.1% performance gains over prior state-of-the-art approaches on the RAID and HDDS datasets, respectively.

Related papers

• Emergent Strategic Reasoning Risks in AI: A Taxonomy-Driven Evaluation Framework [63.74295981594549]
  Large language models (LLMs) engage in behaviors that serve their own objectives.<n>These include, but are not limited to, deception (intentionally misleading users or evaluators), evaluation gaming (strategically manipulating performance during safety testing), and reward hacking.<n>We introduce ESRRSim, a taxonomy-driven agentic framework for automated behavioral risk evaluation.
  arXiv  Detail & Related papers  (2026-04-23T23:44:01Z)
• Fusing Driver Perceived and Physical Risk for Safety Critical Scenario Screening in Autonomous Driving [20.663269212781426]
  We propose a driver risk fusion based hazardous scenario screening method for autonomous driving.<n>During training, the method combines an improved Driver Risk Field with a dynamic cost model to generate high quality risk supervision signals.<n>During inference it directly predicts scenario level risk scores through fast forward passes, avoiding per frame risk computation.
  arXiv  Detail & Related papers  (2026-03-07T13:24:23Z)
• Context-Aware Quantitative Risk Assessment Machine Learning Model for Drivers Distraction [0.0]
  Multi-Class Driver Distraction Risk Assessment (MDDRA) model considers the vehicle, driver, and environmental data during a journey. MDDRA categorises the driver on a risk matrix as safe, careless, or dangerous. We apply machine learning techniques to classify and predict driver distraction according to severity levels.
  arXiv  Detail & Related papers  (2024-02-20T23:20:36Z)
• Leveraging Driver Field-of-View for Multimodal Ego-Trajectory Prediction [69.29802752614677]
  RouteFormer is a novel ego-trajectory prediction network combining GPS data, environmental context, and the driver's field-of-view.<n>To tackle data scarcity and enhance diversity, we introduce GEM, a dataset of urban driving scenarios enriched with synchronized driver field-of-view and gaze data.
  arXiv  Detail & Related papers  (2023-12-13T23:06:30Z)
• RSRD: A Road Surface Reconstruction Dataset and Benchmark for Safe and Comfortable Autonomous Driving [67.09546127265034]
  Road surface reconstruction helps to enhance the analysis and prediction of vehicle responses for motion planning and control systems. We introduce the Road Surface Reconstruction dataset, a real-world, high-resolution, and high-precision dataset collected with a specialized platform in diverse driving conditions. It covers common road types containing approximately 16,000 pairs of stereo images, original point clouds, and ground-truth depth/disparity maps.
  arXiv  Detail & Related papers  (2023-10-03T17:59:32Z)
• Intersection Warning System for Occlusion Risks using Relational Local Dynamic Maps [0.0]
  This work addresses the task of risk evaluation in traffic scenarios with limited observability due to restricted sensorial coverage. To identify the area of sight, we employ ray casting on a local dynamic map providing geometrical information and road infrastructure. Resulting risk indicators are utilized to evaluate the driver's current behavior, to warn the driver in critical situations, to give suggestions on how to act safely or to plan safe trajectories.
  arXiv  Detail & Related papers  (2023-03-13T16:01:55Z)
• Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics [77.34726150561087]
  This work aims to carry out a study on the current scenario of camera and radar-based perception for ADAS and autonomous vehicles. Concepts and characteristics related to both sensors, as well as to their fusion, are presented. We give an overview of the Deep Learning-based detection and segmentation tasks, and the main datasets, metrics, challenges, and open questions in vehicle perception.
  arXiv  Detail & Related papers  (2023-03-08T00:48:32Z)
• FBLNet: FeedBack Loop Network for Driver Attention Prediction [50.936478241688114]
  Nonobjective driving experience is difficult to model, so a mechanism simulating the driver experience accumulation procedure is absent in existing methods.<n>We propose a FeedBack Loop Network (FBLNet), which attempts to model the driving experience accumulation procedure.<n>Our model exhibits a solid advantage over existing methods, achieving an outstanding performance improvement on two driver attention benchmark datasets.
  arXiv  Detail & Related papers  (2022-12-05T08:25:09Z)
• R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenes [69.6715406227469]
  Self-supervised monocular depth estimation in driving scenarios has achieved comparable performance to supervised approaches. We present R4Dyn, a novel set of techniques to use cost-efficient radar data on top of a self-supervised depth estimation framework.
  arXiv  Detail & Related papers  (2021-08-10T17:57:03Z)
• Driver-centric Risk Object Identification [25.85690304998681]
  We propose a driver-centric definition of risk, i.e., risky objects influence driver behavior. We formulate the task as a cause-effect problem and present a novel two-stage risk object identification framework. A driver-centric Risk Object Identification dataset is curated to evaluate the proposed system.
  arXiv  Detail & Related papers  (2021-06-24T17:27:32Z)
• A system of vision sensor based deep neural networks for complex driving scene analysis in support of crash risk assessment and prevention [12.881094474374231]
  This paper develops a system for driving scene analysis using dash cameras on vehicles and deep learning algorithms. The Multi-Net of the system includes two multi-task neural networks that perform scene classification to provide four labels for each scene. Two completely new datasets have been developed and made available to the public, which were proved to be effective in training the proposed deep neural networks.
  arXiv  Detail & Related papers  (2021-06-18T19:07:59Z)
• Who Make Drivers Stop? Towards Driver-centric Risk Assessment: Risk Object Identification via Causal Inference [19.71459945458985]
  We propose a driver-centric definition of risk, i.e., objects influencing drivers' behavior are risky. We present a novel two-stage risk object identification framework based on causal inference with the proposed object-level manipulable driving model. Our framework achieves a substantial average performance boost over a strong baseline by 7.5%.
  arXiv  Detail & Related papers  (2020-03-05T04:14:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.