A Review of Driver Gaze Estimation and Application in Gaze Behavior Understanding

• URL: http://arxiv.org/abs/2307.01470v2
• Date: Wed, 21 Feb 2024 18:28:30 GMT
• Title: A Review of Driver Gaze Estimation and Application in Gaze Behavior Understanding
• Abstract summary: Driver gaze plays an important role in different gaze-based applications such as driver attentiveness detection, visual distraction detection, gaze behavior understanding, and building driver assistance system. This study is to perform a comprehensive summary of driver gaze fundamentals, methods to estimate driver gaze, and it's applications in real world driving scenarios.
• Score: 2.020578082776547
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Driver gaze plays an important role in different gaze-based applications such as driver attentiveness detection, visual distraction detection, gaze behavior understanding, and building driver assistance system. The main objective of this study is to perform a comprehensive summary of driver gaze fundamentals, methods to estimate driver gaze, and it's applications in real world driving scenarios. We first discuss the fundamentals related to driver gaze, involving head-mounted and remote setup based gaze estimation and the terminologies used for each of these data collection methods. Next, we list out the existing benchmark driver gaze datasets, highlighting the collection methodology and the equipment used for such data collection. This is followed by a discussion of the algorithms used for driver gaze estimation, which primarily involves traditional machine learning and deep learning based techniques. The estimated driver gaze is then used for understanding gaze behavior while maneuvering through intersections, on-ramps, off-ramps, lane changing, and determining the effect of roadside advertising structures. Finally, we have discussed the limitations in the existing literature, challenges, and the future scope in driver gaze estimation and gaze-based applications.

Related papers

• SGAP-Gaze: Scene Grid Attention Based Point-of-Gaze Estimation Network for Driver Gaze [2.5160729549992795]
  We propose a benchmark dataset, Urban Driving-Face Scene Gaze (UD-FSG), comprising synchronized driver-face and traffic-scene images.<n>We propose SGAP-Gaze, Scene-Grid Attention based Point-of-Gaze estimation network, trained and tested on our UD-FSG dataset.<n>The proposed SGAP-Gaze model achieves a mean pixel error of 104.73 on the UD-FSG dataset and 63.48 on LBW dataset, achieving a 23.5% reduction in mean pixel error.
  arXiv  Detail & Related papers  (2026-04-21T18:10:03Z)
• DriverGaze360: OmniDirectional Driver Attention with Object-Level Guidance [16.43802401929688]
  DriverGaze360 is a large-scale 360$circ$ field of view driver attention dataset.<n>DriverGaze360-Net jointly learns attention maps and attended objects by employing an auxiliary semantic segmentation head.
  arXiv  Detail & Related papers  (2025-12-16T10:23:00Z)
• Classification of Driver Behaviour Using External Observation Techniques for Autonomous Vehicles [0.7734726150561086]
  This study introduces a novel driver behaviour classification system that uses external observation techniques to detect indicators of distraction and impairment.<n>The proposed framework employs advanced computer vision methodologies, including real-time object tracking, lateral displacement analysis, and lane position monitoring.<n>Unlike systems reliant on inter-vehicular communication, this vision-based approach enables behavioural analysis of non-connected vehicles.
  arXiv  Detail & Related papers  (2025-09-11T11:05:14Z)
• SCOUT+: Towards Practical Task-Driven Drivers' Gaze Prediction [12.246649738388388]
  SCOUT+ is a task- and context-aware model for drivers' gaze prediction. We evaluate our model on two datasets, DR(eye)VE and BDD-A.
  arXiv  Detail & Related papers  (2024-04-12T18:29:10Z)
• A Scoping Review of Energy-Efficient Driving Behaviors and Applied State-of-the-Art AI Methods [2.765388013062202]
  There is no comprehensive investigation into energy-efficient driving behaviors and strategies. Many state-of-the-art AI models have been applied for the analysis of eco-friendly driving styles, but no overview is available. This paper conducts a thorough literature review on ecological driving behaviors and styles and analyzes the driving factors influencing energy consumption.
  arXiv  Detail & Related papers  (2024-03-04T13:57:34Z)
• G-MEMP: Gaze-Enhanced Multimodal Ego-Motion Prediction in Driving [71.9040410238973]
  We focus on inferring the ego trajectory of a driver's vehicle using their gaze data. Next, we develop G-MEMP, a novel multimodal ego-trajectory prediction network that combines GPS and video input with gaze data. The results show that G-MEMP significantly outperforms state-of-the-art methods in both benchmarks.
  arXiv  Detail & Related papers  (2023-12-13T23:06:30Z)
• Understanding and Modeling the Effects of Task and Context on Drivers' Gaze Allocation [12.246649738388388]
  We develop a novel model that modulates drivers' gaze prediction with explicit action and context information. We correct the data processing pipeline used in DR(eye)VE to reduce noise in the recorded gaze data. We benchmark a number of baseline and SOTA models for saliency and driver gaze prediction and use new annotations to analyze how their performance changes in scenarios involving different tasks.
  arXiv  Detail & Related papers  (2023-10-13T17:38:41Z)
• Visual Saliency Detection in Advanced Driver Assistance Systems [7.455416595124159]
  We present an intelligent system that combines a drowsiness detection system for drivers with a scene comprehension pipeline based on saliency. We employ an innovative biosensor embedded on the car steering wheel to monitor the driver. A dedicated 1D temporal deep convolutional network has been devised to classify the collected PPG time-series.
  arXiv  Detail & Related papers  (2023-07-26T15:41:54Z)
• OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mapping [84.65114565766596]
  We present OpenLane-V2, the first dataset on topology reasoning for traffic scene structure. OpenLane-V2 consists of 2,000 annotated road scenes that describe traffic elements and their correlation to the lanes. We evaluate various state-of-the-art methods, and present their quantitative and qualitative results on OpenLane-V2 to indicate future avenues for investigating topology reasoning in traffic scenes.
  arXiv  Detail & Related papers  (2023-04-20T16:31:22Z)
• Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics [77.34726150561087]
  This work aims to carry out a study on the current scenario of camera and radar-based perception for ADAS and autonomous vehicles. Concepts and characteristics related to both sensors, as well as to their fusion, are presented. We give an overview of the Deep Learning-based detection and segmentation tasks, and the main datasets, metrics, challenges, and open questions in vehicle perception.
  arXiv  Detail & Related papers  (2023-03-08T00:48:32Z)
• FBLNet: FeedBack Loop Network for Driver Attention Prediction [75.83518507463226]
  Nonobjective driving experience is difficult to model. In this paper, we propose a FeedBack Loop Network (FBLNet) which attempts to model the driving experience accumulation procedure. Under the guidance of the incremental knowledge, our model fuses the CNN feature and Transformer feature that are extracted from the input image to predict driver attention.
  arXiv  Detail & Related papers  (2022-12-05T08:25:09Z)
• Self-Supervised Steering Angle Prediction for Vehicle Control Using Visual Odometry [55.11913183006984]
  We show how a model can be trained to control a vehicle's trajectory using camera poses estimated through visual odometry methods. We propose a scalable framework that leverages trajectory information from several different runs using a camera setup placed at the front of a car.
  arXiv  Detail & Related papers  (2021-03-20T16:29:01Z)
• The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attention [44.94118128276982]
  A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary. Recent advancements in deep learning and computer vision have shown great promise in monitoring human behaviors and activities. A vast amount of in-domain data is required to train models that provide high performance in predicting driving related tasks.
  arXiv  Detail & Related papers  (2020-12-23T16:37:17Z)
• Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle [58.720142291102135]
  Hand pointing and eye gaze have been extensively investigated in automotive applications for object selection and referencing. Existing outside-the-vehicle referencing methods focus on a static situation, whereas the situation in a moving vehicle is highly dynamic and subject to safety-critical constraints. We investigate the specific characteristics of each modality and the interaction between them when used in the task of referencing outside objects.
  arXiv  Detail & Related papers  (2020-09-23T14:56:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.