Human Centered Non Intrusive Driver State Modeling Using Personalized Physiological Signals in Real World Automated Driving

• URL: http://arxiv.org/abs/2604.11549v1
• Date: Mon, 13 Apr 2026 14:38:06 GMT
• Title: Human Centered Non Intrusive Driver State Modeling Using Personalized Physiological Signals in Real World Automated Driving
• Abstract summary: In vehicles with partial or conditional driving automation, the driver remains responsible for supervising the system and responding to take-over requests.<n>In this study, we examine the feasibility of personalized driver state modeling using non-intrusive physiological sensing.<n>Experiments across four drivers demonstrate substantial interindividual variability in physiological patterns related to driver awareness.
• Score: 2.9359340113589774
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In vehicles with partial or conditional driving automation (SAE Levels 2-3), the driver remains responsible for supervising the system and responding to take-over requests. Therefore, reliable driver monitoring is essential for safe human-automation collaboration. However, most existing Driver Monitoring Systems rely on generalized models that ignore individual physiological variability. In this study, we examine the feasibility of personalized driver state modeling using non-intrusive physiological sensing during real-world automated driving. We conducted experiments in an SAE Level 2 vehicle using an Empatica E4 wearable sensor to capture multimodal physiological signals, including electrodermal activity, heart rate, temperature, and motion data. To leverage deep learning architectures designed for images, we transformed the physiological signals into two-dimensional representations and processed them using a multimodal architecture based on pre-trained ResNet50 feature extractors. Experiments across four drivers demonstrate substantial interindividual variability in physiological patterns related to driver awareness. Personalized models achieved an average accuracy of 92.68%, whereas generalized models trained on multiple users dropped to an accuracy of 54%, revealing substantial limitations in cross-user generalization. These results underscore the necessity of adaptive, personalized driver monitoring systems for future automated vehicles and imply that autonomous systems should adapt to each driver's unique physiological profile.

Related papers

• Driver-WM: A Driver-Centric Traffic-Conditioned Latent World Model for In-Cabin Dynamics Rollout [55.19244743715421]
  Driver-WM is a driver-centric latent world model that rolls out in-cabin dynamics causally conditioned on out-cabin traffic context.<n>It unifies physical kinematics forecasting with auxiliary behavioral and emotional semantic recognition.<n>Driver-WM yields robust long-horizon geometric forecasting for reactive high-motion maneuvers.
  arXiv  Detail & Related papers  (2026-05-06T16:30:48Z)
• PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring [30.242706543653497]
  PhysDrive is the first large-scale multimodal dataset for contactless in-vehicle physiological sensing.<n>It covers a wide spectrum of naturalistic driving conditions, including driver motions, dynamic natural light, vehicle types, and road conditions.
  arXiv  Detail & Related papers  (2025-07-25T11:23:44Z)
• A Survey of World Models for Autonomous Driving [55.520179689933904]
  Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling.<n>World models offer high-fidelity representations of the driving environment that integrate multi-sensor data, semantic cues, and temporal dynamics.<n>Future research must address key challenges in self-supervised representation learning, multimodal fusion, and advanced simulation.
  arXiv  Detail & Related papers  (2025-01-20T04:00:02Z)
• Efficient Mixture-of-Expert for Video-based Driver State and Physiological Multi-task Estimation in Conditional Autonomous Driving [12.765198683804094]
  Road safety remains a critical challenge worldwide, with approximately 1.35 million fatalities annually attributed to traffic accidents.<n>We propose a novel multi-task DMS, termed VDMoE, which leverages RGB video input to monitor driver states non-invasively.
  arXiv  Detail & Related papers  (2024-10-28T14:49:18Z)
• MetaFollower: Adaptable Personalized Autonomous Car Following [63.90050686330677]
  We propose an adaptable personalized car-following framework - MetaFollower. We first utilize Model-Agnostic Meta-Learning (MAML) to extract common driving knowledge from various CF events. We additionally combine Long Short-Term Memory (LSTM) and Intelligent Driver Model (IDM) to reflect temporal heterogeneity with high interpretability.
  arXiv  Detail & Related papers  (2024-06-23T15:30:40Z)
• Evaluating Driver Readiness in Conditionally Automated Vehicles from Eye-Tracking Data and Head Pose [3.637162892228131]
  In SAE Level 3 or partly automated vehicles, the driver needs to be available and ready to intervene when necessary. This article presents a comprehensive analysis of driver readiness assessment by combining head pose features and eye-tracking data. A Bidirectional LSTM architecture, combining both feature sets, achieves a mean absolute error of 0.363 on the DMD dataset.
  arXiv  Detail & Related papers  (2024-01-20T17:32:52Z)
• DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Driving [65.04871316921327]
  This paper introduces a new autonomous driving system that enhances the performance and reliability of autonomous driving system. DME-Driver utilizes a powerful vision language model as the decision-maker and a planning-oriented perception model as the control signal generator. By leveraging this dataset, our model achieves high-precision planning accuracy through a logical thinking process.
  arXiv  Detail & Related papers  (2024-01-08T03:06:02Z)
• Enabling the Evaluation of Driver Physiology Via Vehicle Dynamics [2.290169426618366]
  This paper presents the configuration and methodologies used to transform a vehicle into a connected ecosystem capable of assessing driver physiology. We integrated an array of commercial sensors from the automotive and digital health sectors along with driver inputs from the vehicle itself.
  arXiv  Detail & Related papers  (2023-09-08T02:27:28Z)
• FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing [71.76084256567599]
  We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL) Our system, FastRLAP (faster lap), trains autonomously in the real world, without human interventions, and without requiring any simulation or expert demonstrations. The resulting policies exhibit emergent aggressive driving skills, such as timing braking and acceleration around turns and avoiding areas which impede the robot's motion, approaching the performance of a human driver using a similar first-person interface over the course of training.
  arXiv  Detail & Related papers  (2023-04-19T17:33:47Z)
• Augmented Driver Behavior Models for High-Fidelity Simulation Study of Crash Detection Algorithms [2.064612766965483]
  We present a simulation platform for a hybrid transportation system that includes both human-driven and automated vehicles. We decompose the human driving task and offer a modular approach to simulating a large-scale traffic scenario. We analyze a large driving dataset to extract expressive parameters that would best describe different driving characteristics.
  arXiv  Detail & Related papers  (2022-08-10T19:59:16Z)
• Tackling Real-World Autonomous Driving using Deep Reinforcement Learning [63.3756530844707]
  In this work, we propose a model-free Deep Reinforcement Learning Planner training a neural network that predicts acceleration and steering angle. In order to deploy the system on board the real self-driving car, we also develop a module represented by a tiny neural network.
  arXiv  Detail & Related papers  (2022-07-05T16:33:20Z)
• A Survey and Tutorial of EEG-Based Brain Monitoring for Driver State Analysis [164.93739293097605]
  EEG is proven to be one of the most effective methods for driver state monitoring and human error detection. This paper discusses EEG-based driver state detection systems and their corresponding analysis algorithms over the last three decades. It is concluded that the current EEG-based driver state monitoring algorithms are promising for safety applications.
  arXiv  Detail & Related papers  (2020-08-25T18:21:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.