DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting

• URL: http://arxiv.org/abs/2609.08117v1
• Date: Tue, 08 Sep 2026 01:49:18 GMT
• Title: DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting
• Abstract summary: We introduce DriveMotion, a benchmark for continuous driver motion forecasting.<n>DriveMotion contains 393 hours of 133-keypoint motion sequences at 10 Hz from 360 drivers.<n>We use dynamics-anchored evaluation, placing forecasting windows around vehicle maneuvers identified offline from CAN signals.
• Score: 19.185390523777187
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Driver motion can provide cues to ongoing behavior, attention, and near-term driving intent. However, most existing driver-centric datasets focus on recognizing predefined driver behaviors from short video clips, while human motion forecasting benchmarks largely target motion outside the vehicle. We introduce DriveMotion, a multi-source benchmark for continuous driver motion forecasting. DriveMotion contains 393 hours of 133-keypoint motion sequences at 10 Hz from 360 drivers, integrating naturalistic driving data, curated public in-cabin videos, and the AIDE dataset into a unified representation with per-joint validity masks and synchronized driving context. Naturalistic driving contains long periods of limited body movement, making uniformly sampled evaluation dominated by persistence and less sensitive to brief but behaviorally meaningful motion. To address this, we use dynamics-anchored evaluation, placing forecasting windows around vehicle maneuvers identified offline from CAN signals without providing CAN to the model at inference. Arm motion in pre-maneuver windows is 3.4x greater than in route-matched stable-driving controls. On these anchored windows, learned models reduce forecasting error over persistence by up to 15%, while maneuver-enriched training improves forecast-derived Part-State F1 by 44% over the zero-motion reference. Training on the full multi-source corpus further reduces forecasting error on held-out web drivers by 38% compared with BATON-only training. DriveMotion provides identity-disjoint splits, fixed evaluation subsets, and reference implementations for reproducible evaluation of continuous driver motion forecasting. The dataset and benchmark are available at https://huggingface.co/datasets/HenryYHW/DriveMotion

Related papers

• SimWAM: A Simple World Action Model for End-to-End Autonomous Driving [66.93548079427477]
  We present SimWAM, a simple yet effective WAM that leverages future-video prediction as a training-time supervision signal.<n>An isolated attention mask keeps action prediction independent of future frames, allowing trajectory prediction without explicit future-frame generation at inference.<n>Our SimWAM achieves 91.5 PDMS on NAVSIM, surpasses state-of-the-art WAM-based planners with substantially lower latency, and transfers zero-shot to nuScenes.
  arXiv  Detail & Related papers  (2026-08-07T17:59:09Z)
• DriveDNA: A Large-Scale Multimodal Naturalistic Driving Dataset and Benchmark for Driving Style Identification [22.095487498535434]
  We introduce DriveDNA, a large-scale naturalistic dataset and benchmark for personalized driving-style modeling.<n>DriveDNA defines driving style as a consistent, driver-specific behavioral pattern in how a vehicle moves under similar conditions.<n>We evaluate baselines spanning classical descriptors, supervised and self-supervised time-series encoders, multimodal fusion, probabilistic prediction, and video-only models.
  arXiv  Detail & Related papers  (2026-07-26T20:04:49Z)
• Risk-Aware Selective Multimodal Driver Monitoring with Driver-State World Modeling [13.540675152706589]
  Continuous driver monitoring in automated vehicles requires low-latency inference.<n>We propose a cost-aware selective inference framework for deployable multimodal driver monitoring.
  arXiv  Detail & Related papers  (2026-06-25T11:59:21Z)
• Driver-WM: A Driver-Centric Traffic-Conditioned Latent World Model for In-Cabin Dynamics Rollout [55.19244743715421]
  Driver-WM is a driver-centric latent world model that rolls out in-cabin dynamics causally conditioned on out-cabin traffic context.<n>It unifies physical kinematics forecasting with auxiliary behavioral and emotional semantic recognition.<n>Driver-WM yields robust long-horizon geometric forecasting for reactive high-motion maneuvers.
  arXiv  Detail & Related papers  (2026-05-06T16:30:48Z)
• BATON: A Multimodal Benchmark for Bidirectional Automation Transition Observation in Naturalistic Driving [18.15118596168445]
  Existing driving automation (DA) systems rely on human drivers to decide when to engage DA.<n>BATON is a naturalistic dataset capturing real-world DA usage across 127 drivers, and 136.6 hours of driving.<n>The dataset synchronizes front-view video, in-cabin video, decoded CAN bus signals, radar-based lead-vehicle interaction, and GPS-derived route context.<n>Results show that front-view video captures road context but not driver state, while in-cabin video reflects driver readiness but not the external scene.
  arXiv  Detail & Related papers  (2026-04-08T16:29:24Z)
• Vehicle Acceleration Prediction Considering Environmental Influence and Individual Driving Behavior [21.115172859571583]
  Vehicle acceleration prediction is critical for intelligent driving control and energy efficiency management.<n>This paper proposes a general short-term vehicle acceleration prediction framework that jointly models environmental influence and individual driving behavior.
  arXiv  Detail & Related papers  (2025-04-05T12:43:15Z)
• MetaFollower: Adaptable Personalized Autonomous Car Following [63.90050686330677]
  We propose an adaptable personalized car-following framework - MetaFollower. We first utilize Model-Agnostic Meta-Learning (MAML) to extract common driving knowledge from various CF events. We additionally combine Long Short-Term Memory (LSTM) and Intelligent Driver Model (IDM) to reflect temporal heterogeneity with high interpretability.
  arXiv  Detail & Related papers  (2024-06-23T15:30:40Z)
• Real Time Monocular Vehicle Velocity Estimation using Synthetic Data [78.85123603488664]
  We look at the problem of estimating the velocity of road vehicles from a camera mounted on a moving car. We propose a two-step approach where first an off-the-shelf tracker is used to extract vehicle bounding boxes and then a small neural network is used to regress the vehicle velocity.
  arXiv  Detail & Related papers  (2021-09-16T13:10:27Z)
• Markov Switching Model for Driver Behavior Prediction: Use cases on Smartphones [4.576379639081977]
  We present a driver behavior switching model validated by a low-cost data collection solution using smartphones. The proposed model is validated using a real dataset to predict the driver behavior in short duration periods.
  arXiv  Detail & Related papers  (2021-08-29T09:54:05Z)
• IntentNet: Learning to Predict Intention from Raw Sensor Data [86.74403297781039]
  In this paper, we develop a one-stage detector and forecaster that exploits both 3D point clouds produced by a LiDAR sensor as well as dynamic maps of the environment. Our multi-task model achieves better accuracy than the respective separate modules while saving computation, which is critical to reducing reaction time in self-driving applications.
  arXiv  Detail & Related papers  (2021-01-20T00:31:52Z)
• Driver Intention Anticipation Based on In-Cabin and Driving Scene Monitoring [52.557003792696484]
  We present a framework for the detection of the drivers' intention based on both in-cabin and traffic scene videos. Our framework achieves a prediction with the accuracy of 83.98% and F1-score of 84.3%.
  arXiv  Detail & Related papers  (2020-06-20T11:56:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.