EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessment

• URL: http://arxiv.org/abs/2607.03934v1
• Date: Sat, 04 Jul 2026 16:02:39 GMT
• Title: EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessment
• Abstract summary: EgoInertia-MI is a multimodal benchmark dataset combining egocentric video and wearable IMU signals for motor impairment analysis.<n>We show that egocentric video provides strong cues for motor impairment assessment.<n>These findings highlight the potential of combining egocentric vision and wearable sensing for ecologically valid and privacy-aware motor assessment.
• Score: 2.7963067040946723
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Motor impairments, including tremor, bradykinesia, gait abnormalities, and postural instability, are common across many neurological and movement-related conditions. Conventional clinical assessments are often intermittent and may fail to capture subtle temporal variations in motor behavior. While wearable IMUs and third-person video have shown promise for objective motor assessment, third-person recordings raise privacy concerns and require constrained acquisition setups. In contrast, egocentric vision provides a more naturalistic and privacyaware alternative. In this work, we introduce EgoInertia-MI, a multimodal benchmark dataset combining synchronized egocentric video and wearable IMU signals for motor impairment analysis. The dataset contains 19 upper- and lower-body activities performed by healthy volunteers simulating varying levels of motor impairment severity levels: no impairment, mild impairment, and severe impairment. We establish two benchmark tasks: action recognition and motor impairment severity estimation, and evaluate multiple unimodal and multimodal baselines. Experimental results show that egocentric video provides strong cues for motor impairment assessment, while multimodal fusion achieves the best overall performance, reaching 0.78 Macro-F1 for severity estimation and 0.93 Macro-F1 for action recognition. These findings highlight the potential of combining egocentric vision and wearable sensing for ecologically valid and privacy-aware motor assessment. Code and data are available at:https://fatemah-alh.github.io/EgoInertia-MI-Page/.

Related papers

• Toward Postural State Classification in Immersive VR with Multimodal Data and Explainability Analysis [9.386262755183862]
  This study compares machine learning (ML) and deep learning (DL) models for classifying postural states in VR under visual perturbations.<n>We used a multimodal dataset containing kinematic, electromyographic (EMG), and electrodermal activity (EDA) signals.<n>Among the models, the Mamba-inspired CNN (MI-CNN) achieved the highest accuracy of 96.76%.
  arXiv  Detail & Related papers  (2026-08-28T20:31:00Z)
• ObsDriveBench: Benchmarking Multimodal Understanding under Adverse Weather with Observability Awareness [65.3988208273595]
  We introduce textbfObsDriveBench, a real-world multi-modal benchmark for adverse-weather autonomous driving.<n>Our benchmark is designed with three capability dimensions: textbfobservability awareness, textbfspatial reliability, and textbfrisk-aware decision-making.<n>Experiments reveal consistent performance degradation of existing vision-language models.
  arXiv  Detail & Related papers  (2026-07-26T08:13:46Z)
• A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models [96.64934195520802]
  We introduce CrashTwin, a physics-grounded evaluation framework designed to stress-test the physical trustworthiness of world models.<n>CrashTwin couples a diverse dataset of multi-agent collision scenarios, comprising 25K controllable synthetic 12K in-the-wild real-world collision sequences.<n>We propose a diagnostic suite that systematically evaluates three dimensions:-temporal consistency, momentum and kinetic energy conservation, and world-dynamics integrity.
  arXiv  Detail & Related papers  (2026-06-27T06:13:35Z)
• Introducing WARM-VR: Benchmark Dataset for Multimodal Wearable Affect Recognition in Virtual Reality [12.32040756213776]
  WARM-VR is a novel dataset designed to support affect recognition in immersive, multisensory environments.<n>Data was collected from 31 participants aged 19-37 using wearable sensors.
  arXiv  Detail & Related papers  (2026-04-30T20:00:56Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• MetAdv: A Unified and Interactive Adversarial Testing Platform for Autonomous Driving [85.04826012938642]
  MetAdv is a novel adversarial testing platform that enables realistic, dynamic, and interactive evaluation.<n>It supports flexible 3D vehicle modeling and seamless transitions between simulated and physical environments.<n>It enables real-time capture of physiological signals and behavioral feedback from drivers.
  arXiv  Detail & Related papers  (2025-08-04T03:07:54Z)
• Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking [12.016546264209536]
  This study explores a passive method for estimating refractive power using two eye movement recording techniques: electrooculography (EOG) and video-based eye tracking.<n>We trained Long Short-Term Memory (LSTM) models to classify refractive power from unimodal (EOG or eye tracking) and multimodal configuration.<n>Results show that the multimodal model consistently outperforms unimodal models, achieving the highest average accuracy in both settings.
  arXiv  Detail & Related papers  (2025-05-24T06:03:45Z)
• MVICAD2: Multi-View Independent Component Analysis with Delays and Dilations [61.59658203704757]
  We propose Multi-View Independent Component Analysis with Delays and Dilations (MVICAD2), which allows sources to differ across subjects in both temporal delays and dilations.<n>We present a model with identifiable sources, derive an approximation of its likelihood in closed form, and use regularization and optimization techniques to enhance performance.
  arXiv  Detail & Related papers  (2025-01-13T15:47:02Z)
• Cross-Attention is Not Enough: Incongruity-Aware Dynamic Hierarchical Fusion for Multimodal Affect Recognition [69.32305810128994]
  Incongruity between modalities poses a challenge for multimodal fusion, especially in affect recognition. We propose the Hierarchical Crossmodal Transformer with Dynamic Modality Gating (HCT-DMG), a lightweight incongruity-aware model. HCT-DMG: 1) outperforms previous multimodal models with a reduced size of approximately 0.8M parameters; 2) recognizes hard samples where incongruity makes affect recognition difficult; 3) mitigates the incongruity at the latent level in crossmodal attention.
  arXiv  Detail & Related papers  (2023-05-23T01:24:15Z)
• Towards Continual Egocentric Activity Recognition: A Multi-modal Egocentric Activity Dataset for Continual Learning [21.68009790164824]
  We present a multi-modal egocentric activity dataset for continual learning named UESTC-MMEA-CL. It contains synchronized data of videos, accelerometers, and gyroscopes, for 32 types of daily activities, performed by 10 participants. Results of egocentric activity recognition are reported when using separately, and jointly, three modalities: RGB, acceleration, and gyroscope.
  arXiv  Detail & Related papers  (2023-01-26T04:32:00Z)
• GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation [27.081767446317095]
  We introduce GaitForeMer, Gait Forecasting and impairment estimation transforMer. GaitForeMer is first pre-trained on public datasets to forecast gait movements and then applied to clinical data to predict gait impairment severity. Our method outperforms previous approaches that rely solely on clinical data by a large margin, achieving an F1 score of 0.76, precision of 0.79, and recall of 0.75.
  arXiv  Detail & Related papers  (2022-06-30T21:29:47Z)
• Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson's Disease Motor Severity [39.51722822896373]
  Parkinson's disease (PD) is a progressive neurological disorder affecting motor function. Physical severity of PD impairments can be quantified through the Movement Disorder Society Unified Parkinson's Disease Rating Scale. We propose a computer vision-based model that observes non-intrusive video recordings of individuals, extracts their 3D body skeletons, tracks them through time, and classifies the movements according to the MDS-UPDRS gait scores.
  arXiv  Detail & Related papers  (2020-07-17T11:49:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.