EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment

• URL: http://arxiv.org/abs/2608.18711v1
• Date: Wed, 19 Aug 2026 09:10:24 GMT
• Title: EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment
• Abstract summary: Heart rate variability (HRV) is a widely used noninvasive marker of autonomic regulation under stress.<n>We propose EgoHRV, a method that estimates HRV as well as heart rate (HR) from the gaze cameras that are already integrated into egocentric headsets.<n>Our pipeline combines a 3D backbone with a novel low--high decomposition module that extracts the blood volume pulse (BVP) signal from gaze video.
• Score: 35.715609556178165
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Egocentric vision systems capture human behavior from visible cues, but overlook physiological indicators of autonomic states such as stress, engagement, and attention. Heart rate variability (HRV) is a widely used noninvasive marker of autonomic regulation under stress. HRV reflects small timing differences between successive heartbeats and has so far been out of reach for egocentric platforms, where motion and noise in gaze video mask exactly this fine-grained timing. We propose EgoHRV, a method that estimates HRV as well as heart rate (HR) from the gaze cameras that are already integrated into egocentric headsets. Our pipeline combines a 3D backbone with a novel low--high decomposition module that extracts the blood volume pulse (BVP) signal from gaze video. Our cross-domain pretraining aligns the frequency-domain representations of contact-based and camera-derived signals. This alignment gives EgoHRV the temporal precision to recover HRV from the subtle fluctuations in gaze video. EgoHRV achieves state-of-the-art accuracy for HR and HRV estimation from egocentric video, and its uncertainty-aware design improves downstream behavioral modeling. Integrating our HRV estimates and confidence measures into EgoExo4D's proficiency estimator raises accuracy by 17.8%. Beyond skill, continuous HRV estimation also opens egocentric systems to stress- and arousal-aware estimation tasks. Code: https://github.com/eth-siplab/EgoHRV

Related papers

• EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation [68.71388815638576]
  We present emphEgoPressDiff, a conditional video diffusion framework that generates UV-pressure maps from visual input.<n>EgoPressDiff achieves state-of-the-art results, improving Volumetric IoU by over 34% relative to prior baseline.
  arXiv  Detail & Related papers  (2026-06-05T03:40:10Z)
• egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks [19.969886981165754]
  Egocentric vision systems aim to understand the surroundings and the wearer's behavior inside it, including motions, activities, and interactions.<n>We argue that egocentric systems must additionally detect physiological states to capture a person's attention and situational responses.<n>We introduce PulseFormer, a method to extract heart rate as a key indicator of physiological state from the eye tracking cameras on egocentric vision systems.
  arXiv  Detail & Related papers  (2025-02-28T09:23:40Z)
• Estimating Body and Hand Motion in an Ego-sensed World [62.61989004520802]
  We present EgoAllo, a system for human motion estimation from a head-mounted device.<n>Using only egocentric SLAM poses and images, EgoAllo guides sampling from a conditional diffusion model to estimate 3D body pose, height, and hand parameters.
  arXiv  Detail & Related papers  (2024-10-04T17:59:57Z)
• Lost in Tracking: Uncertainty-guided Cardiac Cine MRI Segmentation at Right Ventricle Base [6.124743898202368]
  We propose to address the currently unsolved issues in CMR segmentation, specifically at the RV base. We propose a novel dual encoder U-Net architecture that leverages temporal incoherence to inform the segmentation when interplanar motions occur.
  arXiv  Detail & Related papers  (2024-10-04T11:14:31Z)
• Deep Learning for Automatic Strain Quantification in Arrhythmogenic Right Ventricular Cardiomyopathy [0.0]
  Quantification of cardiac motion with cine Cardiac Magnetic Resonance Imaging (CMRI) is an integral part of arrhythmogenic right ventricular cardiomyopathy (ARVC) diagnosis. We develop a method to automatically assess cardiac motion using Implicit Neural Representations (INRs) and a deep learning approach. Our results show that inter-slice alignment and generation of super-resolved volumes combined with joint analysis of the two cardiac views, notably improves registration performance.
  arXiv  Detail & Related papers  (2023-11-24T12:55:36Z)
• Semantic-aware Temporal Channel-wise Attention for Cardiac Function Assessment [69.02116920364311]
  Existing video-based methods do not pay much attention to the left ventricular region, nor the left ventricular changes caused by motion. We propose a semi-supervised auxiliary learning paradigm with a left ventricular segmentation task, which contributes to the representation learning for the left ventricular region. Our approach achieves state-of-the-art performance on the Stanford dataset with an improvement of 0.22 MAE, 0.26 RMSE, and 1.9% $R2$.
  arXiv  Detail & Related papers  (2023-10-09T05:57:01Z)
• HVS-Inspired Signal Degradation Network for Just Noticeable Difference Estimation [69.49393407465456]
  We propose an HVS-inspired signal degradation network for JND estimation. We analyze the HVS perceptual process in JND subjective viewing to obtain relevant insights. We show that the proposed method achieves the SOTA performance for accurately estimating the redundancy of the HVS.
  arXiv  Detail & Related papers  (2022-08-16T07:53:45Z)
• Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluation [9.883261192383612]
  Remote photo-plethysmography (r) uses a camera to estimate a person's heart rate (HR) HRV is a measure of the fine fluctuations in the intervals between heart beats. We introduce a refined and efficient real-time r pipeline with novel filtering and motion suppression.
  arXiv  Detail & Related papers  (2020-12-31T18:57:05Z)
• AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching [76.4844593082362]
  We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS) Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2020-04-26T05:43:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.