Towards Accurate Heart Rate Measurement from Ultra-Short Video Clips via Periodicity-Guided rPPG Estimation and Signal Reconstruction
- URL: http://arxiv.org/abs/2506.22078v1
- Date: Fri, 27 Jun 2025 10:05:00 GMT
- Title: Towards Accurate Heart Rate Measurement from Ultra-Short Video Clips via Periodicity-Guided rPPG Estimation and Signal Reconstruction
- Abstract summary: We aim to accurately measure HR from ultra-short 2-second video clips by addressing two key challenges.<n>First, to overcome the limited number of heartbeat cycles in ultra-short video clips, we propose an effective periodicity-guided r estimation method.<n>Second, to mitigate inaccuracies due to spectral leakage, we propose a generator to reconstruct longer r signals.
- Score: 8.153034573979857
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Many remote Heart Rate (HR) measurement methods focus on estimating remote photoplethysmography (rPPG) signals from video clips lasting around 10 seconds but often overlook the need for HR estimation from ultra-short video clips. In this paper, we aim to accurately measure HR from ultra-short 2-second video clips by specifically addressing two key challenges. First, to overcome the limited number of heartbeat cycles in ultra-short video clips, we propose an effective periodicity-guided rPPG estimation method that enforces consistent periodicity between rPPG signals estimated from ultra-short clips and their much longer ground truth signals. Next, to mitigate estimation inaccuracies due to spectral leakage, we propose including a generator to reconstruct longer rPPG signals from ultra-short ones while preserving their periodic consistency to enable more accurate HR measurement. Extensive experiments on four rPPG estimation benchmark datasets demonstrate that our proposed method not only accurately measures HR from ultra-short video clips but also outperform previous rPPG estimation techniques to achieve state-of-the-art performance.
Related papers
- StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning [24.385061454563836]
Remote photoplethysmography (rmography) estimates the blood volume pulse (BVP) signal from facial videos, enabling contact-free health monitoring.<n> Conventional clip-wise approaches, which use video clips as input, require capturing over one hundred frames before introducing inference.<n>We propose Stream, a unified architecture that enables low-latency frame-wise physiological signal estimation.
arXiv Detail & Related papers (2026-06-22T11:31:01Z) - Towards Athlete Fatigue Assessment from Association Football Videos [53.20057980542362]
This paper builds on state-of-theart Game State Reconstruction methods to extract player trajectories in pitch coordinates.<n>We then construct acceleration--speed profiles from these signals and analyze their behavior as fatigue-related performance indicators.<n>Our results indicate that monocular broadcast videos can recover kinematic patterns that are compatible with A-S-temporal while also revealing sensitivity to trajectory noise, calibration errors, and temporal discontinuities inherent to broadcast footage.
arXiv Detail & Related papers (2026-04-07T09:36:28Z) - Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models [45.94962431110573]
Camera-based monitoring of vital signs, also known as imaging photoplethysmography (i), has seen applications in driver-monitoring, affective computing, and more.<n>We introduce methods that combine signal processing and deep learning methods in an inverse problem.
arXiv Detail & Related papers (2025-03-21T16:11:21Z) - Deep Pulse-Signal Magnification for remote Heart Rate Estimation in Compressed Videos [9.094127664014628]
We present a novel approach to address the impact of video compression on r estimation.
We validate our model by exhaustive evaluations on two publicly available datasets.
arXiv Detail & Related papers (2024-05-04T12:37:07Z) - Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach [62.000948039914135]
Using Differentially Private Gradient Descent with Gradient Clipping (DPSGD-GC) to ensure Differential Privacy (DP) comes at the cost of model performance degradation.
We propose a new error-feedback (EF) DP algorithm as an alternative to DPSGD-GC.
We establish an algorithm-specific DP analysis for our proposed algorithm, providing privacy guarantees based on R'enyi DP.
arXiv Detail & Related papers (2023-11-24T17:56:44Z) - Diffusion Probabilistic Model Made Slim [128.2227518929644]
We introduce a customized design for slim diffusion probabilistic models (DPM) for light-weight image synthesis.
We achieve 8-18x computational complexity reduction as compared to the latent diffusion models on a series of conditional and unconditional image generation tasks.
arXiv Detail & Related papers (2022-11-27T16:27:28Z) - Facial Video-based Remote Physiological Measurement via Self-supervised
Learning [9.99375728024877]
We introduce a novel framework that learns to estimate r signals from facial videos without the need of ground truth signals.
Negative samples are generated via a learnable frequency module, which performs nonlinear signal frequency transformation.
Next, we introduce a local r expert aggregation module to estimate r signals from augmented samples.
It encodes complementary pulsation information from different face regions and aggregate them into one r prediction.
arXiv Detail & Related papers (2022-10-27T13:03:23Z) - WPPG Net: A Non-contact Video Based Heart Rate Extraction Network
Framework with Compatible Training Capability [21.33542693986985]
Our facial skin presents subtle color change known as remote Photoplethys (r) signal, from which we could extract the heart rate of the subject.
Recently many deep learning methods and related datasets on r signal extraction are proposed.
However, because of the time consumption blood flowing through our body and other factors, label waves such as BVP signals have uncertain delays with real r signals in some datasets.
In this paper, by analyzing the common characteristics on rhythm and periodicity of r signals and label waves, we propose a whole set of training methodology which wraps these networks so that they could remain efficient when be trained at
arXiv Detail & Related papers (2022-07-04T19:52:30Z) - Generalizing electrocardiogram delineation: training convolutional
neural networks with synthetic data augmentation [63.51064808536065]
Existing databases for ECG delineation are small, being insufficient in size and in the array of pathological conditions they represent.
This article delves has two main contributions. First, a pseudo-synthetic data generation algorithm was developed, based in probabilistically composing ECG traces given "pools" of fundamental segments, as cropped from the original databases, and a set of rules for their arrangement into coherent synthetic traces.
Second, two novel segmentation-based loss functions have been developed, which attempt at enforcing the prediction of an exact number of independent structures and at producing closer segmentation boundaries by focusing on a reduced number of samples.
arXiv Detail & Related papers (2021-11-25T10:11:41Z) - Real Time Video based Heart and Respiration Rate Monitoring [5.257115841810259]
Smartphone cameras can measure heart rate (HR) and respiration rate (RR)
variation in the intensity of the green channel can be measured by the i signals of the video.
This study aimed to provide a method to extract heart rate and respiration rate using the video of individuals' faces.
arXiv Detail & Related papers (2021-06-04T19:03:21Z) - Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground
Truth for Evaluation [9.883261192383612]
Remote photo-plethysmography (r) uses a camera to estimate a person's heart rate (HR)
HRV is a measure of the fine fluctuations in the intervals between heart beats.
We introduce a refined and efficient real-time r pipeline with novel filtering and motion suppression.
arXiv Detail & Related papers (2020-12-31T18:57:05Z) - Perception Consistency Ultrasound Image Super-resolution via
Self-supervised CycleGAN [63.49373689654419]
We propose a new perception consistency ultrasound image super-resolution (SR) method based on self-supervision and cycle generative adversarial network (CycleGAN)
We first generate the HR fathers and the LR sons of the test ultrasound LR image through image enhancement.
We then make full use of the cycle loss of LR-SR-LR and HR-LR-SR and the adversarial characteristics of the discriminator to promote the generator to produce better perceptually consistent SR results.
arXiv Detail & Related papers (2020-12-28T08:24:04Z) - AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement
with Neural Searching [76.4844593082362]
We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS)
Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
arXiv Detail & Related papers (2020-04-26T05:43:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.