Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluation

• URL: http://arxiv.org/abs/2012.15846v1
• Date: Thu, 31 Dec 2020 18:57:05 GMT
• Title: Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluation
• Authors: Amogh Gudi, Marian Bittner, Jan van Gemert
• Abstract summary: Remote photo-plethysmography (r) uses a camera to estimate a person's heart rate (HR) HRV is a measure of the fine fluctuations in the intervals between heart beats. We introduce a refined and efficient real-time r pipeline with novel filtering and motion suppression.
• Score: 9.883261192383612
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Remote photo-plethysmography (rPPG) uses a camera to estimate a person's heart rate (HR). Similar to how heart rate can provide useful information about a person's vital signs, insights about the underlying physio/psychological conditions can be obtained from heart rate variability (HRV). HRV is a measure of the fine fluctuations in the intervals between heart beats. However, this measure requires temporally locating heart beats with a high degree of precision. We introduce a refined and efficient real-time rPPG pipeline with novel filtering and motion suppression that not only estimates heart rates, but also extracts the pulse waveform to time heart beats and measure heart rate variability. This unsupervised method requires no rPPG specific training and is able to operate in real-time. We also introduce a new multi-modal video dataset, VicarPPG 2, specifically designed to evaluate rPPG algorithms on HR and HRV estimation. We validate and study our method under various conditions on a comprehensive range of public and self-recorded datasets, showing state-of-the-art results and providing useful insights into some unique aspects. Lastly, we make available CleanerPPG, a collection of human-verified ground truth peak/heart-beat annotations for existing rPPG datasets. These verified annotations should make future evaluations and benchmarking of rPPG algorithms more accurate, standardized and fair.

Related papers

• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• Improving Diffusion Models for ECG Imputation with an Augmented Template Prior [43.6099225257178]
  noisy and poor-quality recordings are a major issue for signals collected using mobile health systems. Recent studies have explored the imputation of missing values in ECG with probabilistic time-series models. We present a template-guided denoising diffusion probabilistic model (DDPM), PulseDiff, which is conditioned on an informative prior for a range of health conditions.
  arXiv  Detail & Related papers  (2023-10-24T11:34:15Z)
• Semantic-aware Temporal Channel-wise Attention for Cardiac Function Assessment [69.02116920364311]
  Existing video-based methods do not pay much attention to the left ventricular region, nor the left ventricular changes caused by motion. We propose a semi-supervised auxiliary learning paradigm with a left ventricular segmentation task, which contributes to the representation learning for the left ventricular region. Our approach achieves state-of-the-art performance on the Stanford dataset with an improvement of 0.22 MAE, 0.26 RMSE, and 1.9% $R2$.
  arXiv  Detail & Related papers  (2023-10-09T05:57:01Z)
• Quality Assessment of Photoplethysmography Signals For Cardiovascular Biomarkers Monitoring Using Wearable Devices [0.0]
  Photoplethysmography is a non-invasive technology that measures changes in blood volume in the microvascular bed of tissue. Photoplethysmography allows for the assessment of parameters that can indicate conditions such as vasoconstriction or vasodilation.
  arXiv  Detail & Related papers  (2023-07-17T18:26:57Z)
• BeliefPPG: Uncertainty-aware Heart Rate Estimation from PPG signals via Belief Propagation [21.759742456358012]
  We present a novel learning-based method that achieves state-of-the-art performance on several heart rate benchmarks extracted from photoplethysmography signals. We derive a distribution over possible heart rate values for a given PPG signal window through a trained Markov network. We show the robustness of our method on eight public datasets with three different cross-validation experiments.
  arXiv  Detail & Related papers  (2023-06-13T12:36:00Z)
• Camera-Based HRV Prediction for Remote Learning Environments [4.074837550066978]
  Restoring blood volume pulse signals from facial videos is a challenging task that involves a series of preprocessing, image algorithms, and postprocessing to restore waveforms. The challenge in obtaining HRV indices through r is the necessity for algorithms to precisely predict the BVP peak positions. In this paper, we collected the Remote Learning Affect and Physiology (RLAP) dataset, which includes over 32 hours of highly synchronized video and labels from 58 subjects. Using the RLAP dataset, we trained a new model called Seq-r, it is a model based on one-dimensional convolution, and experimental results reveal
  arXiv  Detail & Related papers  (2023-05-07T02:26:00Z)
• A Web Application for Experimenting and Validating Remote Measurement of Vital Signs [0.0]
  Remote Photoplethysmography (r) techniques compute vital signs from facial videos. We implemented a web application framework to measure a person's Heart Rate (HR), Heart Rate Variability (HRV), Blood Pressure (BP), and stress from face video. The accuracy and robustness of the framework was validated with the help of volunteers.
  arXiv  Detail & Related papers  (2022-08-21T16:07:46Z)
• Real Time Video based Heart and Respiration Rate Monitoring [5.257115841810259]
  Smartphone cameras can measure heart rate (HR) and respiration rate (RR) variation in the intensity of the green channel can be measured by the i signals of the video. This study aimed to provide a method to extract heart rate and respiration rate using the video of individuals' faces.
  arXiv  Detail & Related papers  (2021-06-04T19:03:21Z)
• Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling [121.50704279659253]
  We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations. We then use the distilled physiological features for robust multi-task physiological measurements. The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
  arXiv  Detail & Related papers  (2020-07-16T09:39:17Z)
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation [51.72616167073565]
  We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
  arXiv  Detail & Related papers  (2020-06-28T21:03:19Z)
• AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching [76.4844593082362]
  We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS) Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2020-04-26T05:43:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.