Generalization of Video-Based Heart Rate Estimation Methods To Low Illumination and Elevated Heart Rates

• URL: http://arxiv.org/abs/2503.11697v1
• Date: Tue, 11 Mar 2025 18:29:10 GMT
• Title: Generalization of Video-Based Heart Rate Estimation Methods To Low Illumination and Elevated Heart Rates
• Authors: Bhargav Acharya, William Saakyan, Barbara Hammer, Hanna Drimalla,
• Abstract summary: Heart rate is a physiological signal that provides information about an individual's health and affective state.<n>We evaluate representative state-of-the-art methods for estimation of heart rate using remote photoplethysmography (r)<n>Our experimental results indicate that classical methods are not significantly impacted by low-light conditions.<n>Some deep learning methods were found to be more robust to changes in lighting conditions but encountered challenges in estimating high heart rates.
• Score: 3.8886059978578595
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Heart rate is a physiological signal that provides information about an individual's health and affective state. Remote photoplethysmography (rPPG) allows the estimation of this signal from video recordings of a person's face. Classical rPPG methods make use of signal processing techniques, while recent rPPG methods utilize deep learning networks. Methods are typically evaluated on datasets collected in well-lit environments with participants at resting heart rates. However, little investigation has been done on how well these methods adapt to variations in illumination and heart rate. In this work, we systematically evaluate representative state-of-the-art methods for remote heart rate estimation. Specifically, we evaluate four classical methods and four deep learning-based rPPG estimation methods in terms of their generalization ability to changing scenarios, including low lighting conditions and elevated heart rates. For a thorough evaluation of existing approaches, we collected a novel dataset called CHILL, which systematically varies heart rate and lighting conditions. The dataset consists of recordings from 45 participants in four different scenarios. The video data was collected under two different lighting conditions (high and low) and normal and elevated heart rates. In addition, we selected two public datasets to conduct within- and cross-dataset evaluations of the rPPG methods. Our experimental results indicate that classical methods are not significantly impacted by low-light conditions. Meanwhile, some deep learning methods were found to be more robust to changes in lighting conditions but encountered challenges in estimating high heart rates. The cross-dataset evaluation revealed that the selected deep learning methods underperformed when influencing factors such as elevated heart rates and low lighting conditions were not present in the training set.

Related papers

• Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models [45.94962431110573]
  Camera-based monitoring of vital signs, also known as imaging photoplethysmography (i), has seen applications in driver-monitoring, affective computing, and more. We introduce methods that combine signal processing and deep learning methods in an inverse problem.
  arXiv  Detail & Related papers  (2025-03-21T16:11:21Z)
• Multi-task Explainable Skin Lesion Classification [54.76511683427566]
  We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
  arXiv  Detail & Related papers  (2023-10-11T05:49:47Z)
• RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopy [83.4885991036141]
  RIDE is a learning-based method for rotation-equivariant detection and invariant description. It is trained in a self-supervised manner on a large curation of endoscopic images. It sets a new state-of-the-art performance on matching and relative pose estimation tasks.
  arXiv  Detail & Related papers  (2023-09-18T08:16:30Z)
• Successive Subspace Learning for Cardiac Disease Classification with Two-phase Deformation Fields from Cine MRI [36.044984400761535]
  This work proposes a lightweight successive subspace learning framework for CVD classification. It is based on an interpretable feedforward design, in conjunction with a cardiac atlas. Compared with 3D CNN-based approaches, our framework achieves superior classification performance with 140$times$ fewer parameters.
  arXiv  Detail & Related papers  (2023-01-21T15:00:59Z)
• DRNet: Decomposition and Reconstruction Network for Remote Physiological Measurement [39.73408626273354]
  Existing methods are generally divided into two groups. The first focuses on mining the subtle volume pulse (BVP) signals from face videos, but seldom explicitly models the noises that dominate face video content. The second focuses on modeling noisy data directly, resulting in suboptimal performance due to the lack of regularity of these severe random noises.
  arXiv  Detail & Related papers  (2022-06-12T07:40:10Z)
• DeepTechnome: Mitigating Unknown Bias in Deep Learning Based Assessment of CT Images [44.62475518267084]
  We debias deep learning models during training against unknown bias. We use control regions as surrogates that carry information regarding the bias. Applying the proposed method to learn from data exhibiting a strong bias, it near-perfectly recovers the classification performance observed when training with corresponding unbiased data.
  arXiv  Detail & Related papers  (2022-05-26T12:18:48Z)
• A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
  Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow. The actual grading is mostly done through manual inspection of the acquired images. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
  arXiv  Detail & Related papers  (2021-10-24T18:58:40Z)
• Segmentation-free Heart Pathology Detection Using Deep Learning [12.065014651638943]
  We propose a novel segmentation-free heart sound classification method. Specifically, we apply discrete wavelet transform to denoise the signal, followed by feature extraction and feature reduction. Support Vector Machines and Deep Neural Networks are utilised for classification.
  arXiv  Detail & Related papers  (2021-08-09T16:09:30Z)
• Assessment of Deep Learning-based Heart Rate Estimation using Remote Photoplethysmography under Different Illuminations [17.60589015651357]
  We present a public dataset, namely the BH-r dataset, which contains data from twelve subjects under three illuminations: low, medium, and high. We evaluate the performance of three deep learning-based methods using two public datasets: the U-r dataset and the BH-r dataset.
  arXiv  Detail & Related papers  (2021-07-28T06:50:52Z)
• MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement [17.038017337552724]
  We present a novel meta-learning approach called MetaPhys for personalized video-based cardiac measurement. Our method uses only 18-seconds of video for customization and works effectively in both supervised and unsupervised manners.
  arXiv  Detail & Related papers  (2020-10-05T04:41:03Z)
• A Comparative Evaluation of Heart Rate Estimation Methods using Face Videos [25.413558889761127]
  Four alternatives from the literature are tested, three based in hand crafted approaches and one based on deep learning. Experiments show that the learning-based method achieves much better accuracy than the hand crafted ones. The low error rate achieved by the learning based model makes possible its application in real scenarios.
  arXiv  Detail & Related papers  (2020-05-22T10:54:49Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)
• On indirect assessment of heart rate in video [9.176056742068813]
  Problem of indirect assessment of heart rate in video is addressed. Regression models of dependency of heart rate on estimated age and motion intensity were obtained.
  arXiv  Detail & Related papers  (2020-04-27T10:51:11Z)
• AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching [76.4844593082362]
  We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS) Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2020-04-26T05:43:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.