Passive Heart Rate Monitoring During Smartphone Use in Everyday Life

• URL: http://arxiv.org/abs/2503.03783v3
• Date: Fri, 21 Mar 2025 20:09:40 GMT
• Title: Passive Heart Rate Monitoring During Smartphone Use in Everyday Life
• Authors: Shun Liao, Paolo Di Achille, Jiang Wu, Silviu Borac, Jonathan Wang, Xin Liu, Eric Teasley, Lawrence Cai, Yuzhe Yang, Yun Liu, Daniel McDuff, Hao-Wei Su, Brent Winslow, Anupam Pathak, Shwetak Patel, James A. Taylor, Jameson K. Rogers, Ming-Zher Poh,
• Abstract summary: Resting heart rate (RHR) is an important biomarker of cardiovascular health and mortality.<n>We present PHRM, a deep learning system for passive heart rate (HR) and RHR measurements during everyday smartphone use.
• Score: 28.289115592689644
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Resting heart rate (RHR) is an important biomarker of cardiovascular health and mortality, but tracking it longitudinally generally requires a wearable device, limiting its availability. We present PHRM, a deep learning system for passive heart rate (HR) and RHR measurements during everyday smartphone use, using facial video-based photoplethysmography. Our system was developed using 225,773 videos from 495 participants and validated on 185,970 videos from 205 participants in laboratory and free-living conditions, representing the largest validation study of its kind. Compared to reference electrocardiogram, PHRM achieved a mean absolute percentage error (MAPE) < 10% for HR measurements across three skin tone groups of light, medium and dark pigmentation; MAPE for each skin tone group was non-inferior versus the others. Daily RHR measured by PHRM had a mean absolute error < 5 bpm compared to a wearable HR tracker, and was associated with known risk factors. These results highlight the potential of smartphones to enable passive and equitable heart health monitoring.

Related papers

• Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models [45.94962431110573]
  Camera-based monitoring of vital signs, also known as imaging photoplethysmography (i), has seen applications in driver-monitoring, affective computing, and more. We introduce methods that combine signal processing and deep learning methods in an inverse problem.
  arXiv  Detail & Related papers  (2025-03-21T16:11:21Z)
• Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimation [53.2981100111204]
  Photoplethysmography and electrocardiography can potentially enable continuous blood pressure (BP) monitoring.<n>Yet accurate and robust machine learning (ML) models remains challenging due to variability in data quality and patient-specific factors.<n>In this work, we investigate whether a model pre-trained on one modality can effectively be exploited to improve the accuracy of a different signal type.<n>Our approach achieves near state-of-the-art accuracy for diastolic BP and surpasses by 1.5x the accuracy of prior works for systolic BP.
  arXiv  Detail & Related papers  (2025-02-10T13:33:12Z)
• Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram [4.5546756241897235]
  This study utilizes a publicly available phonocardiogram (PCG) dataset to estimate heart rate. We extend the best-performing model to a multi-task learning framework for simultaneous heart rate estimation and murmur detection.
  arXiv  Detail & Related papers  (2024-07-25T22:56:21Z)
• CMRxRecon2024: A Multi-Modality, Multi-View K-Space Dataset Boosting Universal Machine Learning for Accelerated Cardiac MRI [40.11088079783521]
  The CMRxRecon2024 dataset is the largest and most protocal-diverse publicly available cardiac k-space dataset.<n>It is acquired from 330 healthy volunteers, covering commonly used modalities, anatomical views, and acquisition trajectories in clinical cardiac MRI.
  arXiv  Detail & Related papers  (2024-06-27T09:50:20Z)
• Video-based sympathetic arousal assessment via peripheral blood flow estimation [46.695433930419945]
  We present a novel approach to infer sympathetic arousal by measuring the peripheral blood flow on the face or hand optically. We show that sympathetic arousal is best inferred from the forehead, finger, or palm.
  arXiv  Detail & Related papers  (2023-11-12T19:06:33Z)
• Body Fat Estimation from Surface Meshes using Graph Neural Networks [48.85291874087541]
  We show that triangulated body surface meshes can be used to accurately predict VAT and ASAT volumes using graph neural networks. Our methods achieve high performance while reducing training time and required resources compared to state-of-the-art convolutional neural networks in this area.
  arXiv  Detail & Related papers  (2023-07-13T10:21:34Z)
• Real-Time Monitoring of User Stress, Heart Rate and Heart Rate Variability on Mobile Devices [36.16114600037677]
  Beam AI SDK can monitor user stress through the selfie camera in real-time. We evaluate our technology on the UBFC dataset, the MMSE-HR dataset, and Beam AI's internal data.
  arXiv  Detail & Related papers  (2022-10-04T17:58:37Z)
• Real Time Video based Heart and Respiration Rate Monitoring [5.257115841810259]
  Smartphone cameras can measure heart rate (HR) and respiration rate (RR) variation in the intensity of the green channel can be measured by the i signals of the video. This study aimed to provide a method to extract heart rate and respiration rate using the video of individuals' faces.
  arXiv  Detail & Related papers  (2021-06-04T19:03:21Z)
• Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluation [9.883261192383612]
  Remote photo-plethysmography (r) uses a camera to estimate a person's heart rate (HR) HRV is a measure of the fine fluctuations in the intervals between heart beats. We introduce a refined and efficient real-time r pipeline with novel filtering and motion suppression.
  arXiv  Detail & Related papers  (2020-12-31T18:57:05Z)
• Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling [121.50704279659253]
  We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations. We then use the distilled physiological features for robust multi-task physiological measurements. The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
  arXiv  Detail & Related papers  (2020-07-16T09:39:17Z)
• MOMBAT: Heart Rate Monitoring from Face Video using Pulse Modeling and Bayesian Tracking [10.43230025523549]
  We propose a novel face video based HR monitoring method MOMBAT. We utilize out-of-plane face movements to define a novel quality estimation mechanism. We design a Bayesian decision theory based HR tracking mechanism to rectify the spurious HR estimates.
  arXiv  Detail & Related papers  (2020-05-10T09:41:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.