ReViSe: Remote Vital Signs Measurement Using Smartphone Camera

• URL: http://arxiv.org/abs/2206.08748v1
• Date: Mon, 13 Jun 2022 19:20:11 GMT
• Title: ReViSe: Remote Vital Signs Measurement Using Smartphone Camera
• Authors: Donghao Qiao, Amtul Haq Ayesha, Farhana Zulkernine, Raihan Masroor, Nauman Jaffar
• Abstract summary: Remote Photoplethysmography (rVi) is a fast, effective, inexpensive and convenient method for collecting biometric data. We propose an end-to-end framework to measure people's vital signs based on the ruration of a user's face captured with a smartphone camera. We extract face landmarks with a deep learning-based neural network model in real-time.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Remote Photoplethysmography (rPPG) is a fast, effective, inexpensive and convenient method for collecting biometric data as it enables vital signs estimation using face videos. Remote contactless medical service provisioning has proven to be a dire necessity during the COVID-19 pandemic. We propose an end-to-end framework to measure people's vital signs including Heart Rate (HR), Heart Rate Variability (HRV), Oxygen Saturation (SpO2) and Blood Pressure (BP) based on the rPPG methodology from the video of a user's face captured with a smartphone camera. We extract face landmarks with a deep learning-based neural network model in real-time. Multiple face patches also called Region-of-Interests (RoIs) are extracted by using the predicted face landmarks. Several filters are applied to reduce the noise from the RoIs in the extracted cardiac signals called Blood Volume Pulse (BVP) signal. We trained and validated machine learning models using two public rPPG datasets namely the TokyoTech rPPG and the Pulse Rate Detection (PURE) datasets, on which our models achieved the following Mean Absolute Errors (MAE): a) for HR, 1.73 and 3.95 Beats-Per-Minute (bpm) respectively, b) for HRV, 18.55 and 25.03 ms respectively, and c) for SpO2, a MAE of 1.64 on the PURE dataset. We validated our end-to-end rPPG framework, ReViSe, in real life environment, and thereby created the Video-HR dataset. Our HR estimation model achieved a MAE of 2.49 bpm on this dataset. Since no publicly available rPPG datasets existed for BP measurement with face videos, we used a dataset with signals from fingertip sensor to train our model and also created our own video dataset, Video-BP. On our Video-BP dataset, our BP estimation model achieved a MAE of 6.7 mmHg for Systolic Blood Pressure (SBP), and a MAE of 9.6 mmHg for Diastolic Blood Pressure (DBP).

Related papers

• SMILE-UHURA Challenge -- Small Vessel Segmentation at Mesoscopic Scale from Ultra-High Resolution 7T Magnetic Resonance Angiograms [60.35639972035727]
  The lack of publicly available annotated datasets has impeded the development of robust, machine learning-driven segmentation algorithms. The SMILE-UHURA challenge addresses the gap in publicly available annotated datasets by providing an annotated dataset of Time-of-Flight angiography acquired with 7T MRI. Dice scores reached up to 0.838 $pm$ 0.066 and 0.716 $pm$ 0.125 on the respective datasets, with an average performance of up to 0.804 $pm$ 0.15.
  arXiv  Detail & Related papers  (2024-11-14T17:06:00Z)
• Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes [22.23531900474421]
  Video photoplethysmography is an emerging method for non-invasive and convenient measurement of physiological signals. This dataset is designed to validate video vitals estimation algorithms and fusing videos from different positions. Our findings suggest that simultaneous training on multiple indicators, such as PPG and blood oxygen, can reduce MAE in SpO2 estimation by 17.8%.
  arXiv  Detail & Related papers  (2024-09-28T03:36:16Z)
• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• Phase-shifted remote photoplethysmography for estimating heart rate and blood pressure from facial video [4.392877207448768]
  Heart rate and blood pressure are important biometric information for the monitoring of cardiovascular system. In this thesis, we propose a vision-based method for estimating the heart rate and blood pressure. This thesis proposes a 2-stage deep learning framework consisting of a dual remote photoplethysmography network (BP-Net) and bounded blood pressure network (BBP-Net)
  arXiv  Detail & Related papers  (2024-01-09T13:56:37Z)
• Video-based sympathetic arousal assessment via peripheral blood flow estimation [46.695433930419945]
  We present a novel approach to infer sympathetic arousal by measuring the peripheral blood flow on the face or hand optically. We show that sympathetic arousal is best inferred from the forehead, finger, or palm.
  arXiv  Detail & Related papers  (2023-11-12T19:06:33Z)
• Camera-Based HRV Prediction for Remote Learning Environments [4.074837550066978]
  Restoring blood volume pulse signals from facial videos is a challenging task that involves a series of preprocessing, image algorithms, and postprocessing to restore waveforms. The challenge in obtaining HRV indices through r is the necessity for algorithms to precisely predict the BVP peak positions. In this paper, we collected the Remote Learning Affect and Physiology (RLAP) dataset, which includes over 32 hours of highly synchronized video and labels from 58 subjects. Using the RLAP dataset, we trained a new model called Seq-r, it is a model based on one-dimensional convolution, and experimental results reveal
  arXiv  Detail & Related papers  (2023-05-07T02:26:00Z)
• A Web Application for Experimenting and Validating Remote Measurement of Vital Signs [0.0]
  Remote Photoplethysmography (r) techniques compute vital signs from facial videos. We implemented a web application framework to measure a person's Heart Rate (HR), Heart Rate Variability (HRV), Blood Pressure (BP), and stress from face video. The accuracy and robustness of the framework was validated with the help of volunteers.
  arXiv  Detail & Related papers  (2022-08-21T16:07:46Z)
• Unsupervised Pre-Training on Patient Population Graphs for Patient-Level Predictions [48.02011627390706]
  Pre-training has shown success in different areas of machine learning, such as Computer Vision (CV), Natural Language Processing (NLP) and medical imaging. In this paper, we apply unsupervised pre-training to heterogeneous, multi-modal EHR data for patient outcome prediction. We find that our proposed graph based pre-training method helps in modeling the data at a population level.
  arXiv  Detail & Related papers  (2022-03-23T17:59:45Z)
• A Shallow U-Net Architecture for Reliably Predicting Blood Pressure (BP) from Photoplethysmogram (PPG) and Electrocardiogram (ECG) Signals [1.1695966610359496]
  Most existing methods used in the hospitals for continuous monitoring of Blood Pressure (BP) are invasive. In this study, we explored the applicability of autoencoders in predicting BP from non-invasively collectible signals such as Photoplethysmogram ( PPG) and ECG signals. It was found that a very shallow, one-dimensional autoencoder can extract the relevant features to predict the SBP and DBP with the state-of-the-art performance on a very large dataset.
  arXiv  Detail & Related papers  (2021-11-12T19:34:20Z)
• Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
  In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
  arXiv  Detail & Related papers  (2020-06-18T09:49:11Z)
• AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching [76.4844593082362]
  We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS) Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2020-04-26T05:43:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.