A Supervised Learning Approach for Robust Health Monitoring using Face Videos

• URL: http://arxiv.org/abs/2102.00322v1
• Date: Sat, 30 Jan 2021 22:03:16 GMT
• Title: A Supervised Learning Approach for Robust Health Monitoring using Face Videos
• Authors: Mayank Gupta and Lingjun Chen and Denny Yu and Vaneet Aggarwal
• Abstract summary: Non-contact, device-free human sensing methods can eliminate the need for specialized heart and blood pressure monitoring equipment. In this paper, we used a non-contact method that only requires face videos recorded using commercially-available webcams. The proposed approach used facial recognition to detect the face in each frame of the video using facial landmarks.
• Score: 32.157163136267954
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Monitoring of cardiovascular activity is highly desired and can enable novel applications in diagnosing potential cardiovascular diseases and maintaining an individual's well-being. Currently, such vital signs are measured using intrusive contact devices such as an electrocardiogram (ECG), chest straps, and pulse oximeters that require the patient or the health provider to manually implement. Non-contact, device-free human sensing methods can eliminate the need for specialized heart and blood pressure monitoring equipment. Non-contact methods can have additional advantages since they are scalable with any environment where video can be captured, can be used for continuous measurements, and can be used on patients with varying levels of dexterity and independence, from people with physical impairments to infants (e.g., baby camera). In this paper, we used a non-contact method that only requires face videos recorded using commercially-available webcams. These videos were exploited to predict the health attributes like pulse rate and variance in pulse rate. The proposed approach used facial recognition to detect the face in each frame of the video using facial landmarks, followed by supervised learning using deep neural networks to train the machine learning model. The videos captured subjects performing different physical activities that result in varying cardiovascular responses. The proposed method did not require training data from every individual and thus the prediction can be obtained for the new individuals for which there is no prior data; critical in approach generalization. The approach was also evaluated on a dataset of people with different ethnicity. The proposed approach had less than a 4.6\% error in predicting the pulse rate.

Related papers

• Chaos in Motion: Unveiling Robustness in Remote Heart Rate Measurement through Brain-Inspired Skin Tracking [7.688280190165613]
  Existing remote heart rate measurement methods have three serious problems. We apply chaos theory to computer vision tasks for the first time, thus a brain-inspired framework. Our method achieves Robust Skin Tracking for Heart Rate measurement, called HR-RST.
  arXiv  Detail & Related papers  (2024-04-11T12:26:10Z)
• Knowledge-Distilled Graph Neural Networks for Personalized Epileptic Seizure Detection [43.905374104261014]
  We propose a novel knowledge distillation approach to transfer the knowledge from a sophisticated seizure detector (called the teacher) trained on data from the full set of electrodes to learn new detectors (called the student) They are both providing lightweight implementations and significantly reducing the number of electrodes needed for recording the EEG. Our experiments show that both knowledge-distillation and personalization play significant roles in improving performance of seizure detection, particularly for patients with scarce EEG data.
  arXiv  Detail & Related papers  (2023-04-03T15:37:40Z)
• Dataset Creation Pipeline for Camera-Based Heart Rate Estimation [0.3058685580689604]
  Heart rate is one of the most vital health metrics which can be utilized to investigate and gain intuitions into various human physiological and psychological information. Various techniques for camera-based heart rate estimation have been developed ranging from classical image processing to convoluted deep learning models and architectures. In this paper, we discuss how to prepare data for the task of developing an algorithm or machine learning model for heart rate estimation from images of facial regions.
  arXiv  Detail & Related papers  (2023-03-02T18:28:29Z)
• An Algorithm for the Labeling and Interactive Visualization of the Cerebrovascular System of Ischemic Strokes [59.116811751334225]
  VirtualDSA++ is an algorithm designed to segment and label the cerebrovascular tree on CTA scans. We extend the labeling mechanism for the cerebral arteries to identify occluded vessels. We present the generic concept of iterative systematic search for pathways on all nodes of said model, which enables new interactive features.
  arXiv  Detail & Related papers  (2022-04-26T14:20:26Z)
• Machine learning models and facial regions videos for estimating heart rate: a review on Patents, Datasets and Literature [0.0]
  Estimating heart rate is important for monitoring users in various situations. Estimates based on facial videos are increasingly being researched because it makes it possible to monitor cardiac information in a non-invasive way. This study investigates the benefits and challenges of using machine learning models to estimate heart rate from facial videos.
  arXiv  Detail & Related papers  (2022-02-17T21:54:29Z)
• The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Video [10.479541955106328]
  The ability to reliably estimate physiological signals from video is a powerful tool in low-cost, pre-clinical health monitoring. We propose a new approach to remote photoplethysmography (r) - the measurement of blood volume changes from observations of a person's face or skin.
  arXiv  Detail & Related papers  (2021-11-18T15:21:33Z)
• A Spatio-temporal Attention-based Model for Infant Movement Assessment from Videos [44.71923220732036]
  We develop a new method for fidgety movement assessment using human poses extracted from short clips. Human poses capture only relevant motion profiles of joints and limbs and are free from irrelevant appearance artifacts. Our experiments show that the proposed method achieves the ROC-AUC score of 81.87%, significantly outperforming existing competing methods with better interpretability.
  arXiv  Detail & Related papers  (2021-05-20T14:31:54Z)
• One-shot action recognition towards novel assistive therapies [63.23654147345168]
  This work is motivated by the automated analysis of medical therapies that involve action imitation games. The presented approach incorporates a pre-processing step that standardizes heterogeneous motion data conditions. We evaluate the approach on a real use-case of automated video analysis for therapy support with autistic people.
  arXiv  Detail & Related papers  (2021-02-17T19:41:37Z)
• MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement [17.038017337552724]
  We present a novel meta-learning approach called MetaPhys for personalized video-based cardiac measurement. Our method uses only 18-seconds of video for customization and works effectively in both supervised and unsupervised manners.
  arXiv  Detail & Related papers  (2020-10-05T04:41:03Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.