Machine learning models and facial regions videos for estimating heart rate: a review on Patents, Datasets and Literature

• URL: http://arxiv.org/abs/2202.08913v1
• Date: Thu, 17 Feb 2022 21:54:29 GMT
• Title: Machine learning models and facial regions videos for estimating heart rate: a review on Patents, Datasets and Literature
• Authors: Tiago Palma Pagano, Lucas Lemos Ortega, Victor Rocha Santos, Yasmin da Silva Bonfim, Jos\'e Vin\'icius Dantas Paranhos, Paulo Henrique Miranda S\'a, Lian Filipe Santana Nascimento, Ingrid Winkler, Erick Giovani Sperandio Nascimento
• Abstract summary: Estimating heart rate is important for monitoring users in various situations. Estimates based on facial videos are increasingly being researched because it makes it possible to monitor cardiac information in a non-invasive way. This study investigates the benefits and challenges of using machine learning models to estimate heart rate from facial videos.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Estimating heart rate is important for monitoring users in various situations. Estimates based on facial videos are increasingly being researched because it makes it possible to monitor cardiac information in a non-invasive way and because the devices are simpler, requiring only cameras that capture the user's face. From these videos of the user's face, machine learning is able to estimate heart rate. This study investigates the benefits and challenges of using machine learning models to estimate heart rate from facial videos, through patents, datasets, and articles review. We searched Derwent Innovation, IEEE Xplore, Scopus, and Web of Science knowledge bases and identified 7 patent filings, 11 datasets, and 20 articles on heart rate, photoplethysmography, or electrocardiogram data. In terms of patents, we note the advantages of inventions related to heart rate estimation, as described by the authors. In terms of datasets, we discovered that most of them are for academic purposes and with different signs and annotations that allow coverage for subjects other than heartbeat estimation. In terms of articles, we discovered techniques, such as extracting regions of interest for heart rate reading and using Video Magnification for small motion extraction, and models such as EVM-CNN and VGG-16, that extract the observed individual's heart rate, the best regions of interest for signal extraction and ways to process them.

Related papers

• Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Model [66.35766658717205]
  There is a severe shortage of experienced cardiac sonographers, due to the heart's complex structure and significant operational challenges. We present a Cardiac Copilot system capable of providing real-time probe movement guidance. The core innovation lies in proposing a data-driven world model, named Cardiac Dreamer, for representing cardiac spatial structures. We train our model with real-world ultrasound data and corresponding probe motion from 110 routine clinical scans with 151K sample pairs by three certified sonographers.
  arXiv  Detail & Related papers  (2024-06-19T02:42:29Z)
• CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstruction [62.61209705638161]
  There has been growing interest in deep learning-based CMR imaging algorithms. Deep learning methods require large training datasets. This dataset includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects.
  arXiv  Detail & Related papers  (2023-09-19T15:14:42Z)
• Intelligent Robotic Sonographer: Mutual Information-based Disentangled Reward Learning from Few Demonstrations [42.731081399649916]
  This work proposes an intelligent robotic sonographer to autonomously "explore" target anatomies and navigate a US probe to a relevant 2D plane by learning from the expert. The underlying high-level physiological knowledge from experts is inferred by a neural reward function. The proposed advanced framework can robustly work on a variety of seen and unseen phantoms as well as in-vivo human carotid data.
  arXiv  Detail & Related papers  (2023-07-07T16:30:50Z)
• Motion Magnification in Robotic Sonography: Enabling Pulsation-Aware Artery Segmentation [44.868281669589194]
  In order to improve the artery segmentation accuracy and stability during scans, this work presents a novel pulsation-assisted segmentation neural network (PAS-NN) Motion magnification techniques are employed to amplify the subtle motion within the frequency band of interest to extract the pulsation signals from sequential US images. The extracted real-time pulsation information can help to locate the arteries on cross-section US images.
  arXiv  Detail & Related papers  (2023-07-07T16:14:17Z)
• Knowledge-Distilled Graph Neural Networks for Personalized Epileptic Seizure Detection [43.905374104261014]
  We propose a novel knowledge distillation approach to transfer the knowledge from a sophisticated seizure detector (called the teacher) trained on data from the full set of electrodes to learn new detectors (called the student) They are both providing lightweight implementations and significantly reducing the number of electrodes needed for recording the EEG. Our experiments show that both knowledge-distillation and personalization play significant roles in improving performance of seizure detection, particularly for patients with scarce EEG data.
  arXiv  Detail & Related papers  (2023-04-03T15:37:40Z)
• Dataset Creation Pipeline for Camera-Based Heart Rate Estimation [0.3058685580689604]
  Heart rate is one of the most vital health metrics which can be utilized to investigate and gain intuitions into various human physiological and psychological information. Various techniques for camera-based heart rate estimation have been developed ranging from classical image processing to convoluted deep learning models and architectures. In this paper, we discuss how to prepare data for the task of developing an algorithm or machine learning model for heart rate estimation from images of facial regions.
  arXiv  Detail & Related papers  (2023-03-02T18:28:29Z)
• Remote Photoplethysmography from Low Resolution videos: An end-to-end solution using Efficient ConvNets [0.2768955853144218]
  We propose to use efficient convolutional networks to accurately measure the heart rate of user from low resolution facial videos. To ensure that we are able to obtain the heart rate in real time, we compress the deep learning model by pruning it, thereby reducing its memory footprint.
  arXiv  Detail & Related papers  (2022-08-14T10:04:25Z)
• A Supervised Learning Approach for Robust Health Monitoring using Face Videos [32.157163136267954]
  Non-contact, device-free human sensing methods can eliminate the need for specialized heart and blood pressure monitoring equipment. In this paper, we used a non-contact method that only requires face videos recorded using commercially-available webcams. The proposed approach used facial recognition to detect the face in each frame of the video using facial landmarks.
  arXiv  Detail & Related papers  (2021-01-30T22:03:16Z)
• Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluation [9.883261192383612]
  Remote photo-plethysmography (r) uses a camera to estimate a person's heart rate (HR) HRV is a measure of the fine fluctuations in the intervals between heart beats. We introduce a refined and efficient real-time r pipeline with novel filtering and motion suppression.
  arXiv  Detail & Related papers  (2020-12-31T18:57:05Z)
• Identification of Ischemic Heart Disease by using machine learning technique based on parameters measuring Heart Rate Variability [50.591267188664666]
  In this study, 18 non-invasive features (age, gender, left ventricular ejection fraction and 15 obtained from HRV) of 243 subjects were used to train and validate a series of several ANN. The best result was obtained using 7 input parameters and 7 hidden nodes with an accuracy of 98.9% and 82% for the training and validation dataset.
  arXiv  Detail & Related papers  (2020-10-29T19:14:41Z)
• Heart Rate Estimation from Face Videos for Student Assessment: Experiments on edBB [24.666654058140836]
  This study focuses on the RGB and near-infrared video sequences for performing heart rate estimation applying remote photoplethysmography techniques. Experiments include behavioral and physiological data from 25 different students completing a collection of tasks related to e-learning. Our proposed face heart rate estimation approach is compared with the heart rate provided by the smartwatch, achieving very promising results for its future deployment in e-learning applications.
  arXiv  Detail & Related papers  (2020-06-01T10:04:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.