Non-Contact Heart Rate Measurement from Deteriorated Videos
- URL: http://arxiv.org/abs/2304.14789v1
- Date: Fri, 28 Apr 2023 11:58:36 GMT
- Title: Non-Contact Heart Rate Measurement from Deteriorated Videos
- Authors: Nhi Nguyen, Le Nguyen, Constantino \'Alvarez Casado, Olli Silv\'en,
Miguel Bordallo L\'opez
- Abstract summary: Remote photoplethysmography (rmography) offers a state-of-the-art, non-contact methodology for estimating human pulse by analyzing facial videos.
In this study, we apply image processing to intentionally degrade video quality, mimicking challenging conditions.
Our results reveal a significant decrease in accuracy in the presence of these artifacts, prompting us to propose the application of restoration techniques.
- Score: 0.3149883354098941
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Remote photoplethysmography (rPPG) offers a state-of-the-art, non-contact
methodology for estimating human pulse by analyzing facial videos. Despite its
potential, rPPG methods can be susceptible to various artifacts, such as noise,
occlusions, and other obstructions caused by sunglasses, masks, or even
involuntary facial contact, such as individuals inadvertently touching their
faces. In this study, we apply image processing transformations to
intentionally degrade video quality, mimicking these challenging conditions,
and subsequently evaluate the performance of both non-learning and
learning-based rPPG methods on the deteriorated data. Our results reveal a
significant decrease in accuracy in the presence of these artifacts, prompting
us to propose the application of restoration techniques, such as denoising and
inpainting, to improve heart-rate estimation outcomes. By addressing these
challenging conditions and occlusion artifacts, our approach aims to make rPPG
methods more robust and adaptable to real-world situations. To assess the
effectiveness of our proposed methods, we undertake comprehensive experiments
on three publicly available datasets, encompassing a wide range of scenarios
and artifact types. Our findings underscore the potential to construct a robust
rPPG system by employing an optimal combination of restoration algorithms and
rPPG techniques. Moreover, our study contributes to the advancement of
privacy-conscious rPPG methodologies, thereby bolstering the overall utility
and impact of this innovative technology in the field of remote heart-rate
estimation under realistic and diverse conditions.
Related papers
- KID-PPG: Knowledge Informed Deep Learning for Extracting Heart Rate from a Smartwatch [3.329222353111594]
We propose a knowledge-informed deep learning model that integrates expert knowledge through adaptive linear filtering, deep probabilistic inference, and data augmentation.
Our results demonstrate a significant improvement in heart rate tracking through the incorporation of prior knowledge into deep learning models.
This approach shows promise in enhancing various biomedical applications by incorporating existing expert knowledge in deep learning models.
arXiv Detail & Related papers (2024-05-02T16:56:09Z) - Evaluation of Video-Based rPPG in Challenging Environments: Artifact Mitigation and Network Resilience [1.6637373649145606]
Video-based remote photoplethysmography (r) has emerged as a promising technology for non-contact vital sign monitoring.
However, the accurate measurement of vital signs in real-world scenarios faces several challenges.
arXiv Detail & Related papers (2024-05-02T12:21:51Z) - DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery [71.6345505427213]
DPMesh is an innovative framework for occluded human mesh recovery.
It capitalizes on the profound diffusion prior about object structure and spatial relationships embedded in a pre-trained text-to-image diffusion model.
arXiv Detail & Related papers (2024-04-01T18:59:13Z) - Privacy-Preserving Remote Heart Rate Estimation from Facial Videos [19.442685015494316]
Deep learning techniques are vulnerable to perturbation attacks, which can result in significant data breaches.
We propose a data method that involves extraction of certain areas of the face with less identity-related information, followed by pixel shuffling and blurring.
Our approach reduces the accuracy of facial recognition algorithms by over 60%, with minimal impact on r extraction.
arXiv Detail & Related papers (2023-06-01T20:48:04Z) - Learning from Multi-Perception Features for Real-Word Image
Super-resolution [87.71135803794519]
We propose a novel SR method called MPF-Net that leverages multiple perceptual features of input images.
Our method incorporates a Multi-Perception Feature Extraction (MPFE) module to extract diverse perceptual information.
We also introduce a contrastive regularization term (CR) that improves the model's learning capability.
arXiv Detail & Related papers (2023-05-26T07:35:49Z) - Depression Recognition using Remote Photoplethysmography from Facial
Videos [0.3867363075280544]
Depression is a mental illness that may be harmful to an individual's health.
This work analyzes physiological signals to observe if different depressive states have a noticeable impact on the blood volume pulse (BVP) and the heart rate variability (HRV)
We propose a novel scheme that directly extracts them from facial videos, just based on visual information, removing the need for any contact-based device.
arXiv Detail & Related papers (2022-06-09T10:23:49Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - Face2PPG: An unsupervised pipeline for blood volume pulse extraction
from faces [0.456877715768796]
Photoplethys signals have become a key technology in many fields, such as medicine, well-being, or sports.
Our work proposes a set of pipelines to extract PPG signals from the face robustly, reliably, and robustness.
arXiv Detail & Related papers (2022-02-08T19:06:20Z) - Unsupervised deep learning techniques for powdery mildew recognition
based on multispectral imaging [63.62764375279861]
This paper presents a deep learning approach to automatically recognize powdery mildew on cucumber leaves.
We focus on unsupervised deep learning techniques applied to multispectral imaging data.
We propose the use of autoencoder architectures to investigate two strategies for disease detection.
arXiv Detail & Related papers (2021-12-20T13:29:13Z) - Unsupervised Learning Facial Parameter Regressor for Action Unit
Intensity Estimation via Differentiable Renderer [51.926868759681014]
We present a framework to predict the facial parameters based on a bone-driven face model (BDFM) under different views.
The proposed framework consists of a feature extractor, a generator, and a facial parameter regressor.
arXiv Detail & Related papers (2020-08-20T09:49:13Z) - Towards Fine-grained Human Pose Transfer with Detail Replenishing
Network [96.54367984986898]
Human pose transfer (HPT) is an emerging research topic with huge potential in fashion design, media production, online advertising and virtual reality.
Existing HPT methods often suffer from three fundamental issues: detail deficiency, content ambiguity and style inconsistency.
We develop a more challenging yet practical HPT setting, termed as Fine-grained Human Pose Transfer (FHPT), with a higher focus on semantic fidelity and detail replenishment.
arXiv Detail & Related papers (2020-05-26T03:05:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.