EVM-CNN: Real-Time Contactless Heart Rate Estimation from Facial Video
- URL: http://arxiv.org/abs/2212.13843v1
- Date: Sun, 25 Dec 2022 15:25:15 GMT
- Title: EVM-CNN: Real-Time Contactless Heart Rate Estimation from Facial Video
- Authors: Ying Qiu, Yang Liu, Juan Arteaga-Falconi, Haiwei Dong, and
Abdulmotaleb El Saddik
- Abstract summary: A new framework is introduced to remotely estimate the heart rate (HR) under realistic conditions by combining spatial and temporal filtering and a convolutional neural network.
Our proposed approach shows better performance compared with the benchmark on the MMSE-HR dataset in terms of both the average HR estimation and short-time HR estimation.
- Score: 9.664590078212441
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: With the increase in health consciousness, noninvasive body monitoring has
aroused interest among researchers. As one of the most important pieces of
physiological information, researchers have remotely estimated the heart rate
(HR) from facial videos in recent years. Although progress has been made over
the past few years, there are still some limitations, like the processing time
increasing with accuracy and the lack of comprehensive and challenging datasets
for use and comparison. Recently, it was shown that HR information can be
extracted from facial videos by spatial decomposition and temporal filtering.
Inspired by this, a new framework is introduced in this paper to remotely
estimate the HR under realistic conditions by combining spatial and temporal
filtering and a convolutional neural network. Our proposed approach shows
better performance compared with the benchmark on the MMSE-HR dataset in terms
of both the average HR estimation and short-time HR estimation. High
consistency in short-time HR estimation is observed between our method and the
ground truth.
Related papers
- Synthesizing Multimodal Electronic Health Records via Predictive Diffusion Models [69.06149482021071]
We propose a novel EHR data generation model called EHRPD.
It is a diffusion-based model designed to predict the next visit based on the current one while also incorporating time interval estimation.
We conduct experiments on two public datasets and evaluate EHRPD from fidelity, privacy, and utility perspectives.
arXiv Detail & Related papers (2024-06-20T02:20:23Z) - REST: Efficient and Accelerated EEG Seizure Analysis through Residual State Updates [54.96885726053036]
This paper introduces a novel graph-based residual state update mechanism (REST) for real-time EEG signal analysis.
By leveraging a combination of graph neural networks and recurrent structures, REST efficiently captures both non-Euclidean geometry and temporal dependencies within EEG data.
Our model demonstrates high accuracy in both seizure detection and classification tasks.
arXiv Detail & Related papers (2024-06-03T16:30:19Z) - Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
Engagement measurement finds application in healthcare, education, services.
Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors.
We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
arXiv Detail & Related papers (2024-04-05T20:39:16Z) - Cumulative Stay-time Representation for Electronic Health Records in
Medical Event Time Prediction [8.261597797345342]
We propose a novel data representation for EHR called cumulative stay-time representation (CTR)
CTR directly models such cumulative health conditions.
We derive a trainable construction of CTR based on neural networks that has the flexibility to fit the target data.
arXiv Detail & Related papers (2022-04-28T12:34:41Z) - Generating Synthetic Mixed-type Longitudinal Electronic Health Records
for Artificial Intelligent Applications [9.374416143268892]
generative adversarial network (GAN) entitled EHR-M-GAN which synthesizes textitmixed-type timeseries EHR data.
We have validated EHR-M-GAN on three publicly-available intensive care unit databases with records from a total of 141,488 unique patients.
arXiv Detail & Related papers (2021-12-22T17:17:34Z) - Video-based Remote Physiological Measurement via Cross-verified Feature
Disentangling [121.50704279659253]
We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations.
We then use the distilled physiological features for robust multi-task physiological measurements.
The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
arXiv Detail & Related papers (2020-07-16T09:39:17Z) - MOMBAT: Heart Rate Monitoring from Face Video using Pulse Modeling and
Bayesian Tracking [10.43230025523549]
We propose a novel face video based HR monitoring method MOMBAT.
We utilize out-of-plane face movements to define a novel quality estimation mechanism.
We design a Bayesian decision theory based HR tracking mechanism to rectify the spurious HR estimates.
arXiv Detail & Related papers (2020-05-10T09:41:16Z) - AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement
with Neural Searching [76.4844593082362]
We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS)
Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
arXiv Detail & Related papers (2020-04-26T05:43:21Z) - Deep-HR: Fast Heart Rate Estimation from Face Video Under Realistic
Conditions [62.68522031911656]
We propose a simple yet efficient approach to benefit the advantages of the Deep Neural Network (DNN) by simplifying HR estimation from a complex task to learning from very correlated representation to HR.
To be more accurate and work well on low-quality videos, two deep encoder-decoder networks are trained to refine the output of FE.
Experimental results on HR-D and MAHNOB datasets confirm that our method could run as a real-time method and estimate the average HR better than state-of-the-art ones.
arXiv Detail & Related papers (2020-02-12T07:00:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.