Blood Oxygen Saturation Estimation from Facial Video via DC and AC
components of Spatio-temporal Map
- URL: http://arxiv.org/abs/2212.07116v2
- Date: Sun, 14 May 2023 15:30:13 GMT
- Title: Blood Oxygen Saturation Estimation from Facial Video via DC and AC
components of Spatio-temporal Map
- Authors: Yusuke Akamatsu, Yoshifumi Onishi, Hitoshi Imaoka
- Abstract summary: We propose an Sp2 estimation method from facial videos based on convolutional neural networks (CNN)
Our method constructs CNN models that consider the direct current (DC) and alternating current (AC) components extracted from the RGB signals of facial videos.
Experiments using facial video data from 50 subjects demonstrate that the proposed method achieves a better estimation performance than current state-of-the-art SpO2 estimation methods.
- Score: 4.705291741591329
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Peripheral blood oxygen saturation (SpO2), an indicator of oxygen levels in
the blood, is one of the most important physiological parameters. Although SpO2
is usually measured using a pulse oximeter, non-contact SpO2 estimation methods
from facial or hand videos have been attracting attention in recent years. In
this paper, we propose an SpO2 estimation method from facial videos based on
convolutional neural networks (CNN). Our method constructs CNN models that
consider the direct current (DC) and alternating current (AC) components
extracted from the RGB signals of facial videos, which are important in the
principle of SpO2 estimation. Specifically, we extract the DC and AC components
from the spatio-temporal map using filtering processes and train CNN models to
predict SpO2 from these components. We also propose an end-to-end model that
predicts SpO2 directly from the spatio-temporal map by extracting the DC and AC
components via convolutional layers. Experiments using facial videos and SpO2
data from 50 subjects demonstrate that the proposed method achieves a better
estimation performance than current state-of-the-art SpO2 estimation methods.
Related papers
- MPCNN: A Novel Matrix Profile Approach for CNN-based Sleep Apnea
Classification [0.0]
Sleep apnea (SA) is a significant respiratory condition that poses a major global health challenge.
Previous studies have investigated several machine and deep learning models for electrocardiogram (ECG)-based SA diagnoses.
We propose an innovative approach to address this diagnostic gap by delving deeper into the comprehensive segments of the ECG signal.
arXiv Detail & Related papers (2023-11-25T14:39:12Z) - FastCPH: Efficient Survival Analysis for Neural Networks [57.03275837523063]
We propose FastCPH, a new method that runs in linear time and supports both the standard Breslow and Efron methods for tied events.
We also demonstrate the performance of FastCPH combined with LassoNet, a neural network that provides interpretability through feature sparsity.
arXiv Detail & Related papers (2022-08-21T03:35:29Z) - Improving Classification Model Performance on Chest X-Rays through Lung
Segmentation [63.45024974079371]
We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations.
Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
arXiv Detail & Related papers (2022-02-22T15:24:06Z) - Evaluating System Identification Methods for Predicting Thermal
Dissipation of Heterogeneous SoCs [0.0]
We focus on modeling approaches that can predict the temperature based on the clock frequency and the utilization percentage of each core.
We investigate three methods with respect to their prediction accuracy: a linear state-space identification approach using regressors, a NARX neural network approach and a recurrent neural network approach.
The results show that the model based on regressors significantly outperformed the other two models when trained with 1 hour and 6 hours of data.
arXiv Detail & Related papers (2021-12-19T11:26:02Z) - A Deep Learning Based Multitask Network for Respiration Rate Estimation
-- A Practical Perspective [1.290382979353427]
This paper presents a multitasking architecture based on Deep Learning (DL) for estimating instantaneous and average respiration rate from ECG and accelerometer signals.
The proposed model showed better overall accuracy and gave better results than individual modalities during different activities.
arXiv Detail & Related papers (2021-12-13T11:33:42Z) - Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based
Sparse PCA Network [93.22587316229954]
We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E)
We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
arXiv Detail & Related papers (2021-10-27T19:28:36Z) - Mesh convolutional neural networks for wall shear stress estimation in
3D artery models [7.7393800633675465]
We propose to use mesh convolutional neural networks that directly operate on the same finite-element surface mesh as used in CFD.
We show that our flexible deep learning model can accurately predict 3D wall shear stress vectors on this surface mesh.
arXiv Detail & Related papers (2021-09-10T11:32:05Z) - Spatial-Temporal Correlation and Topology Learning for Person
Re-Identification in Videos [78.45050529204701]
We propose a novel framework to pursue discriminative and robust representation by modeling cross-scale spatial-temporal correlation.
CTL utilizes a CNN backbone and a key-points estimator to extract semantic local features from human body.
It explores a context-reinforced topology to construct multi-scale graphs by considering both global contextual information and physical connections of human body.
arXiv Detail & Related papers (2021-04-15T14:32:12Z) - A Novel Prediction Approach for Exploring PM2.5 Spatiotemporal
Propagation Based on Convolutional Recursive Neural Networks [7.131106953836335]
The prediction system of PM2.5 propagation provides more detailed and accurate information as an early warning system to reduce health impacts on the community.
This research was conducted by using dataset of air quality monitoring systems in Taiwan.
In general, the model is able to provide accurate predictive results by considering the bonds among measurement nodes in both spatially and temporally.
arXiv Detail & Related papers (2021-01-15T17:00:04Z) - Video-based Facial Expression Recognition using Graph Convolutional
Networks [57.980827038988735]
We introduce a Graph Convolutional Network (GCN) layer into a common CNN-RNN based model for video-based facial expression recognition.
We evaluate our method on three widely-used datasets, CK+, Oulu-CASIA and MMI, and also one challenging wild dataset AFEW8.0.
arXiv Detail & Related papers (2020-10-26T07:31:51Z) - Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals.
Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts.
We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
arXiv Detail & Related papers (2020-06-18T09:49:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.