Remote Blood Oxygen Estimation From Videos Using Neural Networks

• URL: http://arxiv.org/abs/2107.05087v1
• Date: Sun, 11 Jul 2021 16:59:49 GMT
• Title: Remote Blood Oxygen Estimation From Videos Using Neural Networks
• Authors: Joshua Mathew, Xin Tian, Min Wu, Chau-Wai Wong
• Abstract summary: Blood oxygen saturation (SpO$$) is an essential indicator of respiratory functionality and is receiving increasing attention during the COVID-19 pandemic. We propose the first convolutional neural network based noncontact SpO$$ estimation scheme using smartphone cameras.
• Score: 14.89693668182024
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Blood oxygen saturation (SpO$_2$) is an essential indicator of respiratory functionality and is receiving increasing attention during the COVID-19 pandemic. Clinical findings show that it is possible for COVID-19 patients to have significantly low SpO$_2$ before any obvious symptoms. The prevalence of cameras has motivated researchers to investigate methods for monitoring SpO$_2$ using videos. Most prior schemes involving smartphones are contact-based: They require a fingertip to cover the phone's camera and the nearby light source to capture re-emitted light from the illuminated tissue. In this paper, we propose the first convolutional neural network based noncontact SpO$_2$ estimation scheme using smartphone cameras. The scheme analyzes the videos of a participant's hand for physiological sensing, which is convenient and comfortable, and can protect their privacy and allow for keeping face masks on. We design our neural network architectures inspired by the optophysiological models for SpO$_2$ measurement and demonstrate the explainability by visualizing the weights for channel combination. Our proposed models outperform the state-of-the-art model that is designed for contact-based SpO$_2$ measurement, showing the potential of our proposed method to contribute to public health. We also analyze the impact of skin type and the side of a hand on SpO$_2$ estimation performance.

Related papers

• Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators [47.371024581669516]
  Spiking neural networks (SNNs) represent a promising approach to developing artificial neural networks. Applying SNNs to sequential tasks, such as text classification and time-series forecasting, has been hindered by the challenge of creating an effective and hardware-friendly spike-form positional encoding strategy. We propose a novel PE technique for SNNs, termed CPG-PE. We demonstrate that the commonly used sinusoidal PE is mathematically a specific solution to the membrane potential dynamics of a particular CPG.
  arXiv  Detail & Related papers  (2024-05-23T09:39:12Z)
• Model Explainability in Physiological and Healthcare-based Neural Networks [26.241527103973887]
  The COVID-19 pandemic has highlighted the importance of early detection of changes in SpO2. Traditional SpO2 measurement methods rely on contact-based sensing. pulse oximeters may not be available in marginalized communities or undeveloped countries. Our proposed method can provide a more efficient and accurate way to monitor SpO2 using videos captured from consumer-grade smartphones.
  arXiv  Detail & Related papers  (2023-04-03T20:58:32Z)
• Blood Oxygen Saturation Estimation from Facial Video via DC and AC components of Spatio-temporal Map [4.705291741591329]
  We propose an Sp2 estimation method from facial videos based on convolutional neural networks (CNN) Our method constructs CNN models that consider the direct current (DC) and alternating current (AC) components extracted from the RGB signals of facial videos. Experiments using facial video data from 50 subjects demonstrate that the proposed method achieves a better estimation performance than current state-of-the-art SpO2 estimation methods.
  arXiv  Detail & Related papers  (2022-12-14T09:11:19Z)
• Adapting Brain-Like Neural Networks for Modeling Cortical Visual Prostheses [68.96380145211093]
  Cortical prostheses are devices implanted in the visual cortex that attempt to restore lost vision by electrically stimulating neurons. Currently, the vision provided by these devices is limited, and accurately predicting the visual percepts resulting from stimulation is an open challenge. We propose to address this challenge by utilizing 'brain-like' convolutional neural networks (CNNs), which have emerged as promising models of the visual system.
  arXiv  Detail & Related papers  (2022-09-27T17:33:19Z)
• Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues [81.15465149555864]
  We establish the first joint face spoofing and detection benchmark using both visual appearance and physiological r cues. To enhance the r periodicity discrimination, we design a two-branch physiological network using both facial powerful rtemporal signal map and its continuous wavelet transformed counterpart as inputs.
  arXiv  Detail & Related papers  (2022-08-10T15:41:48Z)
• D'ARTAGNAN: Counterfactual Video Generation [3.4079278794252232]
  Causally-enabled machine learning frameworks could help clinicians to identify the best course of treatments by answering counterfactual questions. We combine deep neural networks, twin causal networks and generative adversarial methods for the first time to build D'ARTAGNAN. We generate new ultrasound videos, retaining the video style and anatomy of the original patient, with variations of the Ejection Fraction conditioned on a given input.
  arXiv  Detail & Related papers  (2022-06-03T15:53:32Z)
• Event-based Video Reconstruction via Potential-assisted Spiking Neural Network [48.88510552931186]
  Bio-inspired neural networks can potentially lead to greater computational efficiency on event-driven hardware. We propose a novel Event-based Video reconstruction framework based on a fully Spiking Neural Network (EVSNN) We find that the spiking neurons have the potential to store useful temporal information (memory) to complete such time-dependent tasks.
  arXiv  Detail & Related papers  (2022-01-25T02:05:20Z)
• Smartphone Camera Oximetry in an Induced Hypoxemia Study [10.837123708913703]
  We create a clinically relevant validation protocol for solely smartphone-based methods on a wide range of SpO$$ values (70%-100%) for the first time. We build a deep learning model using this data to demonstrate accurate reporting of SpO$$ level.
  arXiv  Detail & Related papers  (2021-03-31T18:10:10Z)
• Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling [121.50704279659253]
  We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations. We then use the distilled physiological features for robust multi-task physiological measurements. The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
  arXiv  Detail & Related papers  (2020-07-16T09:39:17Z)
• Two-Stream Deep Feature Modelling for Automated Video Endoscopy Data Analysis [45.19890687786009]
  We propose a two-stream model for endoscopic image analysis. Our model fuses two streams of deep feature inputs by mapping their inherent relations through a novel relational network model.
  arXiv  Detail & Related papers  (2020-07-12T05:24:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.