Automatic Infant Respiration Estimation from Video: A Deep Flow-based Algorithm and a Novel Public Benchmark

• URL: http://arxiv.org/abs/2307.13110v1
• Date: Mon, 24 Jul 2023 19:59:15 GMT
• Title: Automatic Infant Respiration Estimation from Video: A Deep Flow-based Algorithm and a Novel Public Benchmark
• Authors: Sai Kumar Reddy Manne, Shaotong Zhu, Sarah Ostadabbas, Michael Wan
• Abstract summary: We develop a deep-learning method for estimating respiratory rate and waveform from plain video footage in natural settings. Our model supports the first public annotated infant respiration dataset with 125 videos. When trained and tested on the AIR-125 infant data, our method significantly outperforms other state-of-the-art methods in respiratory rate estimation.
• Score: 10.097634735211654
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Respiration is a critical vital sign for infants, and continuous respiratory monitoring is particularly important for newborns. However, neonates are sensitive and contact-based sensors present challenges in comfort, hygiene, and skin health, especially for preterm babies. As a step toward fully automatic, continuous, and contactless respiratory monitoring, we develop a deep-learning method for estimating respiratory rate and waveform from plain video footage in natural settings. Our automated infant respiration flow-based network (AIRFlowNet) combines video-extracted optical flow input and spatiotemporal convolutional processing tuned to the infant domain. We support our model with the first public annotated infant respiration dataset with 125 videos (AIR-125), drawn from eight infant subjects, set varied pose, lighting, and camera conditions. We include manual respiration annotations and optimize AIRFlowNet training on them using a novel spectral bandpass loss function. When trained and tested on the AIR-125 infant data, our method significantly outperforms other state-of-the-art methods in respiratory rate estimation, achieving a mean absolute error of $\sim$2.9 breaths per minute, compared to $\sim$4.7--6.2 for other public models designed for adult subjects and more uniform environments.

Related papers

• Machine learning-based algorithms for at-home respiratory disease monitoring and respiratory assessment [45.104212062055424]
  This work aims to develop machine learning-based algorithms to facilitate at-home respiratory disease monitoring and assessment. Data were collected from 30 healthy adults, encompassing respiratory pressure, flow, and dynamic thoraco-abdominal circumferential measurements. Various machine learning models, including the random forest classifier, logistic regression, and support vector machine (SVM), were trained to predict breathing types.
  arXiv  Detail & Related papers  (2024-09-05T02:14:31Z)
• Using BOLD-fMRI to Compute the Respiration Volume per Time (RTV) and Respiration Variation (RV) with Convolutional Neural Networks (CNN) in the Human Connectome Development Cohort [55.41644538483948]
  This study proposes a one-dimensional CNN model for reconstruction of two respiratory measures, RV and RVT. Results show that a CNN can capture informative features from resting BOLD signals and reconstruct realistic RV and RVT timeseries.
  arXiv  Detail & Related papers  (2023-07-03T18:06:36Z)
• Object Detection During Newborn Resuscitation Activities [3.5661795505491445]
  We propose a two-step process in order to detect activities possibly overlapping in time. The first step is to detect and track the relevant objects, like bag-mask resuscitator, heart rate sensors etc. The performance of the object detection during activities were 96.97 % (ventilations), 100 % (attaching/removing heart rate sensor) and 75 % (suction) on a test set of 20 videos.
  arXiv  Detail & Related papers  (2023-03-14T11:04:50Z)
• Activity Recognition From Newborn Resuscitation Videos [3.54339629317433]
  A dataset of recorded signals during newborn resuscitation, including videos, has been collected in Haydom, Tanzania. We propose a two-step deep neural network system, ORAA-net, to do activity recognition during newborn resuscitation. The system recognized the activities newborn uncovered, stimulation, ventilation and suction with a mean precision of 77.67 %, a mean recall of 77,64 %, and a mean accuracy of 92.40 %.
  arXiv  Detail & Related papers  (2023-03-14T11:04:32Z)
• TempNet: Temporal Attention Towards the Detection of Animal Behaviour in Videos [63.85815474157357]
  We propose an efficient computer vision- and deep learning-based method for the detection of biological behaviours in videos. TempNet uses an encoder bridge and residual blocks to maintain model performance with a two-staged, spatial, then temporal, encoder. We demonstrate its application to the detection of sablefish (Anoplopoma fimbria) startle events.
  arXiv  Detail & Related papers  (2022-11-17T23:55:12Z)
• Differentiable Frequency-based Disentanglement for Aerial Video Action Recognition [56.91538445510214]
  We present a learning algorithm for human activity recognition in videos. Our approach is designed for UAV videos, which are mainly acquired from obliquely placed dynamic cameras. We conduct extensive experiments on the UAV Human dataset and the NEC Drone dataset.
  arXiv  Detail & Related papers  (2022-09-15T22:16:52Z)
• Energy-Efficient Respiratory Anomaly Detection in Premature Newborn Infants [1.845415610921548]
  We propose a Deep Learning enabled wearable monitoring system for premature newborn infants. Respiratory cessation is predicted using signals that are collected wirelessly from a non-invasive wearable Bellypatch put on infant's body. We select a solution that achieves 93.33% accuracy with 18 times lower energy compared with baseline 1DCNN model.
  arXiv  Detail & Related papers  (2022-02-21T23:15:03Z)
• Prediction of Neonatal Respiratory Distress in Term Babies at Birth from Digital Stethoscope Recorded Chest Sounds [2.466324275447402]
  This paper investigates the usage of digital stethoscope recorded chest sounds taken within 1min post-delivery. The algorithm produced specificity, sensitivity, and accuracy results of 85.0%, 66.7% and 81.8%, respectively.
  arXiv  Detail & Related papers  (2022-01-25T05:46:52Z)
• Sleep Apnea and Respiratory Anomaly Detection from a Wearable Band and Oxygen Saturation [1.2291501047353484]
  There is a need in general medicine and critical care for a more convenient method to automatically detect sleep apnea from a simple, easy-to-wear device. The objective is to automatically detect abnormal respiration and estimate the Apnea-Hypopnea-Index (AHI) with a wearable respiratory device. Four models were trained: one each using the respiratory features only, a feature from the SpO2 (%)-signal only, and two additional models that use the respiratory features and the SpO2 (%)-feature.
  arXiv  Detail & Related papers  (2021-02-24T02:04:57Z)
• 2-D Respiration Navigation Framework for 3-D Continuous Cardiac Magnetic Resonance Imaging [61.701281723900216]
  We propose a sampling adaption to acquire 2-D respiration information during a continuous scan. We develop a pipeline to extract the different respiration states from the acquired signals, which are used to reconstruct data from one respiration phase.
  arXiv  Detail & Related papers  (2020-12-26T08:29:57Z)
• Identification of deep breath while moving forward based on multiple body regions and graph signal analysis [45.62293065676075]
  This paper presents an unobtrusive solution that can automatically identify deep breath when a person is walking past the global depth camera. In validation experiments, the proposed approach outperforms the comparative methods with the accuracy, precision, recall and F1 of 75.5%, 76.2%, 75.0% and 75.2%, respectively.
  arXiv  Detail & Related papers  (2020-10-20T08:26:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.