Object Detection During Newborn Resuscitation Activities

• URL: http://arxiv.org/abs/2303.07790v1
• Date: Tue, 14 Mar 2023 11:04:50 GMT
• Title: Object Detection During Newborn Resuscitation Activities
• Authors: {\O}yvind Meinich-Bache, Kjersti Engan, Ivar Austvoll, Trygve Eftest{\o}l, Helge Myklebust, Ladislaus Blacy Yarrot, Hussein Kidanto and Hege Ersdal
• Abstract summary: We propose a two-step process in order to detect activities possibly overlapping in time. The first step is to detect and track the relevant objects, like bag-mask resuscitator, heart rate sensors etc. The performance of the object detection during activities were 96.97 % (ventilations), 100 % (attaching/removing heart rate sensor) and 75 % (suction) on a test set of 20 videos.
• Score: 3.5661795505491445
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Birth asphyxia is a major newborn mortality problem in low-resource countries. International guideline provides treatment recommendations; however, the importance and effect of the different treatments are not fully explored. The available data is collected in Tanzania, during newborn resuscitation, for analysis of the resuscitation activities and the response of the newborn. An important step in the analysis is to create activity timelines of the episodes, where activities include ventilation, suction, stimulation etc. Methods: The available recordings are noisy real-world videos with large variations. We propose a two-step process in order to detect activities possibly overlapping in time. The first step is to detect and track the relevant objects, like bag-mask resuscitator, heart rate sensors etc., and the second step is to use this information to recognize the resuscitation activities. The topic of this paper is the first step, and the object detection and tracking are based on convolutional neural networks followed by post processing. Results: The performance of the object detection during activities were 96.97 % (ventilations), 100 % (attaching/removing heart rate sensor) and 75 % (suction) on a test set of 20 videos. The system also estimate the number of health care providers present with a performance of 71.16 %. Conclusion: The proposed object detection and tracking system provides promising results in noisy newborn resuscitation videos. Significance: This is the first step in a thorough analysis of newborn resuscitation episodes, which could provide important insight about the importance and effect of different newborn resuscitation activities

Related papers

• Advancing Newborn Care: Precise Birth Time Detection Using AI-Driven Thermal Imaging with Adaptive Normalization [1.101731711817642]
  We investigate the fusion of Artificial Intelligence (AI) and thermal imaging to develop the first AI-driven Time of Birth detector. Our methodology involves a three-step process: first, we propose an adaptive normalization method based on Gaussian mixture models (GMM) to mitigate issues related to temperature variations. A precision of 88.1% and a recall of 89.3% are reported in the detection of the newborn within thermal frames during performance evaluation.
  arXiv  Detail & Related papers  (2024-10-14T13:20:51Z)
• Dynamic Gaussian Splatting from Markerless Motion Capture can Reconstruct Infants Movements [2.44755919161855]
  This work paves the way for advanced movement analysis tools that can be applied to diverse clinical populations. We explored the application of dynamic Gaussian splatting to sparse markerless motion capture data. Our results demonstrate the potential of this method in rendering novel views of scenes and tracking infant movements.
  arXiv  Detail & Related papers  (2023-10-30T11:09:39Z)
• Automatic Infant Respiration Estimation from Video: A Deep Flow-based Algorithm and a Novel Public Benchmark [10.097634735211654]
  We develop a deep-learning method for estimating respiratory rate and waveform from plain video footage in natural settings. Our model supports the first public annotated infant respiration dataset with 125 videos. When trained and tested on the AIR-125 infant data, our method significantly outperforms other state-of-the-art methods in respiratory rate estimation.
  arXiv  Detail & Related papers  (2023-07-24T19:59:15Z)
• Activity Recognition From Newborn Resuscitation Videos [3.54339629317433]
  A dataset of recorded signals during newborn resuscitation, including videos, has been collected in Haydom, Tanzania. We propose a two-step deep neural network system, ORAA-net, to do activity recognition during newborn resuscitation. The system recognized the activities newborn uncovered, stimulation, ventilation and suction with a mean precision of 77.67 %, a mean recall of 77,64 %, and a mean accuracy of 92.40 %.
  arXiv  Detail & Related papers  (2023-03-14T11:04:32Z)
• A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
  Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow. The actual grading is mostly done through manual inspection of the acquired images. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
  arXiv  Detail & Related papers  (2021-10-24T18:58:40Z)
• Designing A Clinically Applicable Deep Recurrent Model to Identify Neuropsychiatric Symptoms in People Living with Dementia Using In-Home Monitoring Data [52.40058724040671]
  Agitation is one of the neuropsychiatric symptoms with high prevalence in dementia. Detecting agitation episodes can assist in providing People Living with Dementia (PLWD) with early and timely interventions. This preliminary study presents a supervised learning model to analyse the risk of agitation in PLWD using in-home monitoring data.
  arXiv  Detail & Related papers  (2021-10-19T11:45:01Z)
• One-shot action recognition towards novel assistive therapies [63.23654147345168]
  This work is motivated by the automated analysis of medical therapies that involve action imitation games. The presented approach incorporates a pre-processing step that standardizes heterogeneous motion data conditions. We evaluate the approach on a real use-case of automated video analysis for therapy support with autistic people.
  arXiv  Detail & Related papers  (2021-02-17T19:41:37Z)
• Deep learning in the ultrasound evaluation of neonatal respiratory status [11.308283140003676]
  Lung ultrasound imaging is reaching growing interest from the scientific community. Image analysis and pattern recognition approaches have proven their ability to fully exploit the rich information contained in these data. We present a thorough analysis of recent deep learning networks and training strategies carried out on a vast and challenging multicenter dataset.
  arXiv  Detail & Related papers  (2020-10-31T18:57:55Z)
• Multiple Sclerosis Lesion Activity Segmentation with Attention-Guided Two-Path CNNs [49.32653090178743]
  convolutional neural networks (CNNs) are studied for lesion activity segmentation from two time points. CNNs are designed and evaluated that combine the information from two points in different ways. It is demonstrated that deep learning-based methods outperform classic approaches.
  arXiv  Detail & Related papers  (2020-08-05T08:49:20Z)
• Hybrid Attention for Automatic Segmentation of Whole Fetal Head in Prenatal Ultrasound Volumes [52.53375964591765]
  We propose the first fully-automated solution to segment the whole fetal head in US volumes. The segmentation task is firstly formulated as an end-to-end volumetric mapping under an encoder-decoder deep architecture. We then combine the segmentor with a proposed hybrid attention scheme (HAS) to select discriminative features and suppress the non-informative volumetric features.
  arXiv  Detail & Related papers  (2020-04-28T14:43:05Z)
• ZSTAD: Zero-Shot Temporal Activity Detection [107.63759089583382]
  We propose a novel task setting called zero-shot temporal activity detection (ZSTAD), where activities that have never been seen in training can still be detected. We design an end-to-end deep network based on R-C3D as the architecture for this solution. Experiments on both the THUMOS14 and the Charades datasets show promising performance in terms of detecting unseen activities.
  arXiv  Detail & Related papers  (2020-03-12T02:40:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.