Preterm infants' pose estimation with spatio-temporal features

• URL: http://arxiv.org/abs/2005.08648v1
• Date: Fri, 8 May 2020 09:51:22 GMT
• Title: Preterm infants' pose estimation with spatio-temporal features
• Authors: Sara Moccia and Lucia Migliorelli and Virgilio Carnielli and Emanuele Frontoni
• Abstract summary: This paper introduces the use of preterm-temporal features for limb detection and tracking. It is the first study to use depth videos acquired in the actual clinical practice for limb-pose estimation.
• Score: 7.054093620465401
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Objective: Preterm infants' limb monitoring in neonatal intensive care units (NICUs) is of primary importance for assessing infants' health status and motor/cognitive development. Herein, we propose a new approach to preterm infants' limb pose estimation that features spatio-temporal information to detect and track limb joints from depth videos with high reliability. Methods: Limb-pose estimation is performed using a deep-learning framework consisting of a detection and a regression convolutional neural network (CNN) for rough and precise joint localization, respectively. The CNNs are implemented to encode connectivity in the temporal direction through 3D convolution. Assessment of the proposed framework is performed through a comprehensive study with sixteen depth videos acquired in the actual clinical practice from sixteen preterm infants (the babyPose dataset). Results: When applied to pose estimation, the median root mean squared distance, computed among all limbs, between the estimated and the ground-truth pose was 9.06 pixels, overcoming approaches based on spatial features only (11.27pixels). Conclusion: Results showed that the spatio-temporal features had a significant influence on the pose-estimation performance, especially in challenging cases (e.g., homogeneous image intensity). Significance: This paper significantly enhances the state of art in automatic assessment of preterm infants' health status by introducing the use of spatio-temporal features for limb detection and tracking, and by being the first study to use depth videos acquired in the actual clinical practice for limb-pose estimation. The babyPose dataset has been released as the first annotated dataset for infants' pose estimation.

Related papers

• Modeling 3D Infant Kinetics Using Adaptive Graph Convolutional Networks [2.2279946664123664]
  Spontaneous motor activity, orkinetics', is shown to provide a powerful surrogate measure of upcoming neurodevelopment. Here, we follow an alternative approach, predicting infants' maturation based on data-driven evaluation of individual motor patterns.
  arXiv  Detail & Related papers  (2024-02-22T09:34:48Z)
• Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the Art [9.327466428403916]
  We introduce a groundbreaking dataset called InfActPrimitive'', encompassing five significant infant milestone action categories. We conduct an extensive comparative analysis employing cutting-edge skeleton-based action recognition models. Our findings reveal that, although the PoseC3D model achieves the highest accuracy at approximately 71%, the remaining models struggle to accurately capture the dynamics of infant actions.
  arXiv  Detail & Related papers  (2023-11-21T02:36:47Z)
• Tissue Classification During Needle Insertion Using Self-Supervised Contrastive Learning and Optical Coherence Tomography [53.38589633687604]
  We propose a deep neural network that classifies the tissues from the phase and intensity data of complex OCT signals acquired at the needle tip. We show that with 10% of the training set, our proposed pretraining strategy helps the model achieve an F1 score of 0.84 whereas the model achieves an F1 score of 0.60 without it.
  arXiv  Detail & Related papers  (2023-04-26T14:11:04Z)
• NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants [73.85768093666582]
  We propose an explainable geometric deep network dubbed NeuroExplainer. NeuroExplainer is used to uncover altered infant cortical development patterns associated with preterm birth.
  arXiv  Detail & Related papers  (2023-01-01T12:48:12Z)
• Neurodevelopmental Phenotype Prediction: A State-of-the-Art Deep Learning Model [0.0]
  We apply a deep neural network to analyse the cortical surface data of neonates. Our goal is to identify neurodevelopmental biomarkers and to predict gestational age at birth based on these biomarkers.
  arXiv  Detail & Related papers  (2022-11-16T11:15:23Z)
• Automatic Assessment of Infant Face and Upper-Body Symmetry as Early Signs of Torticollis [11.187291473332325]
  We apply computer vision pose estimation techniques developed expressly for the data-scarce infant domain to the study of torticollis. We use a combination of facial landmark and body joint estimation techniques designed for infants to estimate a range of geometric measures pertaining to face and upper body symmetry.
  arXiv  Detail & Related papers  (2022-10-26T20:39:14Z)
• White Matter Tracts are Point Clouds: Neuropsychological Score Prediction and Critical Region Localization via Geometric Deep Learning [68.5548609642999]
  We propose a deep-learning-based framework for neuropsychological score prediction using white matter tract data. We represent the arcuate fasciculus (AF) as a point cloud with microstructure measurements at each point. We improve prediction performance with the proposed Paired-Siamese Loss that utilizes information about differences between continuous neuropsychological scores.
  arXiv  Detail & Related papers  (2022-07-06T02:03:28Z)
• Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Tracking [98.91894395941766]
  We propose a novel online approach to learning the pose dynamics, which are independent of pose detections in current fame. Specifically, we derive this prediction of dynamics through a graph neural network(GNN) that explicitly accounts for both spatial-temporal and visual information. Experiments on PoseTrack 2017 and PoseTrack 2018 datasets demonstrate that the proposed method achieves results superior to the state of the art on both human pose estimation and tracking tasks.
  arXiv  Detail & Related papers  (2021-06-07T16:36:50Z)
• Towards human-level performance on automatic pose estimation of infant spontaneous movements [2.7086496937827005]
  Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries.
  arXiv  Detail & Related papers  (2020-10-12T18:17:47Z)
• Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and Convolutional Neural Networks [68.96150598294072]
  Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights. It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness. In recent years, there has been a significant effort to automate the diagnosis using deep learning. This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN) Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
  arXiv  Detail & Related papers  (2020-04-03T14:07:41Z)
• 1-D Convlutional Neural Networks for the Analysis of Pupil Size Variations in Scotopic Conditions [79.71065005161566]
  1-D convolutional neural network models are trained for classification of short-range sequences. Model provides prediction with high average accuracy on a hold out test set.
  arXiv  Detail & Related papers  (2020-02-06T17:25:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.