InfantFace: Detecting infant faces in neonatal clinical environments

• URL: http://arxiv.org/abs/2606.20449v1
• Date: Thu, 18 Jun 2026 16:28:00 GMT
• Title: InfantFace: Detecting infant faces in neonatal clinical environments
• Abstract summary: We propose a one-stage YOLOv11m-based model tailored for face detection of infants in neonatal clinical environments.<n>We combined multiple publicly available datasets (VGGFace2, CelebA, FDDB, WIDER FACE) to train and evaluate our proposed model.<n>Our model achieved an AP50 of 0.87, surpassing the performance of three state-of-the-art general face detectors.
• Score: 1.5484719004172118
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reliable localisation of the neonatal face is the first step for several video-camera based non-contact assessments such as pain and distress related facial expression analysis, pain scoring, cardiorespiratory signal extraction and cessation of breathing alerts. However, major challenges persist in neonatal clinical environments. Cluttered backgrounds, illumination changes and poor lighting conditions can reduce the accuracy of face detection models. Clinical interventions, monitoring equipment and, in some cases, medical devices can obstruct the face, making visual assessment difficult. We propose a one-stage YOLOv11m-based model tailored for face detection of infants in neonatal clinical environments. We combined multiple publicly available datasets (VGGFace2, CelebA, FDDB, WIDER FACE) to train and evaluate our proposed model. We then fine-tuned our model on a neonatal research dataset involving 228 videos from 114 recording sessions of 113 independent infants. Before fine-tuning, our model achieved an AP50 of 0.87, surpassing the performance of three state-of-the-art general face detectors. Performance improved further to an AP50 of 0.96 after clinical-domain adaptation. Evaluating face detection performance across different datasets remains a challenge due to the lack of publicly available neonatal datasets. Prioritising the creation of such datasets, while upholding appropriate privacy safeguards and ethical standards in their creation and use, would greatly support further progress in this field.

Related papers

• NeoRed: A Knowledge-Logic-Alignment Multimodal Large Language Model for Neonatal Respiratory Disease Diagnosis [51.033331232872094]
  Neonatal respiratory diseases are a major cause of neonatal morbidity and mortality.<n>Existing Multimodal Large Language Models (MLLMs) face two key limitations in neonatal diagnosis.<n>We propose NeoRed, to the best of our knowledge, the first MLLM tailored for neonatal respiratory disease.
  arXiv  Detail & Related papers  (2026-09-03T08:24:38Z)
• Decoding Children's Gait Behavior [38.15651454272919]
  We introduce a new problem domain for human action recognition: the analysis of children's gait behaviors from standard RGB video.<n>We specifically target the ambulatory patterns of children aged 3-17 years.<n>Despite their clinical value, current 3D sensor-based gait analysis systems are expensive, intrusive, and often impractical for young subjects.
  arXiv  Detail & Related papers  (2026-08-01T00:53:05Z)
• NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments [1.5484719004172118]
  We propose an end-to-end facial landmark detector capable of predicting 68 landmarks on neonatal faces in clinical environments.<n>We combined 37,459 single-face images from 11 public datasets, standardised to 68-point markup, with 1,123 manually annotated frames from a neonatal research dataset.<n>A YOLO-based keypoint model was adapted to regress the facial landmarks, initialised with weights from a pretrained neonatal face detector.
  arXiv  Detail & Related papers  (2026-06-18T18:08:30Z)
• Beyond Benchmarks of IUGC: Rethinking Requirements of Deep Learning Methods for Intrapartum Ultrasound Biometry from Fetal Ultrasound Videos [58.71502465551297]
  Intrapartum Ultrasound Grand Challenge (IUGC) co-hosted with MICCAI 2024 was launched.<n>IUGC introduces a clinically oriented multi-task automatic measurement framework that integrates standard plane classification, fetal head-pubic symphysis segmentation, and biometry.<n>The challenge releases the largest multi-center intrapartum ultrasound video dataset to date, comprising 774 videos (68,106 frames) collected from three hospitals.
  arXiv  Detail & Related papers  (2026-02-13T13:28:22Z)
• Overcoming Small Data Limitations in Video-Based Infant Respiration Estimation [7.723650415926449]
  We introduce the annotated infant respiration dataset of 400 videos (AIR-400), contributing 275 new annotated videos from 10 recruited subjects to the public corpus.<n>We develop the first reproducible pipelines for infant respiration estimation, based on infant-specific region-of-interest detection andtemporal neural processing enhanced by optical flow inputs.<n>We establish, through comprehensive experiments, the first reproducible benchmarks for the state-of-the-art in vision-based infant respiration estimation.
  arXiv  Detail & Related papers  (2025-12-07T15:25:17Z)
• OpticalDR: A Deep Optical Imaging Model for Privacy-Protective Depression Recognition [66.91236298878383]
  Depression Recognition (DR) poses a considerable challenge, especially in the context of privacy concerns. We design a new imaging system to erase the identity information of captured facial images while retain disease-relevant features. It is irreversible for identity information recovery while preserving essential disease-related characteristics necessary for accurate DR.
  arXiv  Detail & Related papers  (2024-02-29T01:20:29Z)
• Neonatal Face and Facial Landmark Detection from Video Recordings [2.6091909702028584]
  This paper explores automated face and facial landmark detection of neonates. It is an important first step in many video-based neonatal health applications, such as vital sign estimation, pain assessment, sleep-wake classification, and jaundice detection.
  arXiv  Detail & Related papers  (2023-02-08T21:18:18Z)
• Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imaging [47.99192239793597]
  We evaluated the effect of privacy-preserving training of AI models regarding accuracy and fairness compared to non-private training. Our study shows that -- under the challenging realistic circumstances of a real-life clinical dataset -- the privacy-preserving training of diagnostic deep learning models is possible with excellent diagnostic accuracy and fairness.
  arXiv  Detail & Related papers  (2023-02-03T09:49:13Z)
• Towards early prediction of neurodevelopmental disorders: Computational model for Face Touch and Self-adaptors in Infants [0.0]
  evaluating a baby's movements is key to understanding possible risks of developmental disorders in their growth. Previous research in psychology has shown that measuring specific movements or gestures such as face touches in babies is essential to analyse how babies understand themselves and their context. This research proposes the first automatic approach that detects face touches from video recordings by tracking infants' movements and gestures.
  arXiv  Detail & Related papers  (2023-01-07T18:08:43Z)
• Intelligent Sight and Sound: A Chronic Cancer Pain Dataset [74.77784420691937]
  This paper introduces the first chronic cancer pain dataset, collected as part of the Intelligent Sight and Sound (ISS) clinical trial. The data collected to date consists of 29 patients, 509 smartphone videos, 189,999 frames, and self-reported affective and activity pain scores. Using static images and multi-modal data to predict self-reported pain levels, early models show significant gaps between current methods available to predict pain.
  arXiv  Detail & Related papers  (2022-04-07T22:14:37Z)
• Robust Neonatal Face Detection in Real-world Clinical Settings [4.263900348596098]
  Current face detection algorithms are extremely generalized and can obtain decent accuracy when detecting the adult faces. By training a state-of-the-art face detection model, You-Only-Look-Once, on a proprietary dataset containing labelled neonate faces in a clinical setting, this work achieves near real time neonate face detection. Preliminary findings show an accuracy of 68.7%, compared to the off the shelf solution which detected neonate faces with an accuracy of 7.37%.
  arXiv  Detail & Related papers  (2022-04-01T18:50:47Z)
• Deep learning in the ultrasound evaluation of neonatal respiratory status [11.308283140003676]
  Lung ultrasound imaging is reaching growing interest from the scientific community. Image analysis and pattern recognition approaches have proven their ability to fully exploit the rich information contained in these data. We present a thorough analysis of recent deep learning networks and training strategies carried out on a vast and challenging multicenter dataset.
  arXiv  Detail & Related papers  (2020-10-31T18:57:55Z)
• Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and Convolutional Neural Networks [68.96150598294072]
  Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights. It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness. In recent years, there has been a significant effort to automate the diagnosis using deep learning. This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN) Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
  arXiv  Detail & Related papers  (2020-04-03T14:07:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.