Robust Neonatal Face Detection in Real-world Clinical Settings
- URL: http://arxiv.org/abs/2204.00655v1
- Date: Fri, 1 Apr 2022 18:50:47 GMT
- Title: Robust Neonatal Face Detection in Real-world Clinical Settings
- Authors: Jacqueline Hausmann, Md Sirajus Salekin, Ghada Zamzmi, Dmitry Goldgof,
Yu Sun
- Abstract summary: Current face detection algorithms are extremely generalized and can obtain decent accuracy when detecting the adult faces.
By training a state-of-the-art face detection model, You-Only-Look-Once, on a proprietary dataset containing labelled neonate faces in a clinical setting, this work achieves near real time neonate face detection.
Preliminary findings show an accuracy of 68.7%, compared to the off the shelf solution which detected neonate faces with an accuracy of 7.37%.
- Score: 4.263900348596098
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Current face detection algorithms are extremely generalized and can obtain
decent accuracy when detecting the adult faces. These approaches are
insufficient when handling outlier cases, for example when trying to detect the
face of a neonate infant whose face composition and expressions are relatively
different than that of the adult. It is furthermore difficult when applied to
detect faces in a complicated setting such as the Neonate Intensive Care Unit.
By training a state-of-the-art face detection model, You-Only-Look-Once, on a
proprietary dataset containing labelled neonate faces in a clinical setting,
this work achieves near real time neonate face detection. Our preliminary
findings show an accuracy of 68.7%, compared to the off the shelf solution
which detected neonate faces with an accuracy of 7.37%. Although further
experiments are needed to validate our model, our results are promising and
prove the feasibility of detecting neonatal faces in challenging real-world
settings. The robust and real-time detection of neonatal faces would benefit
wide range of automated systems (e.g., pain recognition and surveillance) who
currently suffer from the time and effort due to the necessity of manual
annotations. To benefit the research community, we make our trained weights
publicly available at github(https://github.com/ja05haus/trained_neonate_face).
Related papers
- UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization.
We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
arXiv Detail & Related papers (2024-07-26T20:51:54Z) - DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake
Detection [67.3143177137102]
Deepfake detection refers to detecting artificially generated or edited faces in images or videos.
We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
arXiv Detail & Related papers (2023-12-07T07:19:45Z) - An Evaluation of Forensic Facial Recognition [16.17759191184531]
We describe the construction of a large-scale synthetic facial dataset along with a controlled facial forensic lineup.
We evaluate the accuracy of two popular neural-based recognition systems.
We find that previously reported face recognition accuracies of more than 95% drop to as low as 65% in this more challenging forensic scenario.
arXiv Detail & Related papers (2023-11-10T16:02:46Z) - Exploring Decision-based Black-box Attacks on Face Forgery Detection [53.181920529225906]
Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy.
Although face forgery detection has successfully distinguished fake faces, recent studies have demonstrated that face forgery detectors are very vulnerable to adversarial examples.
arXiv Detail & Related papers (2023-10-18T14:49:54Z) - Neonatal Face and Facial Landmark Detection from Video Recordings [2.6091909702028584]
This paper explores automated face and facial landmark detection of neonates.
It is an important first step in many video-based neonatal health applications, such as vital sign estimation, pain assessment, sleep-wake classification, and jaundice detection.
arXiv Detail & Related papers (2023-02-08T21:18:18Z) - Towards early prediction of neurodevelopmental disorders: Computational
model for Face Touch and Self-adaptors in Infants [0.0]
evaluating a baby's movements is key to understanding possible risks of developmental disorders in their growth.
Previous research in psychology has shown that measuring specific movements or gestures such as face touches in babies is essential to analyse how babies understand themselves and their context.
This research proposes the first automatic approach that detects face touches from video recordings by tracking infants' movements and gestures.
arXiv Detail & Related papers (2023-01-07T18:08:43Z) - Detect Faces Efficiently: A Survey and Evaluations [13.105528567365281]
Many applications including face recognition, facial expression recognition, face tracking and head-pose estimation assume that both the location and the size of faces are known in the image.
Deep learning techniques brought remarkable breakthroughs to face detection along with the price of a considerable increase in computation.
This paper introduces representative deep learning-based methods and presents a deep and thorough analysis in terms of accuracy and efficiency.
arXiv Detail & Related papers (2021-12-03T08:39:40Z) - InfAnFace: Bridging the infant-adult domain gap in facial landmark
estimation in the wild [0.2786153781225931]
InfAnFace is a richly-annotated dataset of infant faces.
We benchmark the performance of existing facial landmark estimation algorithms trained on adult faces.
We put forward the next potential steps to bridge that gap.
arXiv Detail & Related papers (2021-10-17T22:12:16Z) - FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in
the Wild [50.8865921538953]
We propose a method to explicitly incorporate facial semantics into age estimation.
We design a face parsing-based network to learn semantic information at different scales.
We show that our method consistently outperforms all existing age estimation methods.
arXiv Detail & Related papers (2021-06-21T14:31:32Z) - Representative Forgery Mining for Fake Face Detection [52.896286647898386]
We propose an attention-based data augmentation framework to guide detector refine and enlarge its attention.
Our method tracks and occludes the Top-N sensitive facial regions, encouraging the detector to mine deeper into the regions ignored before for more representative forgery.
arXiv Detail & Related papers (2021-04-14T03:24:19Z) - VideoForensicsHQ: Detecting High-quality Manipulated Face Videos [77.60295082172098]
We show how the performance of forgery detectors depends on the presence of artefacts that the human eye can see.
We introduce a new benchmark dataset for face video forgery detection, of unprecedented quality.
arXiv Detail & Related papers (2020-05-20T21:17:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.