BioFace3D: A fully automatic pipeline for facial biomarkers extraction of 3D face reconstructions segmented from MRI

• URL: http://arxiv.org/abs/2410.00711v1
• Date: Tue, 1 Oct 2024 14:02:58 GMT
• Title: BioFace3D: A fully automatic pipeline for facial biomarkers extraction of 3D face reconstructions segmented from MRI
• Authors: Álvaro Heredia-Lidón, Luis M. Echeverry-Quiceno, Alejandro González, Noemí Hostalet, Edith Pomarol-Clotet, Juan Fortea, Mar Fatjó-Vilas, Neus Martínez-Abadías, Xavier Sevillano,
• Abstract summary: We present BioFace3D as a fully automatic tool for the calculation of facial biomarkers using facial models reconstructed from magnetic resonance images. The tool is divided into three automatic modules for the extraction of 3D facial models from magnetic resonance images, the registration of anatomical 3D landmarks, and the calculation of facial biomarkers from landmarks coordinates using geometric morphometrics techniques.
• Score: 33.7054351451505
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Facial dysmorphologies have emerged as potential critical indicators in the diagnosis and prognosis of genetic, psychotic and rare disorders. While in certain conditions these dysmorphologies are severe, in other cases may be subtle and not perceivable to the human eye, requiring precise quantitative tools for their identification. Manual coding of facial dysmorphologies is a burdensome task and is subject to inter- and intra-observer variability. To overcome this gap, we present BioFace3D as a fully automatic tool for the calculation of facial biomarkers using facial models reconstructed from magnetic resonance images. The tool is divided into three automatic modules for the extraction of 3D facial models from magnetic resonance images, the registration of homologous 3D landmarks encoding facial morphology, and the calculation of facial biomarkers from anatomical landmarks coordinates using geometric morphometrics techniques.

Related papers

• Electromyography-Informed Facial Expression Reconstruction for Physiological-Based Synthesis and Analysis [6.129164512102711]
  The relationship between muscle activity and resulting facial expressions is crucial for various fields, including psychology, medicine, and entertainment. Existing methods for facial analysis cannot handle electrode occlusion, rendering them ineffective. Our approach is a novel method to restore faces under sEMG occlusion faithfully in an adversarial manner. We validate the effectiveness of our approach through experiments on a dataset of synchronized sEMG recordings and facial mimicry.
  arXiv  Detail & Related papers  (2025-03-12T17:21:10Z)
• A 3D Facial Reconstruction Evaluation Methodology: Comparing Smartphone Scans with Deep Learning Based Methods Using Geometry and Morphometry Criteria [60.865754842465684]
  Three-dimensional (3D) facial shape analysis has gained interest due to its potential clinical applications. High cost of advanced 3D facial acquisition systems limits their widespread use, driving the development of low-cost acquisition and reconstruction methods. This study introduces a novel evaluation methodology that goes beyond traditional geometry-based benchmarks by integrating morphometric shape analysis techniques.
  arXiv  Detail & Related papers  (2025-02-13T15:47:45Z)
• FaceDig: Automated tool for placing landmarks on facial portraits for geometric morphometrics users [0.0]
  FaceDig is an AI-powered tool designed to automate landmark placement with human-level precision. It was trained using one of the largest and most ethnically diverse face datasets. Our results demonstrate that FaceDig provides reliable landmark coordinates, comparable to those placed manually by experts.
  arXiv  Detail & Related papers  (2024-11-03T10:03:52Z)
• Skull-to-Face: Anatomy-Guided 3D Facial Reconstruction and Editing [34.39385635485985]
  This paper proposes an end-to-end 3D face reconstruction and exploration tool. We generate an initial reference 3D face, whose biological profile aligns with the given skull. We then adapt these initial faces to meet the statistical expectations of extruded anatomical landmarks on the skull.
  arXiv  Detail & Related papers  (2024-03-24T16:03:27Z)
• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• Fast refacing of MR images with a generative neural network lowers re-identification risk and preserves volumetric consistency [5.040145546652933]
  We propose a novel method for anonymised face generation for 3D T1-weighted scans based on a 3D conditional generative adversarial network. The proposed method takes 9 seconds for face generation and is suitable for recovering consistent post-processing results after defacing.
  arXiv  Detail & Related papers  (2023-05-26T13:34:14Z)
• Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
  We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks. In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics. Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
  arXiv  Detail & Related papers  (2022-09-19T09:43:19Z)
• Controllable Evaluation and Generation of Physical Adversarial Patch on Face Recognition [49.42127182149948]
  Recent studies have revealed the vulnerability of face recognition models against physical adversarial patches. We propose to simulate the complex transformations of faces in the physical world via 3D-face modeling. We further propose a Face3DAdv method considering the 3D face transformations and realistic physical variations.
  arXiv  Detail & Related papers  (2022-03-09T10:21:40Z)
• Texture Characterization of Histopathologic Images Using Ecological Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
  This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate. It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
  arXiv  Detail & Related papers  (2022-02-27T02:19:09Z)
• Morphology Decoder: A Machine Learning Guided 3D Vision Quantifying Heterogenous Rock Permeability for Planetary Surveillance and Robotic Functions [0.0]
  Permeability has a dominant influence on the flow properties of a natural fluid. Lattice Boltzmann simulator determines permeability from the nano and micropore network. We propose a morphology decoder, a parallel and serial flow reconstruction of machine learning segmented heterogeneous Cretaceous texture.
  arXiv  Detail & Related papers  (2021-11-26T12:20:03Z)
• Explainable multiple abnormality classification of chest CT volumes with AxialNet and HiResCAM [89.2175350956813]
  We introduce the challenging new task of explainable multiple abnormality classification in volumetric medical images. We propose a multiple instance learning convolutional neural network, AxialNet, that allows identification of top slices for each abnormality. We then aim to improve the model's learning through a novel mask loss that leverages HiResCAM and 3D allowed regions.
  arXiv  Detail & Related papers  (2021-11-24T01:14:33Z)
• Comprehensive Validation of Automated Whole Body Skeletal Muscle, Adipose Tissue, and Bone Segmentation from 3D CT images for Body Composition Analysis: Towards Extended Body Composition [0.6176955945418618]
  Powerful tools of artificial intelligence such as deep learning are making it feasible now to segment the entire 3D image and generate accurate measurements of all internal anatomy. These will enable the overcoming of the severe bottleneck that existed previously, namely, the need for manual segmentation. These measurements were hitherto unavailable thereby limiting the field to a very small and limited subset.
  arXiv  Detail & Related papers  (2021-06-01T17:30:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.