FCR: Investigating Generative AI models for Forensic Craniofacial Reconstruction

• URL: http://arxiv.org/abs/2508.18031v1
• Date: Mon, 25 Aug 2025 13:52:59 GMT
• Title: FCR: Investigating Generative AI models for Forensic Craniofacial Reconstruction
• Authors: Ravi Shankar Prasad, Dinesh Singh,
• Abstract summary: We propose a generic framework for craniofacial reconstruction from 2D X-ray images.<n>This is the first time where 2D X-rays are being used as a representation of the skull by generative models for craniofacial reconstruction.<n>By experimental results, we have found that this can be an effective tool for forensic science.
• Score: 2.9936254916060503
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Craniofacial reconstruction in forensics is one of the processes to identify victims of crime and natural disasters. Identifying an individual from their remains plays a crucial role when all other identification methods fail. Traditional methods for this task, such as clay-based craniofacial reconstruction, require expert domain knowledge and are a time-consuming process. At the same time, other probabilistic generative models like the statistical shape model or the Basel face model fail to capture the skull and face cross-domain attributes. Looking at these limitations, we propose a generic framework for craniofacial reconstruction from 2D X-ray images. Here, we used various generative models (i.e., CycleGANs, cGANs, etc) and fine-tune the generator and discriminator parts to generate more realistic images in two distinct domains, which are the skull and face of an individual. This is the first time where 2D X-rays are being used as a representation of the skull by generative models for craniofacial reconstruction. We have evaluated the quality of generated faces using FID, IS, and SSIM scores. Finally, we have proposed a retrieval framework where the query is the generated face image and the gallery is the database of real faces. By experimental results, we have found that this can be an effective tool for forensic science.

Related papers

• Cranio-ID: Graph-Based Craniofacial Identification via Automatic Landmark Annotation in 2D Multi-View X-rays [2.4382430407654767]
  Traditional methods for locating craniometric landmarks are time-consuming and require specialized knowledge and expertise.<n>We propose a novel framework Cranio-ID: First, an automatic annotation of landmarks on 2D skulls with their respective optical images.<n>Second, cross-modal matching by formulating these landmarks into graph representations and then finding semantic correspondence between graphs of these two modalities.
  arXiv  Detail & Related papers  (2025-11-18T12:15:22Z)
• BFSM: 3D Bidirectional Face-Skull Morphable Model [30.3163131796241]
  Building a joint face-skull morphable model holds great potential for applications such as remote diagnostics, surgical planning, medical education, and physically based facial simulation.<n>However, realizing this vision is constrained by the scarcity of paired face-skull data, insufficient registration accuracy, and limited exploration of reconstruction and clinical applications.<n>We introduce the 3D Bidirectional Face-Skull Morphable Model (BFSM), which enables shape inference between the face and skull through a shared space.
  arXiv  Detail & Related papers  (2025-09-29T10:34:13Z)
• Cross-Domain Identity Representation for Skull to Face Matching with Benchmark DataSet [6.1655282360871375]
  We present a framework for the identification of a person given the X-ray image of a skull using convolutional Siamese networks for cross-domain identity representation.<n>Siamese networks are twin networks that share the same architecture and can be trained to discover a feature space where nearby observations that are similar are grouped and dissimilar observations are moved apart.
  arXiv  Detail & Related papers  (2025-07-11T05:49:12Z)
• OSDFace: One-Step Diffusion Model for Face Restoration [72.5045389847792]
  Diffusion models have demonstrated impressive performance in face restoration.<n>We propose OSDFace, a novel one-step diffusion model for face restoration.<n>Results demonstrate that OSDFace surpasses current state-of-the-art (SOTA) methods in both visual quality and quantitative metrics.
  arXiv  Detail & Related papers  (2024-11-26T07:07:48Z)
• UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
  High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization. We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
  arXiv  Detail & Related papers  (2024-07-26T20:51:54Z)
• Skull-to-Face: Anatomy-Guided 3D Facial Reconstruction and Editing [34.39385635485985]
  Deducing the 3D face from a skull is a challenging task in forensic science and archaeology.<n>This paper proposes an end-to-end 3D face reconstruction pipeline and an exploration method.<n> Experiments conducted on a real skull-face dataset demonstrated the effectiveness of our proposed pipeline.
  arXiv  Detail & Related papers  (2024-03-24T16:03:27Z)
• FitDiff: Robust monocular 3D facial shape and reflectance estimation using Diffusion Models [79.65289816077629]
  We present FitDiff, a diffusion-based 3D facial avatar generative model.<n>Our model accurately generates relightable facial avatars, utilizing an identity embedding extracted from an "in-the-wild" 2D facial image.<n>Being the first 3D LDM conditioned on face recognition embeddings, FitDiff reconstructs relightable human avatars, that can be used as-is in common rendering engines.
  arXiv  Detail & Related papers  (2023-12-07T17:35:49Z)
• Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images [39.94162291765236]
  We present a weakly supervised method to generate a healthy version of a diseased image and then use it to obtain a pixel-wise anomaly map. We employ a diffusion model trained on healthy samples and combine Denoising Diffusion Probabilistic Model (DDPM) and Denoising Implicit Model (DDIM) at each step of the sampling process.
  arXiv  Detail & Related papers  (2023-08-03T21:56:50Z)
• HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Faces [47.27033282706179]
  We present our method for neural face reenactment, called HyperReenact, that aims to generate realistic talking head images of a source identity. Our method operates under the one-shot setting (i.e., using a single source frame) and allows for cross-subject reenactment, without requiring subject-specific fine-tuning. We compare our method both quantitatively and qualitatively against several state-of-the-art techniques on the standard benchmarks of VoxCeleb1 and VoxCeleb2.
  arXiv  Detail & Related papers  (2023-07-20T11:59:42Z)
• Fast refacing of MR images with a generative neural network lowers re-identification risk and preserves volumetric consistency [5.040145546652933]
  We propose a novel method for anonymised face generation for 3D T1-weighted scans based on a 3D conditional generative adversarial network. The proposed method takes 9 seconds for face generation and is suitable for recovering consistent post-processing results after defacing.
  arXiv  Detail & Related papers  (2023-05-26T13:34:14Z)
• Cross-modulated Few-shot Image Generation for Colorectal Tissue Classification [58.147396879490124]
  Our few-shot generation method, named XM-GAN, takes one base and a pair of reference tissue images as input and generates high-quality yet diverse images. To the best of our knowledge, we are the first to investigate few-shot generation in colorectal tissue images.
  arXiv  Detail & Related papers  (2023-04-04T17:50:30Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• SCULPTOR: Skeleton-Consistent Face Creation Using a Learned Parametric Generator [42.25745590793068]
  We present SCULPTOR, 3D face creations with Skeleton Consistency Using a Learned Parametric facial generaTOR. At the core of SCULPTOR is LUCY, the first large-scale shape-skeleton face dataset in collaboration with plastic surgeons.
  arXiv  Detail & Related papers  (2022-09-14T05:21:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.