SDeMorph: Towards Better Facial De-morphing from Single Morph

• URL: http://arxiv.org/abs/2308.11442v1
• Date: Tue, 22 Aug 2023 13:46:12 GMT
• Title: SDeMorph: Towards Better Facial De-morphing from Single Morph
• Authors: Nitish Shukla
• Abstract summary: Face Recognition Systems (FRS) are vulnerable to morph attacks. Current Morph Attack Detection (MAD) can detect the morph but are unable to recover the identities used to create the morph. We propose SDeMorph, a novel de-morphing method that is reference-free and recovers the identities of bona fides.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Face Recognition Systems (FRS) are vulnerable to morph attacks. A face morph is created by combining multiple identities with the intention to fool FRS and making it match the morph with multiple identities. Current Morph Attack Detection (MAD) can detect the morph but are unable to recover the identities used to create the morph with satisfactory outcomes. Existing work in de-morphing is mostly reference-based, i.e. they require the availability of one identity to recover the other. Sudipta et al. \cite{ref9} proposed a reference-free de-morphing technique but the visual realism of outputs produced were feeble. In this work, we propose SDeMorph (Stably Diffused De-morpher), a novel de-morphing method that is reference-free and recovers the identities of bona fides. Our method produces feature-rich outputs that are of significantly high quality in terms of definition and facial fidelity. Our method utilizes Denoising Diffusion Probabilistic Models (DDPM) by destroying the input morphed signal and then reconstructing it back using a branched-UNet. Experiments on ASML, FRLL-FaceMorph, FRLL-MorDIFF, and SMDD datasets support the effectiveness of the proposed method.

Related papers

• LADIMO: Face Morph Generation through Biometric Template Inversion with Latent Diffusion [5.602947425285195]
  Face morphing attacks pose a severe security threat to face recognition systems. We present a representation-level face morphing approach, namely LADIMO, that performs morphing on two face recognition embeddings. We show that each face morph variant has an individual attack success rate, enabling us to maximize the morph attack potential.
  arXiv  Detail & Related papers  (2024-10-10T14:41:37Z)
• Facial Demorphing via Identity Preserving Image Decomposition [10.902536447343465]
  morph attack detection techniques do not extract information about the underlying bonafides used to create them. We propose a novel method that is reference-free and recovers the bonafides with high accuracy. Our method is observed to reconstruct high-quality bonafides in terms of definition and fidelity.
  arXiv  Detail & Related papers  (2024-08-20T16:42:11Z)
• Worst-Case Morphs using Wasserstein ALI and Improved MIPGAN [5.1899190294312385]
  We introduce a morph generation method that can approximate worst-case morphs even when the Face Recognition system is not known. Our method is based on Adversarially Learned Inference (ALI) and uses concepts from Wasserstein GANs trained with Gradient Penalty. We show how our findings can be used to improve MIPGAN, an existing StyleGAN-based morph generator.
  arXiv  Detail & Related papers  (2023-10-12T14:40:24Z)
• MorphGANFormer: Transformer-based Face Morphing and De-Morphing [55.211984079735196]
  StyleGAN-based approaches to face morphing are among the leading techniques. We propose a transformer-based alternative to face morphing and demonstrate its superiority to StyleGAN-based methods.
  arXiv  Detail & Related papers  (2023-02-18T19:09:11Z)
• Restricted Black-box Adversarial Attack Against DeepFake Face Swapping [70.82017781235535]
  We introduce a practical adversarial attack that does not require any queries to the facial image forgery model. Our method is built on a substitute model persuing for face reconstruction and then transfers adversarial examples from the substitute model directly to inaccessible black-box DeepFake models.
  arXiv  Detail & Related papers  (2022-04-26T14:36:06Z)
• Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learning [54.15303628138665]
  Face anti-spoofing (FAS) plays a vital role in preventing face recognition systems from presentation attacks. Existing face anti-spoofing datasets lack diversity due to the insufficient identity and insignificant variance. We propose Dual Spoof Disentanglement Generation framework to tackle this challenge by "anti-spoofing via generation"
  arXiv  Detail & Related papers  (2021-12-01T15:36:59Z)
• A Face Recognition System's Worst Morph Nightmare, Theoretically [0.0]
  Face Recognition Systems (FRSs) are vulnerable to morphing attacks, but most research focusses on landmark-based morphs. We propose a method to create a third, different type of morph, that has the advantage of being easier to train.
  arXiv  Detail & Related papers  (2021-11-30T14:09:47Z)
• Disentangled Lifespan Face Synthesis [100.29058545878341]
  A lifespan face synthesis (LFS) model aims to generate a set of photo-realistic face images of a person's whole life, given only one snapshot as reference. The generated face image given a target age code is expected to be age-sensitive reflected by bio-plausible transformations of shape and texture. This is achieved by extracting shape, texture and identity features separately from an encoder.
  arXiv  Detail & Related papers  (2021-08-05T22:33:14Z)
• DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition [85.94331736287765]
  We formulate HFR as a dual generation problem, and tackle it via a novel Dual Variational Generation (DVG-Face) framework. We integrate abundant identity information of large-scale visible data into the joint distribution. Massive new diverse paired heterogeneous images with the same identity can be generated from noises.
  arXiv  Detail & Related papers  (2020-09-20T09:48:24Z)
• Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer [51.926868759681014]
  We present a framework to predict the facial parameters based on a bone-driven face model (BDFM) under different views. The proposed framework consists of a feature extractor, a generator, and a facial parameter regressor.
  arXiv  Detail & Related papers  (2020-08-20T09:49:13Z)
• Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detection [22.220940043294334]
  We propose a new framework for generating face morphs using a newer Generative Adversarial Network (GAN) - StyleGAN. With the newly created morphing dataset of 2500 morphed face images, we pose a critical question in this work.
  arXiv  Detail & Related papers  (2020-07-07T16:52:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.