Adversarially Perturbed Wavelet-based Morphed Face Generation

• URL: http://arxiv.org/abs/2111.01965v1
• Date: Wed, 3 Nov 2021 01:18:29 GMT
• Title: Adversarially Perturbed Wavelet-based Morphed Face Generation
• Authors: Kelsey O'Haire, Sobhan Soleymani, Baaria Chaudhary, Poorya Aghdaie, Jeremy Dawson, Nasser M. Nasrabadi
• Abstract summary: Morphed images can fool Facial Recognition Systems into falsely accepting multiple people. As morphed image synthesis becomes easier, it is vital to expand the research community's available data. We leverage both methods to generate high-quality adversarially perturbed from the FERET, FRGC, and FRLL datasets.
• Score: 16.98806338782858
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Morphing is the process of combining two or more subjects in an image in order to create a new identity which contains features of both individuals. Morphed images can fool Facial Recognition Systems (FRS) into falsely accepting multiple people, leading to failures in national security. As morphed image synthesis becomes easier, it is vital to expand the research community's available data to help combat this dilemma. In this paper, we explore combination of two methods for morphed image generation, those of geometric transformation (warping and blending to create morphed images) and photometric perturbation. We leverage both methods to generate high-quality adversarially perturbed morphs from the FERET, FRGC, and FRLL datasets. The final images retain high similarity to both input subjects while resulting in minimal artifacts in the visual domain. Images are synthesized by fusing the wavelet sub-bands from the two look-alike subjects, and then adversarially perturbed to create highly convincing imagery to deceive both humans and deep morph detectors.

Related papers

• Facial Demorphing via Identity Preserving Image Decomposition [10.902536447343465]
  morph attack detection techniques do not extract information about the underlying bonafides used to create them. We propose a novel method that is reference-free and recovers the bonafides with high accuracy. Our method is observed to reconstruct high-quality bonafides in terms of definition and fidelity.
  arXiv  Detail & Related papers  (2024-08-20T16:42:11Z)
• Human-imperceptible, Machine-recognizable Images [76.01951148048603]
  A major conflict is exposed relating to software engineers between better developing AI systems and distancing from the sensitive training data. This paper proposes an efficient privacy-preserving learning paradigm, where images are encrypted to become human-imperceptible, machine-recognizable'' We show that the proposed paradigm can ensure the encrypted images have become human-imperceptible while preserving machine-recognizable information.
  arXiv  Detail & Related papers  (2023-06-06T13:41:37Z)
• MorphGANFormer: Transformer-based Face Morphing and De-Morphing [55.211984079735196]
  StyleGAN-based approaches to face morphing are among the leading techniques. We propose a transformer-based alternative to face morphing and demonstrate its superiority to StyleGAN-based methods.
  arXiv  Detail & Related papers  (2023-02-18T19:09:11Z)
• Landmark Enforcement and Style Manipulation for Generative Morphing [24.428843425522107]
  We propose a novel StyleGAN morph generation technique by introducing a landmark enforcement method to resolve this issue. Exploration of the latent space of our model is conducted using Principal Component Analysis (PCA) to accentuate the effect of both the bona fide faces on the morphed latent representation. To improve high frequency reconstruction in the morphs, we study the train-ability of the noise input for the StyleGAN2 model.
  arXiv  Detail & Related papers  (2022-10-18T22:10:25Z)
• Facial De-morphing: Extracting Component Faces from a Single Morph [12.346914707006773]
  morph attack detection strategies can detect morphs but cannot recover the images or identities used in creating them. We propose a novel de-morphing method that can recover images of both identities simultaneously from a single morphed face image.
  arXiv  Detail & Related papers  (2022-09-07T05:01:02Z)
• Cross-View Panorama Image Synthesis [68.35351563852335]
  PanoGAN is a novel adversarial feedback GAN framework named. PanoGAN enables high-quality panorama image generation with more convincing details than state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-03-22T15:59:44Z)
• DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition [85.94331736287765]
  We formulate HFR as a dual generation problem, and tackle it via a novel Dual Variational Generation (DVG-Face) framework. We integrate abundant identity information of large-scale visible data into the joint distribution. Massive new diverse paired heterogeneous images with the same identity can be generated from noises.
  arXiv  Detail & Related papers  (2020-09-20T09:48:24Z)
• Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detection [22.220940043294334]
  We propose a new framework for generating face morphs using a newer Generative Adversarial Network (GAN) - StyleGAN. With the newly created morphing dataset of 2500 morphed face images, we pose a critical question in this work.
  arXiv  Detail & Related papers  (2020-07-07T16:52:56Z)
• Multi-Margin based Decorrelation Learning for Heterogeneous Face Recognition [90.26023388850771]
  This paper presents a deep neural network approach to extract decorrelation representations in a hyperspherical space for cross-domain face images. The proposed framework can be divided into two components: heterogeneous representation network and decorrelation representation learning. Experimental results on two challenging heterogeneous face databases show that our approach achieves superior performance on both verification and recognition tasks.
  arXiv  Detail & Related papers  (2020-05-25T07:01:12Z)
• Fine-grained Image-to-Image Transformation towards Visual Recognition [102.51124181873101]
  We aim at transforming an image with a fine-grained category to synthesize new images that preserve the identity of the input image. We adopt a model based on generative adversarial networks to disentangle the identity related and unrelated factors of an image. Experiments on the CompCars and Multi-PIE datasets demonstrate that our model preserves the identity of the generated images much better than the state-of-the-art image-to-image transformation models.
  arXiv  Detail & Related papers  (2020-01-12T05:26:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.