PF-cpGAN: Profile to Frontal Coupled GAN for Face Recognition in the Wild

• URL: http://arxiv.org/abs/2005.02166v1
• Date: Sat, 25 Apr 2020 09:01:54 GMT
• Title: PF-cpGAN: Profile to Frontal Coupled GAN for Face Recognition in the Wild
• Authors: Fariborz Taherkhani, Veeru Talreja, Jeremy Dawson, Matthew C. Valenti, and Nasser M. Nasrabadi
• Abstract summary: Many deep face recognition models perform relatively poorly in handling profile faces compared to frontal faces. We look to exploit this connection by projecting the profile faces and frontal faces into a common latent space. We leverage a coupled generative adversarial network (cpGAN) structure to find the hidden relationship between the profile and frontal images.
• Score: 22.78667743907491
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In recent years, due to the emergence of deep learning, face recognition has achieved exceptional success. However, many of these deep face recognition models perform relatively poorly in handling profile faces compared to frontal faces. The major reason for this poor performance is that it is inherently difficult to learn large pose invariant deep representations that are useful for profile face recognition. In this paper, we hypothesize that the profile face domain possesses a gradual connection with the frontal face domain in the deep feature space. We look to exploit this connection by projecting the profile faces and frontal faces into a common latent space and perform verification or retrieval in the latent domain. We leverage a coupled generative adversarial network (cpGAN) structure to find the hidden relationship between the profile and frontal images in a latent common embedding subspace. Specifically, the cpGAN framework consists of two GAN-based sub-networks, one dedicated to the frontal domain and the other dedicated to the profile domain. Each sub-network tends to find a projection that maximizes the pair-wise correlation between two feature domains in a common embedding feature subspace. The efficacy of our approach compared with the state-of-the-art is demonstrated using the CFP, CMU MultiPIE, IJB-A, and IJB-C datasets.

Related papers

• Pose Attention-Guided Profile-to-Frontal Face Recognition [13.96448286983864]
  We propose a new approach to utilize pose as an auxiliary information via an attention mechanism. We develop a novel pose attention block (PAB) to specially guide the pose-agnostic feature extraction from profile faces. To be more specific, PAB is designed to explicitly help the network to focus on important features along both channel and spatial dimension.
  arXiv  Detail & Related papers  (2022-09-15T02:06:31Z)
• Profile to Frontal Face Recognition in the Wild Using Coupled Conditional GAN [23.903991257669492]
  It is difficult to learn pose-invariant deep representations that are useful for profile face recognition. We leverage a conditional generative adversarial network (cpGAN) structure to find the hidden relationship between the profile and frontal images. We have also implemented a coupled convolutional neural network (cpCNN) and an adversarial discriminative domain adaptation network (ADDA) for profile to frontal face recognition.
  arXiv  Detail & Related papers  (2021-07-29T04:33:43Z)
• Heterogeneous Face Frontalization via Domain Agnostic Learning [74.86585699909459]
  We propose a domain agnostic learning-based generative adversarial network (DAL-GAN) which can synthesize frontal views in the visible domain from thermal faces with pose variations. DAL-GAN consists of a generator with an auxiliary classifier and two discriminators which capture both local and global texture discriminations for better synthesis.
  arXiv  Detail & Related papers  (2021-07-17T20:41:41Z)
• SuperFront: From Low-resolution to High-resolution Frontal Face Synthesis [65.35922024067551]
  We propose a generative adversarial network (GAN) -based model to generate high-quality, identity preserving frontal faces. Specifically, we propose SuperFront-GAN to synthesize a high-resolution (HR), frontal face from one-to-many LR faces with various poses. We integrate a super-resolution side-view module into SF-GAN to preserve identity information and fine details of the side-views in HR space.
  arXiv  Detail & Related papers  (2020-12-07T23:30:28Z)
• Multi-Margin based Decorrelation Learning for Heterogeneous Face Recognition [90.26023388850771]
  This paper presents a deep neural network approach to extract decorrelation representations in a hyperspherical space for cross-domain face images. The proposed framework can be divided into two components: heterogeneous representation network and decorrelation representation learning. Experimental results on two challenging heterogeneous face databases show that our approach achieves superior performance on both verification and recognition tasks.
  arXiv  Detail & Related papers  (2020-05-25T07:01:12Z)
• Single-Side Domain Generalization for Face Anti-Spoofing [91.79161815884126]
  We propose an end-to-end single-side domain generalization framework to improve the generalization ability of face anti-spoofing. Our proposed approach is effective and outperforms the state-of-the-art methods on four public databases.
  arXiv  Detail & Related papers  (2020-04-29T09:32:54Z)
• DotFAN: A Domain-transferred Face Augmentation Network for Pose and Illumination Invariant Face Recognition [94.96686189033869]
  We propose a 3D model-assisted domain-transferred face augmentation network (DotFAN) DotFAN can generate a series of variants of an input face based on the knowledge distilled from existing rich face datasets collected from other domains. Experiments show that DotFAN is beneficial for augmenting small face datasets to improve their within-class diversity.
  arXiv  Detail & Related papers  (2020-02-23T08:16:34Z)
• Dual-Attention GAN for Large-Pose Face Frontalization [59.689836951934694]
  We present a novel Dual-Attention Generative Adversarial Network (DA-GAN) for photo-realistic face frontalization. Specifically, a self-attention-based generator is introduced to integrate local features with their long-range dependencies. A novel face-attention-based discriminator is applied to emphasize local features of face regions.
  arXiv  Detail & Related papers  (2020-02-17T20:00:56Z)
• Domain Embedded Multi-model Generative Adversarial Networks for Image-based Face Inpainting [44.598234654270584]
  We present a domain embedded multi-model generative adversarial model for inpainting of face images with large cropped regions. Experiments on both CelebA and CelebA-HQ face datasets demonstrate that our proposed approach achieved state-of-the-art performance.
  arXiv  Detail & Related papers  (2020-02-05T17:36:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.