Face Shape-Guided Deep Feature Alignment for Face Recognition Robust to Face Misalignment

• URL: http://arxiv.org/abs/2209.07220v1
• Date: Thu, 15 Sep 2022 11:23:51 GMT
• Title: Face Shape-Guided Deep Feature Alignment for Face Recognition Robust to Face Misalignment
• Authors: Hyung-Il Kim, Kimin Yun, Yong Man Ro
• Abstract summary: Face recognition (FR) has been actively studied in computer vision and pattern recognition society. Recently, due to the advances in deep learning, the FR technology shows high performance for most of the benchmark datasets. However, when the FR algorithm is applied to a real-world scenario, the performance has been known to be still unsatisfactory.
• Score: 32.53066213465744
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: For the past decades, face recognition (FR) has been actively studied in computer vision and pattern recognition society. Recently, due to the advances in deep learning, the FR technology shows high performance for most of the benchmark datasets. However, when the FR algorithm is applied to a real-world scenario, the performance has been known to be still unsatisfactory. This is mainly attributed to the mismatch between training and testing sets. Among such mismatches, face misalignment between training and testing faces is one of the factors that hinder successful FR. To address this limitation, we propose a face shape-guided deep feature alignment framework for FR robust to the face misalignment. Based on a face shape prior (e.g., face keypoints), we train the proposed deep network by introducing alignment processes, i.e., pixel and feature alignments, between well-aligned and misaligned face images. Through the pixel alignment process that decodes the aggregated feature extracted from a face image and face shape prior, we add the auxiliary task to reconstruct the well-aligned face image. Since the aggregated features are linked to the face feature extraction network as a guide via the feature alignment process, we train the robust face feature to the face misalignment. Even if the face shape estimation is required in the training stage, the additional face alignment process, which is usually incorporated in the conventional FR pipeline, is not necessarily needed in the testing phase. Through the comparative experiments, we validate the effectiveness of the proposed method for the face misalignment with the FR datasets.

Related papers

• Text-Guided Face Recognition using Multi-Granularity Cross-Modal Contrastive Learning [0.0]
  We introduce text-guided face recognition (TGFR) to analyze the impact of integrating facial attributes in the form of natural language descriptions. TGFR demonstrates remarkable improvements, particularly on low-quality images, over existing face recognition models.
  arXiv  Detail & Related papers  (2023-12-14T22:04:22Z)
• FlowFace++: Explicit Semantic Flow-supervised End-to-End Face Swapping [28.714484307143927]
  FlowFace++ is a novel face-swapping framework utilizing explicit semantic flow supervision and end-to-end architecture. The discriminator is shape-aware and relies on a semantic flow-guided operation to explicitly calculate the shape discrepancies between the target and source faces.
  arXiv  Detail & Related papers  (2023-06-22T06:18:29Z)
• End-to-end Face-swapping via Adaptive Latent Representation Learning [12.364688530047786]
  This paper proposes a novel and end-to-end integrated framework for high resolution and attribute preservation face swapping. Our framework integrating facial perceiving and blending into the end-to-end training and testing process can achieve high realistic face-swapping on wild faces.
  arXiv  Detail & Related papers  (2023-03-07T19:16:20Z)
• Human Face Recognition from Part of a Facial Image based on Image Stitching [0.0]
  Most of the current techniques for face recognition require the presence of a full face of the person to be recognized. In this work, we adopted the process of stitching the face by completing the missing part with the flipping of the part shown in the picture. The selected face recognition algorithms that are applied here are Eigenfaces and geometrical methods.
  arXiv  Detail & Related papers  (2022-03-10T19:31:57Z)
• Face Deblurring Based on Separable Normalization and Adaptive Denormalization [25.506065804812522]
  Face deblurring aims to restore a clear face image from a blurred input image with more explicit structure and facial details. We design an effective face deblurring network based on separable normalization and adaptive denormalization. Experimental results on both CelebA and CelebA-HQ datasets demonstrate that the proposed face deblurring network restores face structure with more facial details.
  arXiv  Detail & Related papers  (2021-12-18T03:42:23Z)
• SphereFace Revived: Unifying Hyperspherical Face Recognition [57.07058009281208]
  We introduce a unified framework to understand large angular margin in hyperspherical face recognition. Under this framework, we propose an improved variant with substantially better training stability -- SphereFace-R. We show that SphereFace-R is consistently better than or competitive with state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-09-12T17:07:54Z)
• Learning Fair Face Representation With Progressive Cross Transformer [79.73754444296213]
  We propose a progressive cross transformer (PCT) method for fair face recognition. We show that PCT is capable of mitigating bias in face recognition while achieving state-of-the-art FR performance.
  arXiv  Detail & Related papers  (2021-08-11T01:31:14Z)
• Pro-UIGAN: Progressive Face Hallucination from Occluded Thumbnails [53.080403912727604]
  We propose a multi-stage Progressive Upsampling and Inpainting Generative Adversarial Network, dubbed Pro-UIGAN. It exploits facial geometry priors to replenish and upsample (8*) the occluded and tiny faces. Pro-UIGAN achieves visually pleasing HR faces, reaching superior performance in downstream tasks.
  arXiv  Detail & Related papers  (2021-08-02T02:29:24Z)
• Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collection [65.92058628082322]
  Non-parametric face modeling aims to reconstruct 3D face only from images without shape assumptions. This paper presents a novel Learning to Aggregate and Personalize framework for unsupervised robust 3D face modeling.
  arXiv  Detail & Related papers  (2021-06-15T03:10:17Z)
• Face Hallucination with Finishing Touches [65.14864257585835]
  We present a novel Vivid Face Hallucination Generative Adversarial Network (VividGAN) for simultaneously super-resolving and frontalizing tiny non-frontal face images. VividGAN consists of coarse-level and fine-level Face Hallucination Networks (FHnet) and two discriminators, i.e., Coarse-D and Fine-D. Experiments demonstrate that our VividGAN achieves photo-realistic frontal HR faces, reaching superior performance in downstream tasks.
  arXiv  Detail & Related papers  (2020-02-09T07:33:48Z)
• Exploiting Semantics for Face Image Deblurring [121.44928934662063]
  We propose an effective and efficient face deblurring algorithm by exploiting semantic cues via deep convolutional neural networks. We incorporate face semantic labels as input priors and propose an adaptive structural loss to regularize facial local structures. The proposed method restores sharp images with more accurate facial features and details.
  arXiv  Detail & Related papers  (2020-01-19T13:06:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.