SymFace: Additional Facial Symmetry Loss for Deep Face Recognition

• URL: http://arxiv.org/abs/2409.11816v1
• Date: Wed, 18 Sep 2024 09:06:55 GMT
• Title: SymFace: Additional Facial Symmetry Loss for Deep Face Recognition
• Authors: Pritesh Prakash, Koteswar Rao Jerripothula, Ashish Jacob Sam, Prinsh Kumar Singh, S Umamaheswaran,
• Abstract summary: This research examines the natural phenomenon of facial symmetry in the face verification problem. We show that the two output embedding vectors of split faces must project close to each other in the output embedding space. Inspired by this concept, we penalize the network based on the disparity of embedding of the symmetrical pair of split faces.
• Score: 1.5612101323427952
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Over the past decade, there has been a steady advancement in enhancing face recognition algorithms leveraging advanced machine learning methods. The role of the loss function is pivotal in addressing face verification problems and playing a game-changing role. These loss functions have mainly explored variations among intra-class or inter-class separation. This research examines the natural phenomenon of facial symmetry in the face verification problem. The symmetry between the left and right hemi faces has been widely used in many research areas in recent decades. This paper adopts this simple approach judiciously by splitting the face image vertically into two halves. With the assumption that the natural phenomena of facial symmetry can enhance face verification methodology, we hypothesize that the two output embedding vectors of split faces must project close to each other in the output embedding space. Inspired by this concept, we penalize the network based on the disparity of embedding of the symmetrical pair of split faces. Symmetrical loss has the potential to minimize minor asymmetric features due to facial expression and lightning conditions, hence significantly increasing the inter-class variance among the classes and leading to more reliable face embedding. This loss function propels any network to outperform its baseline performance across all existing network architectures and configurations, enabling us to achieve SoTA results.

Related papers

• X2-Softmax: Margin Adaptive Loss Function for Face Recognition [6.497884034818003]
  We propose a new angular margin loss named X2-Softmax. X2-Softmax loss has adaptive angular margins, which provide the margin that increases with the angle between different classes growing. We have trained the neural network with X2-Softmax loss on the MS1Mv3 dataset.
  arXiv  Detail & Related papers  (2023-12-08T10:27:47Z)
• End-to-end Face-swapping via Adaptive Latent Representation Learning [12.364688530047786]
  This paper proposes a novel and end-to-end integrated framework for high resolution and attribute preservation face swapping. Our framework integrating facial perceiving and blending into the end-to-end training and testing process can achieve high realistic face-swapping on wild faces.
  arXiv  Detail & Related papers  (2023-03-07T19:16:20Z)
• Human Face Recognition from Part of a Facial Image based on Image Stitching [0.0]
  Most of the current techniques for face recognition require the presence of a full face of the person to be recognized. In this work, we adopted the process of stitching the face by completing the missing part with the flipping of the part shown in the picture. The selected face recognition algorithms that are applied here are Eigenfaces and geometrical methods.
  arXiv  Detail & Related papers  (2022-03-10T19:31:57Z)
• A new face swap method for image and video domains: a technical report [60.47144478048589]
  We introduce a new face swap pipeline that is based on FaceShifter architecture. New eye loss function, super-resolution block, and Gaussian-based face mask generation leads to improvements in quality.
  arXiv  Detail & Related papers  (2022-02-07T10:15:50Z)
• Pro-UIGAN: Progressive Face Hallucination from Occluded Thumbnails [53.080403912727604]
  We propose a multi-stage Progressive Upsampling and Inpainting Generative Adversarial Network, dubbed Pro-UIGAN. It exploits facial geometry priors to replenish and upsample (8*) the occluded and tiny faces. Pro-UIGAN achieves visually pleasing HR faces, reaching superior performance in downstream tasks.
  arXiv  Detail & Related papers  (2021-08-02T02:29:24Z)
• Heterogeneous Face Frontalization via Domain Agnostic Learning [74.86585699909459]
  We propose a domain agnostic learning-based generative adversarial network (DAL-GAN) which can synthesize frontal views in the visible domain from thermal faces with pose variations. DAL-GAN consists of a generator with an auxiliary classifier and two discriminators which capture both local and global texture discriminations for better synthesis.
  arXiv  Detail & Related papers  (2021-07-17T20:41:41Z)
• Multi-Margin based Decorrelation Learning for Heterogeneous Face Recognition [90.26023388850771]
  This paper presents a deep neural network approach to extract decorrelation representations in a hyperspherical space for cross-domain face images. The proposed framework can be divided into two components: heterogeneous representation network and decorrelation representation learning. Experimental results on two challenging heterogeneous face databases show that our approach achieves superior performance on both verification and recognition tasks.
  arXiv  Detail & Related papers  (2020-05-25T07:01:12Z)
• Learning Oracle Attention for High-fidelity Face Completion [121.72704525675047]
  We design a comprehensive framework for face completion based on the U-Net structure. We propose a dual spatial attention module to efficiently learn the correlations between facial textures at multiple scales. We take the location of the facial components as prior knowledge and impose a multi-discriminator on these regions.
  arXiv  Detail & Related papers  (2020-03-31T01:37:10Z)
• Dual-Attention GAN for Large-Pose Face Frontalization [59.689836951934694]
  We present a novel Dual-Attention Generative Adversarial Network (DA-GAN) for photo-realistic face frontalization. Specifically, a self-attention-based generator is introduced to integrate local features with their long-range dependencies. A novel face-attention-based discriminator is applied to emphasize local features of face regions.
  arXiv  Detail & Related papers  (2020-02-17T20:00:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.