ElasticFace: Elastic Margin Loss for Deep Face Recognition

• URL: http://arxiv.org/abs/2109.09416v2
• Date: Wed, 22 Sep 2021 13:18:06 GMT
• Title: ElasticFace: Elastic Margin Loss for Deep Face Recognition
• Authors: Fadi Boutros, Naser Damer, Florian Kirchbuchner, Arjan Kuijper
• Abstract summary: Learning discriminative face features plays a major role in building high-performing face recognition models. Recent state-of-the-art face recognition solutions proposed to incorporate a fixed penalty margin on classification loss function, softmax loss. We propose elastic margin loss (ElasticFace) that allows flexibility in the push for class separability.
• Score: 6.865656740940772
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Learning discriminative face features plays a major role in building high-performing face recognition models. The recent state-of-the-art face recognition solutions proposed to incorporate a fixed penalty margin on commonly used classification loss function, softmax loss, in the normalized hypersphere to increase the discriminative power of face recognition models, by minimizing the intra-class variation and maximizing the inter-class variation. Marginal softmax losses, such as ArcFace and CosFace, assume that the geodesic distance between and within the different identities can be equally learned using a fixed margin. However, such a learning objective is not realistic for real data with inconsistent inter-and intra-class variation, which might limit the discriminative and generalizability of the face recognition model. In this paper, we relax the fixed margin constrain by proposing elastic margin loss (ElasticFace) that allows flexibility in the push for class separability. The main idea is to utilize random margin values drawn from a normal distribution in each training iteration. This aims at giving the margin chances to extract and retract to allow space for flexible class separability learning. We demonstrate the superiority of our elastic margin loss over ArcFace and CosFace losses, using the same geometric transformation, on a large set of mainstream benchmarks. From a wider perspective, our ElasticFace has advanced the state-of-the-art face recognition performance on six out of nine mainstream benchmarks.

Related papers

• X2-Softmax: Margin Adaptive Loss Function for Face Recognition [6.497884034818003]
  We propose a new angular margin loss named X2-Softmax. X2-Softmax loss has adaptive angular margins, which provide the margin that increases with the angle between different classes growing. We have trained the neural network with X2-Softmax loss on the MS1Mv3 dataset.
  arXiv  Detail & Related papers  (2023-12-08T10:27:47Z)
• InterFace:Adjustable Angular Margin Inter-class Loss for Deep Face Recognition [7.158500469489626]
  We propose a novel loss function, InterFace, to improve the discriminative power of the model. Our InterFace has advanced the state-of-the-art face recognition performance on five out of thirteen mainstream benchmarks.
  arXiv  Detail & Related papers  (2022-10-05T04:38:29Z)
• SubFace: Learning with Softmax Approximation for Face Recognition [3.262192371833866]
  SubFace is a softmax approximation method that employs the subspace feature to promote the performance of face recognition. Comprehensive experiments conducted on benchmark datasets demonstrate that our method can significantly improve the performance of vanilla CNN baseline.
  arXiv  Detail & Related papers  (2022-08-24T12:31:08Z)
• Learning Towards the Largest Margins [83.7763875464011]
  Loss function should promote the largest possible margins for both classes and samples. Not only does this principled framework offer new perspectives to understand and interpret existing margin-based losses, but it can guide the design of new tools.
  arXiv  Detail & Related papers  (2022-06-23T10:03:03Z)
• Meta Balanced Network for Fair Face Recognition [51.813457201437195]
  We systematically and scientifically study bias from both data and algorithm aspects. We propose a novel meta-learning algorithm, called Meta Balanced Network (MBN), which learns adaptive margins in large margin loss. Extensive experiments show that MBN successfully mitigates bias and learns more balanced performance for people with different skin tones in face recognition.
  arXiv  Detail & Related papers  (2022-05-13T10:25:44Z)
• AdaFace: Quality Adaptive Margin for Face Recognition [56.99208144386127]
  We introduce another aspect of adaptiveness in the loss function, namely the image quality. We propose a new loss function that emphasizes samples of different difficulties based on their image quality. Our method, AdaFace, improves the face recognition performance over the state-of-the-art (SoTA) on four datasets.
  arXiv  Detail & Related papers  (2022-04-03T01:23:41Z)
• KappaFace: Adaptive Additive Angular Margin Loss for Deep Face Recognition [22.553018305072925]
  We introduce a novel adaptive strategy, called KappaFace, to modulate the relative importance based on class difficultness and imbalance. Experiments conducted on popular facial benchmarks demonstrate that our proposed method achieves superior performance to the state-of-the-art.
  arXiv  Detail & Related papers  (2022-01-19T03:05:24Z)
• Federated Learning for Face Recognition with Gradient Correction [52.896286647898386]
  In this work, we introduce a framework, FedGC, to tackle federated learning for face recognition. We show that FedGC constitutes a valid loss function similar to standard softmax.
  arXiv  Detail & Related papers  (2021-12-14T09:19:29Z)
• SphereFace Revived: Unifying Hyperspherical Face Recognition [57.07058009281208]
  We introduce a unified framework to understand large angular margin in hyperspherical face recognition. Under this framework, we propose an improved variant with substantially better training stability -- SphereFace-R. We show that SphereFace-R is consistently better than or competitive with state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-09-12T17:07:54Z)
• SphereFace2: Binary Classification is All You Need for Deep Face Recognition [57.07058009281208]
  State-of-the-art deep face recognition methods are mostly trained with a softmax-based multi-class classification framework. We propose a novel binary classification training framework, termed SphereFace2. We show that SphereFace2 can consistently outperform current state-of-the-art deep face recognition methods.
  arXiv  Detail & Related papers  (2021-08-03T13:58:45Z)
• More Information Supervised Probabilistic Deep Face Embedding Learning [10.52667214402514]
  We analyse margin based softmax loss in probability view. An auto-encoder architecture called Linear-Auto-TS-Encoder(LATSE) is proposed to corroborate this finding.
  arXiv  Detail & Related papers  (2020-06-08T12:33:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.