How to Boost Face Recognition with StyleGAN?

• URL: http://arxiv.org/abs/2210.10090v2
• Date: Fri, 28 Jul 2023 18:18:39 GMT
• Title: How to Boost Face Recognition with StyleGAN?
• Authors: Artem Sevastopolsky, Yury Malkov, Nikita Durasov, Luisa Verdoliva, Matthias Nie{\ss}ner
• Abstract summary: State-of-the-art face recognition systems require vast amounts of labeled training data. Self-supervised revolution in the industry motivates research on the adaptation of related techniques to facial recognition. We show that a simple approach based on fine-tuning pSp encoder for StyleGAN allows us to improve upon the state-of-the-art facial recognition.
• Score: 13.067766076889995
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: State-of-the-art face recognition systems require vast amounts of labeled training data. Given the priority of privacy in face recognition applications, the data is limited to celebrity web crawls, which have issues such as limited numbers of identities. On the other hand, self-supervised revolution in the industry motivates research on the adaptation of related techniques to facial recognition. One of the most popular practical tricks is to augment the dataset by the samples drawn from generative models while preserving the identity. We show that a simple approach based on fine-tuning pSp encoder for StyleGAN allows us to improve upon the state-of-the-art facial recognition and performs better compared to training on synthetic face identities. We also collect large-scale unlabeled datasets with controllable ethnic constitution -- AfricanFaceSet-5M (5 million images of different people) and AsianFaceSet-3M (3 million images of different people) -- and we show that pretraining on each of them improves recognition of the respective ethnicities (as well as others), while combining all unlabeled datasets results in the biggest performance increase. Our self-supervised strategy is the most useful with limited amounts of labeled training data, which can be beneficial for more tailored face recognition tasks and when facing privacy concerns. Evaluation is based on a standard RFW dataset and a new large-scale RB-WebFace benchmark. The code and data are made publicly available at https://github.com/seva100/stylegan-for-facerec.

Related papers

• SASMU: boost the performance of generalized recognition model using synthetic face dataset [5.596292759115785]
  We propose SASMU, a simple, novel, and effective method for face recognition using a synthetic dataset. Our proposed method consists of spatial data augmentation (SA) and spectrum mixup (SMU)
  arXiv  Detail & Related papers  (2023-06-02T11:11:00Z)
• Attribute-preserving Face Dataset Anonymization via Latent Code Optimization [64.4569739006591]
  We present a task-agnostic anonymization procedure that directly optimize the images' latent representation in the latent space of a pre-trained GAN. We demonstrate through a series of experiments that our method is capable of anonymizing the identity of the images whilst -- crucially -- better-preserving the facial attributes.
  arXiv  Detail & Related papers  (2023-03-20T17:34:05Z)
• Unsupervised Face Recognition using Unlabeled Synthetic Data [16.494722503803196]
  We propose an unsupervised face recognition model based on unlabeled synthetic data (U SynthFace) Our proposed U SynthFace learns to maximize the similarity between two augmented images of the same synthetic instance. We prove the effectiveness of our U SynthFace in achieving relatively high recognition accuracies using unlabeled synthetic data.
  arXiv  Detail & Related papers  (2022-11-14T14:05:19Z)
• SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Data [9.249824128880707]
  We propose and investigate the feasibility of using a privacy-friendly synthetically generated face dataset to train face recognition models. To address the privacy aspect of using such data to train a face recognition model, we provide extensive evaluation experiments on the identity relation between the synthetic dataset and the original authentic dataset used to train the generative model. We also propose to train face recognition on our privacy-friendly dataset, SFace, using three different learning strategies, multi-class classification, label-free knowledge transfer, and combined learning of multi-class classification and knowledge transfer.
  arXiv  Detail & Related papers  (2022-06-21T16:42:04Z)
• Training face verification models from generated face identity data [2.557825816851682]
  We consider an approach to increase the privacy protection of data sets, as applied to face recognition. We build on the StyleGAN generative adversarial network and feed it with latent codes combining two distinct sub-codes. We find that the addition of a small amount of private data greatly improves the performance of our model.
  arXiv  Detail & Related papers  (2021-08-02T12:00:01Z)
• FedFace: Collaborative Learning of Face Recognition Model [66.84737075622421]
  FedFace is a framework for collaborative learning of face recognition models. It learns an accurate and generalizable face recognition model where the face images stored at each client are neither shared with other clients nor the central host. Our code and pre-trained models will be publicly available.
  arXiv  Detail & Related papers  (2021-04-07T09:25:32Z)
• Omni-supervised Facial Expression Recognition via Distilled Data [120.11782405714234]
  We propose omni-supervised learning to exploit reliable samples in a large amount of unlabeled data for network training. We experimentally verify that the new dataset can significantly improve the ability of the learned FER model. To tackle this, we propose to apply a dataset distillation strategy to compress the created dataset into several informative class-wise images.
  arXiv  Detail & Related papers  (2020-05-18T09:36:51Z)
• Masked Face Recognition Dataset and Application [28.2082082956263]
  This work proposes three types of masked face datasets, including Masked Face Detection dataset (MFDD), Real-world Masked Face Recognition dataset (RMFRD) and Simulated Masked Face Recognition dataset (SMFRD) The multi-granularity masked face recognition model we developed achieves 95% accuracy, exceeding the results reported by the industry.
  arXiv  Detail & Related papers  (2020-03-20T04:15:19Z)
• Boosting Unconstrained Face Recognition with Auxiliary Unlabeled Data [59.85605718477639]
  We present an approach to use unlabeled faces to learn generalizable face representations. Experimental results on unconstrained datasets show that a small amount of unlabeled data with sufficient diversity can lead to an appreciable gain in recognition performance.
  arXiv  Detail & Related papers  (2020-03-17T20:58:56Z)
• Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
  We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks. TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
  arXiv  Detail & Related papers  (2020-03-15T12:45:10Z)
• Investigating the Impact of Inclusion in Face Recognition Training Data on Individual Face Identification [93.5538147928669]
  We audit ArcFace, a state-of-the-art, open source face recognition system, in a large-scale face identification experiment with more than one million distractor images. We find a Rank-1 face identification accuracy of 79.71% for individuals present in the model's training data and an accuracy of 75.73% for those not present.
  arXiv  Detail & Related papers  (2020-01-09T15:50:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.