Vec2Face+ for Face Dataset Generation

• URL: http://arxiv.org/abs/2507.17192v2
• Date: Mon, 28 Jul 2025 00:57:20 GMT
• Title: Vec2Face+ for Face Dataset Generation
• Authors: Haiyu Wu, Jaskirat Singh, Sicong Tian, Liang Zheng, Kevin W. Bowyer,
• Abstract summary: Vec2Face+ is a generative model that creates images directly from image features.<n>Our system generates VFace10K, a synthetic face dataset with 10K identities.<n>The corresponding VFace100K and VFace300K datasets yield higher accuracy than the real-world training dataset, CASIA-WebFace.
• Score: 19.02273216268032
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: When synthesizing identities as face recognition training data, it is generally believed that large inter-class separability and intra-class attribute variation are essential for synthesizing a quality dataset. % This belief is generally correct, and this is what we aim for. However, when increasing intra-class variation, existing methods overlook the necessity of maintaining intra-class identity consistency. % To address this and generate high-quality face training data, we propose Vec2Face+, a generative model that creates images directly from image features and allows for continuous and easy control of face identities and attributes. Using Vec2Face+, we obtain datasets with proper inter-class separability and intra-class variation and identity consistency using three strategies: 1) we sample vectors sufficiently different from others to generate well-separated identities; 2) we propose an AttrOP algorithm for increasing general attribute variations; 3) we propose LoRA-based pose control for generating images with profile head poses, which is more efficient and identity-preserving than AttrOP. % Our system generates VFace10K, a synthetic face dataset with 10K identities, which allows an FR model to achieve state-of-the-art accuracy on seven real-world test sets. Scaling the size to 4M and 12M images, the corresponding VFace100K and VFace300K datasets yield higher accuracy than the real-world training dataset, CASIA-WebFace, on five real-world test sets. This is the first time a synthetic dataset beats the CASIA-WebFace in average accuracy. In addition, we find that only 1 out of 11 synthetic datasets outperforms random guessing (\emph{i.e., 50\%}) in twin verification and that models trained with synthetic identities are more biased than those trained with real identities. Both are important aspects for future investigation. Code is available at https://github.com/HaiyuWu/Vec2Face_plus

Related papers

• VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognition [4.409387706050884]
  VariFace is a two-stage diffusion-based pipeline to create fair and diverse synthetic face datasets to train face recognition models.<n>When constrained to the same dataset size, VariFace considerably outperforms previous synthetic datasets.<n>For the first time, VariFace outperforms the real dataset (CASIA-WebFace) across six evaluation datasets.
  arXiv  Detail & Related papers  (2024-12-09T06:21:11Z)
• OSDFace: One-Step Diffusion Model for Face Restoration [72.5045389847792]
  Diffusion models have demonstrated impressive performance in face restoration.<n>We propose OSDFace, a novel one-step diffusion model for face restoration.<n>Results demonstrate that OSDFace surpasses current state-of-the-art (SOTA) methods in both visual quality and quantitative metrics.
  arXiv  Detail & Related papers  (2024-11-26T07:07:48Z)
• ID$^3$: Identity-Preserving-yet-Diversified Diffusion Models for Synthetic Face Recognition [60.15830516741776]
  Synthetic face recognition (SFR) aims to generate datasets that mimic the distribution of real face data. We introduce a diffusion-fueled SFR model termed $textID3$. $textID3$ employs an ID-preserving loss to generate diverse yet identity-consistent facial appearances.
  arXiv  Detail & Related papers  (2024-09-26T06:46:40Z)
• TCDiff: Triple Condition Diffusion Model with 3D Constraints for Stylizing Synthetic Faces [1.7535229154829601]
  Face recognition experiments using 1k, 2k, and 5k classes of our new dataset for training outperform state-of-the-art synthetic datasets in real face benchmarks.
  arXiv  Detail & Related papers  (2024-09-05T14:59:41Z)
• Vec2Face: Scaling Face Dataset Generation with Loosely Constrained Vectors [19.02273216268032]
  Vec2Face is a holistic model that uses only a sampled vector as input.<n>Vec2Face generates as many as 300K identities.<n>Vec2Face achieves state-of-the-art accuracy, from 92% to 93.52%, on five real-world test sets.
  arXiv  Detail & Related papers  (2024-09-04T17:59:51Z)
• Arc2Face: A Foundation Model for ID-Consistent Human Faces [95.00331107591859]
  Arc2Face is an identity-conditioned face foundation model. It can generate diverse photo-realistic images with an unparalleled degree of face similarity than existing models.
  arXiv  Detail & Related papers  (2024-03-18T10:32:51Z)
• SwinFace: A Multi-task Transformer for Face Recognition, Expression Recognition, Age Estimation and Attribute Estimation [60.94239810407917]
  This paper presents a multi-purpose algorithm for simultaneous face recognition, facial expression recognition, age estimation, and face attribute estimation based on a single Swin Transformer. To address the conflicts among multiple tasks, a Multi-Level Channel Attention (MLCA) module is integrated into each task-specific analysis. Experiments show that the proposed model has a better understanding of the face and achieves excellent performance for all tasks.
  arXiv  Detail & Related papers  (2023-08-22T15:38:39Z)
• How to Boost Face Recognition with StyleGAN? [13.067766076889995]
  State-of-the-art face recognition systems require vast amounts of labeled training data. Self-supervised revolution in the industry motivates research on the adaptation of related techniques to facial recognition. We show that a simple approach based on fine-tuning pSp encoder for StyleGAN allows us to improve upon the state-of-the-art facial recognition.
  arXiv  Detail & Related papers  (2022-10-18T18:41:56Z)
• SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Data [9.249824128880707]
  We propose and investigate the feasibility of using a privacy-friendly synthetically generated face dataset to train face recognition models. To address the privacy aspect of using such data to train a face recognition model, we provide extensive evaluation experiments on the identity relation between the synthetic dataset and the original authentic dataset used to train the generative model. We also propose to train face recognition on our privacy-friendly dataset, SFace, using three different learning strategies, multi-class classification, label-free knowledge transfer, and combined learning of multi-class classification and knowledge transfer.
  arXiv  Detail & Related papers  (2022-06-21T16:42:04Z)
• Learning Disentangled Representation for One-shot Progressive Face Swapping [92.09538942684539]
  We present a simple yet efficient method named FaceSwapper, for one-shot face swapping based on Generative Adversarial Networks.<n>Our method consists of a disentangled representation module and a semantic-guided fusion module.<n>Our method achieves state-of-the-art results on benchmark datasets with fewer training samples.
  arXiv  Detail & Related papers  (2022-03-24T11:19:04Z)
• DotFAN: A Domain-transferred Face Augmentation Network for Pose and Illumination Invariant Face Recognition [94.96686189033869]
  We propose a 3D model-assisted domain-transferred face augmentation network (DotFAN) DotFAN can generate a series of variants of an input face based on the knowledge distilled from existing rich face datasets collected from other domains. Experiments show that DotFAN is beneficial for augmenting small face datasets to improve their within-class diversity.
  arXiv  Detail & Related papers  (2020-02-23T08:16:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.