IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Models

• URL: http://arxiv.org/abs/2308.04995v2
• Date: Thu, 10 Aug 2023 10:43:53 GMT
• Title: IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Models
• Authors: Fadi Boutros, Jonas Henry Grebe, Arjan Kuijper, Naser Damer
• Abstract summary: Synthetic datasets have emerged as a promising alternative to privacy-sensitive authentic data for face recognition development. IDiff-Face is a novel approach based on conditional latent diffusion models for synthetic identity generation with realistic identity variations for face recognition training.
• Score: 15.217324893166579
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The availability of large-scale authentic face databases has been crucial to the significant advances made in face recognition research over the past decade. However, legal and ethical concerns led to the recent retraction of many of these databases by their creators, raising questions about the continuity of future face recognition research without one of its key resources. Synthetic datasets have emerged as a promising alternative to privacy-sensitive authentic data for face recognition development. However, recent synthetic datasets that are used to train face recognition models suffer either from limitations in intra-class diversity or cross-class (identity) discrimination, leading to less optimal accuracies, far away from the accuracies achieved by models trained on authentic data. This paper targets this issue by proposing IDiff-Face, a novel approach based on conditional latent diffusion models for synthetic identity generation with realistic identity variations for face recognition training. Through extensive evaluations, our proposed synthetic-based face recognition approach pushed the limits of state-of-the-art performances, achieving, for example, 98.00% accuracy on the Labeled Faces in the Wild (LFW) benchmark, far ahead from the recent synthetic-based face recognition solutions with 95.40% and bridging the gap to authentic-based face recognition with 99.82% accuracy.

Related papers

• Local Features Meet Stochastic Anonymization: Revolutionizing Privacy-Preserving Face Recognition for Black-Box Models [54.88064975480573]
  The task of privacy-preserving face recognition (PPFR) currently faces two major unsolved challenges. By disrupting global features while enhancing local features, we achieve effective recognition even in black-box environments. Our method achieves an average recognition accuracy of 94.21% on black-box models, outperforming existing methods in both privacy protection and anti-reconstruction capabilities.
  arXiv  Detail & Related papers  (2024-12-11T10:49:15Z)
• Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Data [104.30479583607918]
  2nd FRCSyn-onGoing challenge is based on the 2nd Face Recognition Challenge in the Era of Synthetic Data (FRCSyn), originally launched at CVPR 2024. We focus on exploring the use of synthetic data both individually and in combination with real data to solve current challenges in face recognition.
  arXiv  Detail & Related papers  (2024-12-02T11:12:01Z)
• ID$^3$: Identity-Preserving-yet-Diversified Diffusion Models for Synthetic Face Recognition [60.15830516741776]
  Synthetic face recognition (SFR) aims to generate datasets that mimic the distribution of real face data. We introduce a diffusion-fueled SFR model termed $textID3$. $textID3$ employs an ID-preserving loss to generate diverse yet identity-consistent facial appearances.
  arXiv  Detail & Related papers  (2024-09-26T06:46:40Z)
• Second Edition FRCSyn Challenge at CVPR 2024: Face Recognition Challenge in the Era of Synthetic Data [104.45155847778584]
  This paper presents an overview of the 2nd edition of the Face Recognition Challenge in the Era of Synthetic Data (FRCSyn) FRCSyn aims to investigate the use of synthetic data in face recognition to address current technological limitations.
  arXiv  Detail & Related papers  (2024-04-16T08:15:10Z)
• SDFR: Synthetic Data for Face Recognition Competition [51.9134406629509]
  Large-scale face recognition datasets are collected by crawling the Internet and without individuals' consent, raising legal, ethical, and privacy concerns. Recently several works proposed generating synthetic face recognition datasets to mitigate concerns in web-crawled face recognition datasets. This paper presents the summary of the Synthetic Data for Face Recognition (SDFR) Competition held in conjunction with the 18th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2024) The SDFR competition was split into two tasks, allowing participants to train face recognition systems using new synthetic datasets and/or existing ones.
  arXiv  Detail & Related papers  (2024-04-06T10:30:31Z)
• If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Faces [16.977459035497162]
  Large face datasets are primarily sourced from web-based images, lacking explicit user consent. In this paper, we examine whether and how synthetic face data can be used to train effective face recognition models.
  arXiv  Detail & Related papers  (2024-04-04T15:45:25Z)
• Synthetic Data for Face Recognition: Current State and Future Prospects [14.288753326973984]
  This work aims at providing a clear and structured picture of the use-cases of synthetic face data in face recognition. We discuss the challenges facing the use of synthetic data in face recognition development and several future prospects of synthetic data in the domain of face recognition.
  arXiv  Detail & Related papers  (2023-05-01T18:25:22Z)
• Identity-driven Three-Player Generative Adversarial Network for Synthetic-based Face Recognition [14.73254194339562]
  We present a three-player generative adversarial network (GAN) framework, namely IDnet, that enables the integration of identity information into the generation process. We empirically proved that our IDnet synthetic images are of higher identity discrimination in comparison to the conventional two-player GAN. We demonstrated the applicability of our IDnet data in training face recognition models by evaluating these models on a wide set of face recognition benchmarks.
  arXiv  Detail & Related papers  (2023-04-30T00:04:27Z)
• Unsupervised Face Recognition using Unlabeled Synthetic Data [16.494722503803196]
  We propose an unsupervised face recognition model based on unlabeled synthetic data (U SynthFace) Our proposed U SynthFace learns to maximize the similarity between two augmented images of the same synthetic instance. We prove the effectiveness of our U SynthFace in achieving relatively high recognition accuracies using unlabeled synthetic data.
  arXiv  Detail & Related papers  (2022-11-14T14:05:19Z)
• SynFace: Face Recognition with Synthetic Data [83.15838126703719]
  We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap. We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
  arXiv  Detail & Related papers  (2021-08-18T03:41:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.