PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymization

• URL: http://arxiv.org/abs/2509.20281v1
• Date: Wed, 24 Sep 2025 16:15:43 GMT
• Title: PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymization
• Authors: Haruka Kumagai, Leslie Wöhler, Satoshi Ikehata, Kiyoharu Aizawa,
• Abstract summary: This paper proposes a human-perception-based face similarity metric, creating a dataset of 6,400 triplet annotations and metric learning to predict the similarity.<n> Experimental results demonstrate significant improvements in both face similarity prediction and attribute-based face classification tasks over existing methods.
• Score: 33.653319607273495
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In response to rising societal awareness of privacy concerns, face anonymization techniques have advanced, including the emergence of face-swapping methods that replace one identity with another. Achieving a balance between anonymity and naturalness in face swapping requires careful selection of identities: overly similar faces compromise anonymity, while dissimilar ones reduce naturalness. Existing models, however, focus on binary identity classification "the same person or not", making it difficult to measure nuanced similarities such as "completely different" versus "highly similar but different." This paper proposes a human-perception-based face similarity metric, creating a dataset of 6,400 triplet annotations and metric learning to predict the similarity. Experimental results demonstrate significant improvements in both face similarity prediction and attribute-based face classification tasks over existing methods.

Related papers

• A novel Facial Recognition technique with Focusing on Masked Faces [0.26120191698993106]
  This study proposes Masked-Unmasked Face Matching Model (MUFM)<n>This model employs transfer learning using the Visual Geometry Group (VGG16) model to extract significant facial features.<n>The cosine similarity metric is employed to compare masked and unmasked faces of the same individuals.
  arXiv  Detail & Related papers  (2025-01-08T11:53:30Z)
• iFADIT: Invertible Face Anonymization via Disentangled Identity Transform [51.123936665445356]
  Face anonymization aims to conceal the visual identity of a face to safeguard the individual's privacy.<n>This paper proposes a novel framework named iFADIT, an acronym for Invertible Face Anonymization via Disentangled Identity Transform.
  arXiv  Detail & Related papers  (2025-01-08T10:08:09Z)
• Local Features Meet Stochastic Anonymization: Revolutionizing Privacy-Preserving Face Recognition for Black-Box Models [54.88064975480573]
  The task of privacy-preserving face recognition (PPFR) currently faces two major unsolved challenges.<n>By disrupting global features while enhancing local features, we achieve effective recognition even in black-box environments.<n>Our method achieves an average recognition accuracy of 94.21% on black-box models, outperforming existing methods in both privacy protection and anti-reconstruction capabilities.
  arXiv  Detail & Related papers  (2024-12-11T10:49:15Z)
• Face Anonymization Made Simple [44.24233169815565]
  Current face anonymization techniques often depend on identity loss calculated by face recognition models, which can be inaccurate and unreliable. In contrast, our approach uses diffusion models with only a reconstruction loss, eliminating the need for facial landmarks or masks. Our model achieves state-of-the-art performance in three key areas: identity anonymization, facial preservation, and image quality.
  arXiv  Detail & Related papers  (2024-11-01T17:45:21Z)
• BlendFace: Re-designing Identity Encoders for Face-Swapping [2.320417845168326]
  BlendFace is a novel identity encoder for face-swapping. It disentangles identity features into generators and guides generators properly as an identity loss function. Extensive experiments demonstrate that BlendFace improves the identity-attribute disentanglement in face-swapping models.
  arXiv  Detail & Related papers  (2023-07-20T13:17:30Z)
• GANonymization: A GAN-based Face Anonymization Framework for Preserving Emotional Expressions [43.017036538109274]
  GANonymization is a novel face anonymization framework with facial expression-preserving abilities. Our approach is based on a high-level representation of a face, which is synthesized into an anonymized version based on a generative adversarial network (GAN)
  arXiv  Detail & Related papers  (2023-05-03T14:22:48Z)
• Benchmarking Human Face Similarity Using Identical Twins [5.93228031688634]
  The problem of distinguishing identical twins and non-twin look-alikes in automated facial recognition (FR) applications has become increasingly important. This work presents an application of one of the largest twin datasets compiled to date to address two FR challenges.
  arXiv  Detail & Related papers  (2022-08-25T01:45:02Z)
• Towards Intrinsic Common Discriminative Features Learning for Face Forgery Detection using Adversarial Learning [59.548960057358435]
  We propose a novel method which utilizes adversarial learning to eliminate the negative effect of different forgery methods and facial identities. Our face forgery detection model learns to extract common discriminative features through eliminating the effect of forgery methods and facial identities.
  arXiv  Detail & Related papers  (2022-07-08T09:23:59Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Dual-Attention GAN for Large-Pose Face Frontalization [59.689836951934694]
  We present a novel Dual-Attention Generative Adversarial Network (DA-GAN) for photo-realistic face frontalization. Specifically, a self-attention-based generator is introduced to integrate local features with their long-range dependencies. A novel face-attention-based discriminator is applied to emphasize local features of face regions.
  arXiv  Detail & Related papers  (2020-02-17T20:00:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.