On the Burstiness of Faces in Set

• URL: http://arxiv.org/abs/2506.20312v1
• Date: Wed, 25 Jun 2025 10:49:45 GMT
• Title: On the Burstiness of Faces in Set
• Authors: Jiong Wang,
• Abstract summary: Burstiness, a phenomenon observed in text and image retrieval, refers to that particular elements appear more times in a set than a statistically independent model assumes.<n>We argue that burstiness exists widely and degrades the performance in two aspects: Firstly, the bursty faces, where faces with particular attributes %exist frequently in a face set, dominate the training instances and dominate the training face sets and lead to poor generalization ability to unconstrained scenarios.
• Score: 4.253592897114859
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Burstiness, a phenomenon observed in text and image retrieval, refers to that particular elements appear more times in a set than a statistically independent model assumes. We argue that in the context of set-based face recognition (SFR), burstiness exists widely and degrades the performance in two aspects: Firstly, the bursty faces, where faces with particular attributes %exist frequently in a face set, dominate the training instances and dominate the training face sets and lead to poor generalization ability to unconstrained scenarios. Secondly, the bursty faces %dominating the evaluation sets interfere with the similarity comparison in set verification and identification when evaluation. To detect the bursty faces in a set, we propose three strategies based on Quickshift++, feature self-similarity, and generalized max-pooling (GMP). We apply the burst detection results on training and evaluation stages to enhance the sampling ratios or contributions of the infrequent faces. When evaluation, we additionally propose the quality-aware GMP that enables awareness of the face quality and robustness to the low-quality faces for the original GMP. We give illustrations and extensive experiments on the SFR benchmarks to demonstrate that burstiness is widespread and suppressing burstiness considerably improves the recognition performance.

Related papers

• A Lightweight Face Quality Assessment Framework to Improve Face Verification Performance in Real-Time Screening Applications [0.0]
  Face image quality plays a critical role in determining the accuracy and reliability of face verification systems.<n>Low-quality face images, often caused by factors such as motion blur, poor lighting conditions, and extreme pose variations, significantly degrade the performance of face recognition models.<n>We propose a framework for automatic face quality assessment, which aims to pre-filter low-quality face images before they are passed to the verification pipeline.
  arXiv  Detail & Related papers  (2025-07-21T18:04:14Z)
• Exploring Decision-based Black-box Attacks on Face Forgery Detection [53.181920529225906]
  Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy. Although face forgery detection has successfully distinguished fake faces, recent studies have demonstrated that face forgery detectors are very vulnerable to adversarial examples.
  arXiv  Detail & Related papers  (2023-10-18T14:49:54Z)
• Set-Based Face Recognition Beyond Disentanglement: Burstiness Suppression With Variance Vocabulary [78.203301910422]
  We argue that the two crucial issues in SFR, the face quality and burstiness, are both identity-irrelevant and variance-relevant. We propose a light-weighted set-based disentanglement framework to separate the identity features with the variance features. To suppress face burstiness in the sets, we propose a vocabulary-based burst suppression (VBS) method.
  arXiv  Detail & Related papers  (2023-04-13T04:02:58Z)
• Watch Out for the Confusing Faces: Detecting Face Swapping with the Probability Distribution of Face Identification Models [37.49012763328351]
  We propose a novel face swapping detection approach based on face identification probability distributions. IdP_FSD is specially designed for detecting swapped faces whose identities belong to a finite set. IdP_FSD exploits face swapping's common nature that the identity of swapped face combines that of two faces involved in swapping.
  arXiv  Detail & Related papers  (2023-03-23T09:33:10Z)
• Fair SA: Sensitivity Analysis for Fairness in Face Recognition [1.7149364927872013]
  We propose a new fairness evaluation based on robustness in the form of a generic framework. We analyze the performance of common face recognition models and empirically show that certain subgroups are at a disadvantage when images are perturbed.
  arXiv  Detail & Related papers  (2022-02-08T01:16:09Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Inducing Predictive Uncertainty Estimation for Face Recognition [102.58180557181643]
  We propose a method for generating image quality training data automatically from'mated-pairs' of face images. We use the generated data to train a lightweight Predictive Confidence Network, termed as PCNet, for estimating the confidence score of a face image.
  arXiv  Detail & Related papers  (2020-09-01T17:52:00Z)
• Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer [51.926868759681014]
  We present a framework to predict the facial parameters based on a bone-driven face model (BDFM) under different views. The proposed framework consists of a feature extractor, a generator, and a facial parameter regressor.
  arXiv  Detail & Related papers  (2020-08-20T09:49:13Z)
• On Improving the Generalization of Face Recognition in the Presence of Occlusions [13.299431908881425]
  Occlusion-aware face REcOgnition (OREO) approach learned discriminative facial templates despite the presence of such occlusions. OREO improved the generalization ability of face recognition under occlusions by (10.17%) in a single-image-based setting.
  arXiv  Detail & Related papers  (2020-06-11T20:17:23Z)
• Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild [98.48284827503409]
  We develop a textitunified BIQA model and an approach of training it for both synthetic and realistic distortions. We employ the fidelity loss to optimize a deep neural network for BIQA over a large number of such image pairs. Experiments on six IQA databases show the promise of the learned method in blindly assessing image quality in the laboratory and wild.
  arXiv  Detail & Related papers  (2020-05-28T13:35:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.