Revisiting Face Recognition for Monozygotic Twins: The Celeb Twins Test Set

• URL: http://arxiv.org/abs/2609.01141v1
• Date: Tue, 01 Sep 2026 12:17:43 GMT
• Title: Revisiting Face Recognition for Monozygotic Twins: The Celeb Twins Test Set
• Abstract summary: The Celeb Twins Test Set (CTTS) contains web-scraped image pairs for 80 sets of celebrity twins.<n>It is the only twins test set with meta-data for twins with distinguishing skin marks and possible mirror asymmetry.<n>Current deep CNN matchers can achieve over 76% accuracy in classifying CTTS same-person / different-person image pairs.
• Score: 12.430872995530786
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Past literature on face recognition for monozygotic (("identical") twins points to facial marks and mirror asymmetry as possible directions for improved accuracy of twins recognition. The Celeb Twins Test Set (CTTS) contains web-scraped image pairs for 80 sets of celebrity twins. It is the only twins test set with meta-data for twins with distinguishing skin marks and possible mirror asymmetry. CTTS is organized in the manner of face verification test sets such as LFW, CALFW, CPLFW, CFP-FP, and AgeDB-30. Current deep CNN matchers can achieve over 76% accuracy in classifying CTTS same-person / different-person image pairs. We show that current matchers do not make use of skin marks, or asymmetry, and discuss reasons for this. Finally, we discuss the feasibility of using generative AI tools such as Grok, ChatGPT and Gemini to create images of imagined monozygotic twins as a means to increase representation of twins in face recognition training sets.

Related papers

• DNA: Dual-stage Native Attribution for Generated Image Source Tracing [75.65470221927096]
  Existing proactive methods rely on watermark embedding or model modification.<n>DNA is a coarse-to-fine framework that follows this hierarchy without additional neural-network training.<n>Experiments show that DNA achieves 89.11% end-to-end attribution accuracy.
  arXiv  Detail & Related papers  (2026-07-15T10:27:52Z)
• AHAN: Asymmetric Hierarchical Attention Network for Identical Twin Face Verification [0.0]
  Current face recognition methods achieve over 99.8% accuracy on standard benchmarks but drop dramatically to 88.9% when distinguishing identical twins.<n>We propose the Asymmetric Hierarchical Attention Network (AHAN), a novel architecture specifically designed for this challenge through multi-granularity facial analysis.<n>AHAN achieves 92.3% twin verification accuracy, representing a 3.4% improvement over state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-02-25T02:33:25Z)
• No More Sibling Rivalry: Debiasing Human-Object Interaction Detection [47.554732714656296]
  This study identifies a critical issue-"Toxic Siblings" bias-which hinders the interaction decoder's learning.<n>This bias arises from high confusion among sibling triplets/categories, where increased similarity paradoxically reduces precision.<n>We propose two novel debiasing learning objectives-"contrastive-then-calibration" and "merge-then-split"
  arXiv  Detail & Related papers  (2025-08-31T09:23:15Z)
• A Siamese Network to Detect If Two Iris Images Are Monozygotic [7.082273060309677]
  We employ a Siamese network architecture and contrastive learning to categorize a pair of iris images as coming from monozygotic or non-monozygotic irises.<n>Our approach achieves accuracy levels using the full iris image that exceed those previously reported for human classification of monozygotic iris pairs.
  arXiv  Detail & Related papers  (2025-03-12T18:48:38Z)
• Goldilocks Test Sets for Face Verification [5.518961562474026]
  We propose three challenging test sets to reveal important but ignored weaknesses of the existing face recognition algorithms.<n>To challenge FR models on similar-looking persons, we propose twins-IND, which contains images from a dedicated twins dataset.<n>The proposed test sets have on-par or higher difficulties than the existing test sets.
  arXiv  Detail & Related papers  (2024-05-24T22:27:10Z)
• Few-Shot Meta Learning for Recognizing Facial Phenotypes of Genetic Disorders [55.41644538483948]
  Automated classification and similarity retrieval aid physicians in decision-making to diagnose possible genetic conditions as early as possible. Previous work has addressed the problem as a classification problem and used deep learning methods. In this study, we used a facial recognition model trained on a large corpus of healthy individuals as a pre-task and transferred it to facial phenotype recognition.
  arXiv  Detail & Related papers  (2022-10-23T11:52:57Z)
• Weakly Supervised Face Naming with Symmetry-Enhanced Contrastive Loss [50.32343933000289]
  SECLA is a Symmetry-Enhanced Contrastive Learning-based Alignment model. A variation of the model, SECLA-B, learns to align names and faces as humans do. We achieve state-of-the-art results for both the augmented Labeled Faces in the Wild dataset and the Celebrity Together dataset.
  arXiv  Detail & Related papers  (2022-10-17T11:51:04Z)
• Benchmarking Human Face Similarity Using Identical Twins [5.93228031688634]
  The problem of distinguishing identical twins and non-twin look-alikes in automated facial recognition (FR) applications has become increasingly important. This work presents an application of one of the largest twin datasets compiled to date to address two FR challenges.
  arXiv  Detail & Related papers  (2022-08-25T01:45:02Z)
• T-Person-GAN: Text-to-Person Image Generation with Identity-Consistency and Manifold Mix-Up [16.165889084870116]
  We present an end-to-end approach to generate high-resolution person images conditioned on texts only. We develop an effective generative model to produce person images with two novel mechanisms.
  arXiv  Detail & Related papers  (2022-08-18T07:41:02Z)
• Twin identification over viewpoint change: A deep convolutional neural network surpasses humans [2.9363019325439255]
  Deep convolutional neural networks have achieved human-level accuracy in face identification. It is unclear how accurately they discriminate highly-similar faces. A DCNN trained for face identification was tested on the same image pairs presented to humans. Machine performance mirrored the pattern of human accuracy, but with performance at or above all humans in all but one condition.
  arXiv  Detail & Related papers  (2022-07-12T04:59:53Z)
• Contrastive Semantic Similarity Learning for Image Captioning Evaluation with Intrinsic Auto-encoder [52.42057181754076]
  Motivated by the auto-encoder mechanism and contrastive representation learning advances, we propose a learning-based metric for image captioning. We develop three progressive model structures to learn the sentence level representations. Experiment results show that our proposed method can align well with the scores generated from other contemporary metrics.
  arXiv  Detail & Related papers  (2021-06-29T12:27:05Z)
• DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition [85.94331736287765]
  We formulate HFR as a dual generation problem, and tackle it via a novel Dual Variational Generation (DVG-Face) framework. We integrate abundant identity information of large-scale visible data into the joint distribution. Massive new diverse paired heterogeneous images with the same identity can be generated from noises.
  arXiv  Detail & Related papers  (2020-09-20T09:48:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.