Supervised Contrastive Learning and Feature Fusion for Improved Kinship Verification

• URL: http://arxiv.org/abs/2302.09556v1
• Date: Sun, 19 Feb 2023 12:20:14 GMT
• Title: Supervised Contrastive Learning and Feature Fusion for Improved Kinship Verification
• Authors: Nazim Bendib
• Abstract summary: We propose a novel method for solving kinship verification by using supervised contrastive learning. Our experiments show state-of-the-art results and achieve 81.1% accuracy in the Families in the Wild dataset.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Facial Kinship Verification is the task of determining the degree of familial relationship between two facial images. It has recently gained a lot of interest in various applications spanning forensic science, social media, and demographic studies. In the past decade, deep learning-based approaches have emerged as a promising solution to this problem, achieving state-of-the-art performance. In this paper, we propose a novel method for solving kinship verification by using supervised contrastive learning, which trains the model to maximize the similarity between related individuals and minimize it between unrelated individuals. Our experiments show state-of-the-art results and achieve 81.1% accuracy in the Families in the Wild (FIW) dataset.

Related papers

• Cross-Age Contrastive Learning for Age-Invariant Face Recognition [29.243096587091575]
  Cross-age facial images are typically challenging and expensive to collect. Images of the same subject at different ages are usually hard or even impossible to obtain. We propose a novel semi-supervised learning approach named Cross-Age Contrastive Learning (CACon)
  arXiv  Detail & Related papers  (2023-12-18T13:41:21Z)
• From Pretext to Purpose: Batch-Adaptive Self-Supervised Learning [32.18543787821028]
  This paper proposes an adaptive technique of batch fusion for self-supervised contrastive learning. It achieves state-of-the-art performance under equitable comparisons. We suggest that the proposed method may contribute to the advancement of data-driven self-supervised learning research.
  arXiv  Detail & Related papers  (2023-11-16T15:47:49Z)
• The Fairness Stitch: Unveiling the Potential of Model Stitching in Neural Network De-Biasing [0.043512163406552]
  This study introduces a novel method called "The Fairness Stitch" to enhance fairness in deep learning models. We conduct a comprehensive evaluation of two well-known datasets, CelebA and UTKFace. Our findings reveal a notable improvement in achieving a balanced trade-off between fairness and performance.
  arXiv  Detail & Related papers  (2023-11-06T21:14:37Z)
• Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting [64.80538055623842]
  sociodemographic prompting is a technique that steers the output of prompt-based models towards answers that humans with specific sociodemographic profiles would give. We show that sociodemographic information affects model predictions and can be beneficial for improving zero-shot learning in subjective NLP tasks.
  arXiv  Detail & Related papers  (2023-09-13T15:42:06Z)
• Age Prediction From Face Images Via Contrastive Learning [1.7705784090599048]
  We leverage readily available face datasets of different people at different ages and aim to extract age-related features using contrastive learning. Our method emphasizes relevant features while suppressing identity-related features using a combination of cosine similarity and triplet margin losses.
  arXiv  Detail & Related papers  (2023-08-23T03:43:34Z)
• Learning Diversified Feature Representations for Facial Expression Recognition in the Wild [97.14064057840089]
  We propose a mechanism to diversify the features extracted by CNN layers of state-of-the-art facial expression recognition architectures. Experimental results on three well-known facial expression recognition in-the-wild datasets, AffectNet, FER+, and RAF-DB, show the effectiveness of our method.
  arXiv  Detail & Related papers  (2022-10-17T19:25:28Z)
• On Modality Bias Recognition and Reduction [70.69194431713825]
  We study the modality bias problem in the context of multi-modal classification. We propose a plug-and-play loss function method, whereby the feature space for each label is adaptively learned. Our method yields remarkable performance improvements compared with the baselines.
  arXiv  Detail & Related papers  (2022-02-25T13:47:09Z)
• Kinship Verification Based on Cross-Generation Feature Interaction Learning [53.62256887837659]
  Kinship verification from facial images has been recognized as an emerging yet challenging technique in computer vision applications. We propose a novel cross-generation feature interaction learning (CFIL) framework for robust kinship verification.
  arXiv  Detail & Related papers  (2021-09-07T01:50:50Z)
• Deep Collaborative Multi-Modal Learning for Unsupervised Kinship Estimation [53.62256887837659]
  Kinship verification is a long-standing research challenge in computer vision. We propose a novel deep collaborative multi-modal learning (DCML) to integrate the underlying information presented in facial properties. Our DCML method is always superior to some state-of-the-art kinship verification methods.
  arXiv  Detail & Related papers  (2021-09-07T01:34:51Z)
• FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild [50.8865921538953]
  We propose a method to explicitly incorporate facial semantics into age estimation. We design a face parsing-based network to learn semantic information at different scales. We show that our method consistently outperforms all existing age estimation methods.
  arXiv  Detail & Related papers  (2021-06-21T14:31:32Z)
• A Unified Approach to Kinship Verification [10.508187462682308]
  We propose a deep learning-based approach for kin verification using a unified multi-task learning scheme. We introduce a novel approach for fusing the embeddings of kin images, to avoid overfitting, which is a common issue in training such networks. An adaptive sampling scheme is derived for the training set images to resolve the inherent imbalance in kin verification datasets.
  arXiv  Detail & Related papers  (2020-09-12T22:13:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.