Improving Identity-Robustness for Face Models

• URL: http://arxiv.org/abs/2304.03838v2
• Date: Thu, 29 Jun 2023 07:05:37 GMT
• Title: Improving Identity-Robustness for Face Models
• Authors: Qi Qi, Shervin Ardeshir
• Abstract summary: We explore using face-recognition embedding vectors, as proxies for identities, to enforce such robustness. We do so by weighting samples according to their conditional inverse density (CID) in the proxy embedding space. Our experiments suggest that such a simple sample weighting scheme, not only improves the training robustness, it often improves the overall performance.
• Score: 9.721206532236515
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Despite the success of deep-learning models in many tasks, there have been concerns about such models learning shortcuts, and their lack of robustness to irrelevant confounders. When it comes to models directly trained on human faces, a sensitive confounder is that of human identities. Many face-related tasks should ideally be identity-independent, and perform uniformly across different individuals (i.e. be fair). One way to measure and enforce such robustness and performance uniformity is through enforcing it during training, assuming identity-related information is available at scale. However, due to privacy concerns and also the cost of collecting such information, this is often not the case, and most face datasets simply contain input images and their corresponding task-related labels. Thus, improving identity-related robustness without the need for such annotations is of great importance. Here, we explore using face-recognition embedding vectors, as proxies for identities, to enforce such robustness. We propose to use the structure in the face-recognition embedding space, to implicitly emphasize rare samples within each class. We do so by weighting samples according to their conditional inverse density (CID) in the proxy embedding space. Our experiments suggest that such a simple sample weighting scheme, not only improves the training robustness, it often improves the overall performance as a result of such robustness. We also show that employing such constraints during training results in models that are significantly less sensitive to different levels of bias in the dataset.

Related papers

• On Feature Decorrelation in Cloth-Changing Person Re-identification [32.27835236681253]
  Cloth-changing person re-identification (CC-ReID) poses a significant challenge in computer vision. Traditional methods to achieve this involve integrating multi-modality data or employing manually annotated clothing labels. We introduce a novel regularization technique based on density ratio estimation.
  arXiv  Detail & Related papers  (2024-10-07T22:25:37Z)
• Segue: Side-information Guided Generative Unlearnable Examples for Facial Privacy Protection in Real World [64.4289385463226]
  We propose Segue: Side-information guided generative unlearnable examples. To improve transferability, we introduce side information such as true labels and pseudo labels. It can resist JPEG compression, adversarial training, and some standard data augmentations.
  arXiv  Detail & Related papers  (2023-10-24T06:22:37Z)
• Enhancing Multiple Reliability Measures via Nuisance-extended Information Bottleneck [77.37409441129995]
  In practical scenarios where training data is limited, many predictive signals in the data can be rather from some biases in data acquisition. We consider an adversarial threat model under a mutual information constraint to cover a wider class of perturbations in training. We propose an autoencoder-based training to implement the objective, as well as practical encoder designs to facilitate the proposed hybrid discriminative-generative training.
  arXiv  Detail & Related papers  (2023-03-24T16:03:21Z)
• Attribute-preserving Face Dataset Anonymization via Latent Code Optimization [64.4569739006591]
  We present a task-agnostic anonymization procedure that directly optimize the images' latent representation in the latent space of a pre-trained GAN. We demonstrate through a series of experiments that our method is capable of anonymizing the identity of the images whilst -- crucially -- better-preserving the facial attributes.
  arXiv  Detail & Related papers  (2023-03-20T17:34:05Z)
• Self-similarity Driven Scale-invariant Learning for Weakly Supervised Person Search [66.95134080902717]
  We propose a novel one-step framework, named Self-similarity driven Scale-invariant Learning (SSL) We introduce a Multi-scale Exemplar Branch to guide the network in concentrating on the foreground and learning scale-invariant features. Experiments on PRW and CUHK-SYSU databases demonstrate the effectiveness of our method.
  arXiv  Detail & Related papers  (2023-02-25T04:48:11Z)
• Training face verification models from generated face identity data [2.557825816851682]
  We consider an approach to increase the privacy protection of data sets, as applied to face recognition. We build on the StyleGAN generative adversarial network and feed it with latent codes combining two distinct sub-codes. We find that the addition of a small amount of private data greatly improves the performance of our model.
  arXiv  Detail & Related papers  (2021-08-02T12:00:01Z)
• How important are faces for person re-identification? [14.718372669984364]
  We apply a face detection and blurring algorithm to create anonymized versions of several popular person re-identification datasets. We evaluate the effect of this anonymization on re-identification performance using standard metrics.
  arXiv  Detail & Related papers  (2020-10-13T11:47:16Z)
• Trade-offs between membership privacy & adversarially robust learning [13.37805637358556]
  We identify settings where standard models will overfit to a larger extent in comparison to robust models. The degree of overfitting naturally depends on the amount of data available for training.
  arXiv  Detail & Related papers  (2020-06-08T14:20:12Z)
• Boosting Unconstrained Face Recognition with Auxiliary Unlabeled Data [59.85605718477639]
  We present an approach to use unlabeled faces to learn generalizable face representations. Experimental results on unconstrained datasets show that a small amount of unlabeled data with sufficient diversity can lead to an appreciable gain in recognition performance.
  arXiv  Detail & Related papers  (2020-03-17T20:58:56Z)
• Intra-Camera Supervised Person Re-Identification [87.88852321309433]
  We propose a novel person re-identification paradigm based on an idea of independent per-camera identity annotation. This eliminates the most time-consuming and tedious inter-camera identity labelling process. We formulate a Multi-tAsk mulTi-labEl (MATE) deep learning method for Intra-Camera Supervised (ICS) person re-id.
  arXiv  Detail & Related papers  (2020-02-12T15:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.