A Responsible Face Recognition Approach for Small and Mid-Scale Systems Through Personalized Neural Networks

• URL: http://arxiv.org/abs/2505.19920v1
• Date: Mon, 26 May 2025 12:45:01 GMT
• Title: A Responsible Face Recognition Approach for Small and Mid-Scale Systems Through Personalized Neural Networks
• Authors: Sebastian Groß, Stefan Heindorf, Philipp Terhörst,
• Abstract summary: We propose a novel model-template approach that replaces vector-based face templates with small personalized neural networks.<n>MOTE creates a dedicated binary classifier for each identity, trained to determine whether an input face matches the enrolled identity.<n>Experiments across multiple datasets and recognition systems demonstrate substantial improvements in fairness and particularly in privacy.
• Score: 1.8916513799622021
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Traditional face recognition systems rely on extracting fixed face representations, known as templates, to store and verify identities. These representations are typically generated by neural networks that often lack explainability and raise concerns regarding fairness and privacy. In this work, we propose a novel model-template (MOTE) approach that replaces vector-based face templates with small personalized neural networks. This design enables more responsible face recognition for small and medium-scale systems. During enrollment, MOTE creates a dedicated binary classifier for each identity, trained to determine whether an input face matches the enrolled identity. Each classifier is trained using only a single reference sample, along with synthetically balanced samples to allow adjusting fairness at the level of a single individual during enrollment. Extensive experiments across multiple datasets and recognition systems demonstrate substantial improvements in fairness and particularly in privacy. Although the method increases inference time and storage requirements, it presents a strong solution for small- and mid-scale applications where fairness and privacy are critical.

Related papers

• Diffusion-Driven Universal Model Inversion Attack for Face Recognition [17.70133779192382]
  Face recognition systems convert raw images into embeddings, traditionally considered privacy-preserving.<n>Model inversion attacks pose a significant privacy threat by reconstructing private facial images.<n>We propose DiffUMI, a training-free diffusion-driven universal model inversion attack for face recognition systems.
  arXiv  Detail & Related papers  (2025-04-25T01:53:27Z)
• CLIP Unreasonable Potential in Single-Shot Face Recognition [0.0]
  Face recognition is a core task in computer vision designed to identify and authenticate individuals by analyzing facial patterns and features. Recent Contrastive Language Image Pretraining (CLIP) a model developed by OpenAI has shown promising advancements. CLIP links natural language processing with vision tasks allowing it to generalize across modalities.
  arXiv  Detail & Related papers  (2024-11-19T08:23:52Z)
• Efficient Visualization of Neural Networks with Generative Models and Adversarial Perturbations [0.0]
  This paper presents a novel approach for deep visualization via a generative network, offering an improvement over existing methods. Our model simplifies the architecture by reducing the number of networks used, requiring only a generator and a discriminator. Our model requires less prior training knowledge and uses a non-adversarial training process, where the discriminator acts as a guide.
  arXiv  Detail & Related papers  (2024-09-20T14:59:25Z)
• Federated Face Forgery Detection Learning with Personalized Representation [63.90408023506508]
  Deep generator technology can produce high-quality fake videos that are indistinguishable, posing a serious social threat. Traditional forgery detection methods directly centralized training on data. The paper proposes a novel federated face forgery detection learning with personalized representation.
  arXiv  Detail & Related papers  (2024-06-17T02:20:30Z)
• Faceptor: A Generalist Model for Face Perception [52.8066001012464]
  Faceptor is proposed to adopt a well-designed single-encoder dual-decoder architecture. Layer-Attention into Faceptor enables the model to adaptively select features from optimal layers to perform the desired tasks. Our training framework can also be applied to auxiliary supervised learning, significantly improving performance in data-sparse tasks such as age estimation and expression recognition.
  arXiv  Detail & Related papers  (2024-03-14T15:42:31Z)
• Deep Variational Privacy Funnel: General Modeling with Applications in Face Recognition [3.351714665243138]
  We develop a method for privacy-preserving representation learning using an end-to-end training framework. We apply our model to state-of-the-art face recognition systems.
  arXiv  Detail & Related papers  (2024-01-26T11:32:53Z)
• Open-set Face Recognition with Neural Ensemble, Maximal Entropy Loss and Feature Augmentation [1.8047694351309207]
  Open-set face recognition refers to a scenario in which biometric systems have incomplete knowledge of all existing subjects. This work introduces a novel method that associates an ensemble of compact neural networks with a margin-based cost function. We carry out experiments on well-known LFW and IJB-C datasets where results show that the approach is able to boost closed and open-set identification rates.
  arXiv  Detail & Related papers  (2023-08-23T18:22:03Z)
• Dynamic Prototype Mask for Occluded Person Re-Identification [88.7782299372656]
  Existing methods mainly address this issue by employing body clues provided by an extra network to distinguish the visible part. We propose a novel Dynamic Prototype Mask (DPM) based on two self-evident prior knowledge. Under this condition, the occluded representation could be well aligned in a selected subspace spontaneously.
  arXiv  Detail & Related papers  (2022-07-19T03:31:13Z)
• Towards Intrinsic Common Discriminative Features Learning for Face Forgery Detection using Adversarial Learning [59.548960057358435]
  We propose a novel method which utilizes adversarial learning to eliminate the negative effect of different forgery methods and facial identities. Our face forgery detection model learns to extract common discriminative features through eliminating the effect of forgery methods and facial identities.
  arXiv  Detail & Related papers  (2022-07-08T09:23:59Z)
• Real Time Face Recognition Using Convoluted Neural Networks [0.0]
  Convolutional Neural Networks are proved to be best for facial recognition. The creation of dataset is done by converting face videos of the persons to be recognized into hundreds of images of person.
  arXiv  Detail & Related papers  (2020-10-09T12:04:49Z)
• Joint Deep Learning of Facial Expression Synthesis and Recognition [97.19528464266824]
  We propose a novel joint deep learning of facial expression synthesis and recognition method for effective FER. The proposed method involves a two-stage learning procedure. Firstly, a facial expression synthesis generative adversarial network (FESGAN) is pre-trained to generate facial images with different facial expressions. In order to alleviate the problem of data bias between the real images and the synthetic images, we propose an intra-class loss with a novel real data-guided back-propagation (RDBP) algorithm.
  arXiv  Detail & Related papers  (2020-02-06T10:56:00Z)
• Investigating the Impact of Inclusion in Face Recognition Training Data on Individual Face Identification [93.5538147928669]
  We audit ArcFace, a state-of-the-art, open source face recognition system, in a large-scale face identification experiment with more than one million distractor images. We find a Rank-1 face identification accuracy of 79.71% for individuals present in the model's training data and an accuracy of 75.73% for those not present.
  arXiv  Detail & Related papers  (2020-01-09T15:50:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.