Facial Soft Biometrics for Recognition in the Wild: Recent Works, Annotation, and COTS Evaluation

• URL: http://arxiv.org/abs/2210.13129v1
• Date: Mon, 24 Oct 2022 11:29:57 GMT
• Title: Facial Soft Biometrics for Recognition in the Wild: Recent Works, Annotation, and COTS Evaluation
• Authors: Ester Gonzalez-Sosa, Julian Fierrez, Ruben Vera-Rodriguez, Fernando Alonso-Fernandez
• Abstract summary: We study the role of soft biometrics to enhance person recognition systems in unconstrained scenarios. We consider two assumptions: 1) manual estimation of soft biometrics and 2) automatic estimation from two commercial off-the-shelf systems. Experiments are carried out fusing soft biometrics with two state-of-the-art face recognition systems based on deep learning.
• Score: 63.05890836038913
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The role of soft biometrics to enhance person recognition systems in unconstrained scenarios has not been extensively studied. Here, we explore the utility of the following modalities: gender, ethnicity, age, glasses, beard, and moustache. We consider two assumptions: 1) manual estimation of soft biometrics and 2) automatic estimation from two commercial off-the-shelf systems (COTS). All experiments are reported using the labeled faces in the wild (LFW) database. First, we study the discrimination capabilities of soft biometrics standalone. Then, experiments are carried out fusing soft biometrics with two state-of-the-art face recognition systems based on deep learning. We observe that soft biometrics is a valuable complement to the face modality in unconstrained scenarios, with relative improvements up to 40%/15% in the verification performance when using manual/automatic soft biometrics estimation. Results are reproducible as we make public our manual annotations and COTS outputs of soft biometrics over LFW, as well as the face recognition scores.

Related papers

• Open-Set Biometrics: Beyond Good Closed-Set Models [15.65725865703615]
  Most practical applications involve open-set biometrics, where probe subjects may or may not be present in the gallery. Existing loss functions are inconsistent with open-set evaluation. We introduce novel loss functions: (1) the identification-detection loss optimized for open-set performance under selective thresholds and (2) relative threshold minimization to reduce the maximum negative score for each probe.
  arXiv  Detail & Related papers  (2024-07-23T02:34:39Z)
• ChatGPT and biometrics: an assessment of face recognition, gender detection, and age estimation capabilities [2.537406035246369]
  We specifically examine the capabilities of ChatGPT in performing biometric-related tasks, with an emphasis on face recognition, gender detection, and age estimation. Our study reveals that ChatGPT recognizes facial identities and differentiates between two facial images with considerable accuracy.
  arXiv  Detail & Related papers  (2024-03-05T13:41:25Z)
• Multi-Channel Time-Series Person and Soft-Biometric Identification [65.83256210066787]
  This work investigates person and soft-biometrics identification from recordings of humans performing different activities using deep architectures. We evaluate the method on four datasets of multi-channel time-series human activity recognition (HAR) Soft-biometric based attribute representation shows promising results and emphasis the necessity of larger datasets.
  arXiv  Detail & Related papers  (2023-04-04T07:24:51Z)
• Fingerprint Image-Quality Estimation and its Application to Multialgorithm Verification [56.128200319868526]
  Signal-quality awareness has been found to increase recognition rates and to support decisions in multisensor environments significantly. Here, we study the orientation tensor of fingerprint images to quantify signal impairments, such as noise, lack of structure, blur, with the help of symmetry descriptors. The quantitative results favor quality awareness under all aspects, boosting recognition rates and fusing differently skilled experts efficiently as well as effectively.
  arXiv  Detail & Related papers  (2022-11-24T12:17:49Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• Evaluation of a User Authentication Schema Using Behavioral Biometrics and Machine Learning [0.0]
  This study contributes to the research being done on behavioral biometrics by creating and evaluating a user authentication scheme using behavioral biometrics. The behavioral biometrics used in this study include touch dynamics and phone movement. We evaluate the performance of different single-modal and multi-modal combinations of the two biometrics.
  arXiv  Detail & Related papers  (2022-05-07T05:16:34Z)
• Mobile Behavioral Biometrics for Passive Authentication [65.94403066225384]
  This work carries out a comparative analysis of unimodal and multimodal behavioral biometric traits. Experiments are performed over HuMIdb, one of the largest and most comprehensive freely available mobile user interaction databases. In our experiments, the most discriminative background sensor is the magnetometer, whereas among touch tasks the best results are achieved with keystroke.
  arXiv  Detail & Related papers  (2022-03-14T17:05:59Z)
• Benchmarking Quality-Dependent and Cost-Sensitive Score-Level Multimodal Biometric Fusion Algorithms [58.156733807470395]
  This paper reports a benchmarking study carried out within the framework of the BioSecure DS2 (Access Control) evaluation campaign. The campaign targeted the application of physical access control in a medium-size establishment with some 500 persons. To the best of our knowledge, this is the first attempt to benchmark quality-based multimodal fusion algorithms.
  arXiv  Detail & Related papers  (2021-11-17T13:39:48Z)
• Attribute-Based Deep Periocular Recognition: Leveraging Soft Biometrics to Improve Periocular Recognition [24.267703297385413]
  This paper presents a new deep periocular recognition framework called attribute-based deep periocular recognition (ADPR) ADPR predicts soft biometrics and incorporates the prediction into a periocular recognition algorithm to determine identity from periocular images with high accuracy. Experimental results indicate that our soft biometric based periocular recognition approach outperforms other state-of-the-art methods for periocular recognition in wild environments.
  arXiv  Detail & Related papers  (2021-11-02T01:51:37Z)
• Biometric Quality: Review and Application to Face Recognition with FaceQnet [16.791628175513637]
  Quality is the number one factor responsible for the good or bad performance of automated biometric systems. Some of the most used and deployed biometric characteristics are lacking behind in the development of these methods. FaceQnet is a novel open-source face quality assessment tool, inspired and powered by deep learning technology.
  arXiv  Detail & Related papers  (2020-06-05T08:33:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.