Facial Masks and Soft-Biometrics: Leveraging Face Recognition CNNs for Age and Gender Prediction on Mobile Ocular Images

• URL: http://arxiv.org/abs/2103.16760v1
• Date: Wed, 31 Mar 2021 01:48:29 GMT
• Title: Facial Masks and Soft-Biometrics: Leveraging Face Recognition CNNs for Age and Gender Prediction on Mobile Ocular Images
• Authors: Fernando Alonso-Fernandez, Kevin Hernandez Diaz, Silvia Ramis, Francisco J. Perales, Josef Bigun
• Abstract summary: We address the use of selfie ocular images captured with smartphones to estimate age and gender. We adapt two existing lightweight CNNs proposed in the context of the ImageNet Challenge. Some networks are further pre-trained for face recognition, for which very large training databases are available.
• Score: 53.913598771836924
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We address the use of selfie ocular images captured with smartphones to estimate age and gender. Partial face occlusion has become an issue due to the mandatory use of face masks. Also, the use of mobile devices has exploded, with the pandemic further accelerating the migration to digital services. However, state-of-the-art solutions in related tasks such as identity or expression recognition employ large Convolutional Neural Networks, whose use in mobile devices is infeasible due to hardware limitations and size restrictions of downloadable applications. To counteract this, we adapt two existing lightweight CNNs proposed in the context of the ImageNet Challenge, and two additional architectures proposed for mobile face recognition. Since datasets for soft-biometrics prediction using selfie images are limited, we counteract over-fitting by using networks pre-trained on ImageNet. Furthermore, some networks are further pre-trained for face recognition, for which very large training databases are available. Since both tasks employ similar input data, we hypothesize that such strategy can be beneficial for soft-biometrics estimation. A comprehensive study of the effects of different pre-training over the employed architectures is carried out, showing that, in most cases, a better accuracy is obtained after the networks have been fine-tuned for face recognition.

Related papers

• Privacy-preserving Optics for Enhancing Protection in Face De-identification [60.110274007388135]
  We propose a hardware-level face de-identification method to solve this vulnerability. We also propose an anonymization framework that generates a new face using the privacy-preserving image, face heatmap, and a reference face image from a public dataset as input.
  arXiv  Detail & Related papers  (2024-03-31T19:28:04Z)
• SqueezerFaceNet: Reducing a Small Face Recognition CNN Even More Via Filter Pruning [55.84746218227712]
  We develop SqueezerFaceNet, a light face recognition network which less than 1M parameters. We show that it can be further reduced (up to 40%) without an appreciable loss in performance.
  arXiv  Detail & Related papers  (2023-07-20T08:38:50Z)
• FACE-AUDITOR: Data Auditing in Facial Recognition Systems [24.082527732931677]
  Few-shot-based facial recognition systems have gained increasing attention due to their scalability and ability to work with a few face images. To prevent the face images from being misused, one straightforward approach is to modify the raw face images before sharing them. We propose a complete toolkit FACE-AUDITOR that can query the few-shot-based facial recognition model and determine whether any of a user's face images is used in training the model.
  arXiv  Detail & Related papers  (2023-04-05T23:03:54Z)
• Towards Privacy-Preserving Affect Recognition: A Two-Level Deep Learning Architecture [2.9392867898439006]
  We propose a two-level deep learning architecture for affect recognition. The architecture consists of recurrent neural networks to capture the temporal relationships amongst the features.
  arXiv  Detail & Related papers  (2021-11-14T13:52:57Z)
• Masked Face Recognition for Secure Authentication [2.429066522170765]
  Masked faces make it difficult to be detected and recognized, thereby threatening to make the in-house datasets invalid. We present an open-source tool, MaskTheFace to mask faces effectively creating a large dataset of masked faces. We report an increase of 38% in the true positive rate for the Facenet system.
  arXiv  Detail & Related papers  (2020-08-25T15:33:59Z)
• SqueezeFacePoseNet: Lightweight Face Verification Across Different Poses for Mobile Platforms [55.84746218227712]
  Face verification technologies can provide reliable and robust user authentication, given the availability of cameras in mobile devices. Deep Convolutional Neural Networks have resulted in many accurate face verification architectures, but their typical size (hundreds of megabytes) makes them infeasible to be incorporated in downloadable mobile applications. We develop a lightweight face recognition network of just a few megabytes that can operate with sufficient accuracy in comparison to much larger models.
  arXiv  Detail & Related papers  (2020-07-16T19:02:38Z)
• Deep convolutional neural networks for face and iris presentation attack detection: Survey and case study [0.5801044612920815]
  Cross-dataset evaluation on face PAD showed better generalization than state of the art. We propose the use of a single deep network trained to detect both face and iris attacks.
  arXiv  Detail & Related papers  (2020-04-25T02:06:19Z)
• Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
  We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks. TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
  arXiv  Detail & Related papers  (2020-03-15T12:45:10Z)
• Exploiting Semantics for Face Image Deblurring [121.44928934662063]
  We propose an effective and efficient face deblurring algorithm by exploiting semantic cues via deep convolutional neural networks. We incorporate face semantic labels as input priors and propose an adaptive structural loss to regularize facial local structures. The proposed method restores sharp images with more accurate facial features and details.
  arXiv  Detail & Related papers  (2020-01-19T13:06:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.