Attribute-Based Deep Periocular Recognition: Leveraging Soft Biometrics
to Improve Periocular Recognition
- URL: http://arxiv.org/abs/2111.01325v1
- Date: Tue, 2 Nov 2021 01:51:37 GMT
- Title: Attribute-Based Deep Periocular Recognition: Leveraging Soft Biometrics
to Improve Periocular Recognition
- Authors: Veeru Talreja and Nasser M. Nasrabadi and Matthew C. Valenti
- Abstract summary: This paper presents a new deep periocular recognition framework called attribute-based deep periocular recognition (ADPR)
ADPR predicts soft biometrics and incorporates the prediction into a periocular recognition algorithm to determine identity from periocular images with high accuracy.
Experimental results indicate that our soft biometric based periocular recognition approach outperforms other state-of-the-art methods for periocular recognition in wild environments.
- Score: 24.267703297385413
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In recent years, periocular recognition has been developed as a valuable
biometric identification approach, especially in wild environments (for
example, masked faces due to COVID-19 pandemic) where facial recognition may
not be applicable. This paper presents a new deep periocular recognition
framework called attribute-based deep periocular recognition (ADPR), which
predicts soft biometrics and incorporates the prediction into a periocular
recognition algorithm to determine identity from periocular images with high
accuracy. We propose an end-to-end framework, which uses several shared
convolutional neural network (CNN)layers (a common network) whose output feeds
two separate dedicated branches (modality dedicated layers); the first branch
classifies periocular images while the second branch predicts softn biometrics.
Next, the features from these two branches are fused together for a final
periocular recognition. The proposed method is different from existing methods
as it not only uses a shared CNN feature space to train these two tasks
jointly, but it also fuses predicted soft biometric features with the
periocular features in the training step to improve the overall periocular
recognition performance. Our proposed model is extensively evaluated using four
different publicly available datasets. Experimental results indicate that our
soft biometric based periocular recognition approach outperforms other
state-of-the-art methods for periocular recognition in wild environments.
Related papers
- Fusion of Minutia Cylinder Codes and Minutia Patch Embeddings for Latent Fingerprint Recognition [1.534667887016089]
We propose a fusion based local matching approach towards latent fingerprint recognition.
Proposed approach would integrate these handcrafted features with a recently proposed deep neural network embedding features in a multi-stage fusion approach.
arXiv Detail & Related papers (2024-03-24T14:29:41Z) - COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
Face forgery recognition methods can only process one face at a time.
Most face forgery recognition methods can only process one face at a time.
We propose COMICS, an end-to-end framework for multi-face forgery detection.
arXiv Detail & Related papers (2023-08-03T03:37:13Z) - Periocular biometrics: databases, algorithms and directions [69.35569554213679]
Periocular biometrics has been established as an independent modality due to concerns on the performance of iris or face systems in uncontrolled conditions.
This paper presents a review of the state of the art in periocular biometric research.
arXiv Detail & Related papers (2023-07-26T11:14:36Z) - Multimodal Adaptive Fusion of Face and Gait Features using Keyless
attention based Deep Neural Networks for Human Identification [67.64124512185087]
Soft biometrics such as gait are widely used with face in surveillance tasks like person recognition and re-identification.
We propose a novel adaptive multi-biometric fusion strategy for the dynamic incorporation of gait and face biometric cues by leveraging keyless attention deep neural networks.
arXiv Detail & Related papers (2023-03-24T05:28:35Z) - Periocular Biometrics: A Modality for Unconstrained Scenarios [66.93179447621188]
Periocular biometrics includes the externally visible region of the face that surrounds the eye socket.
The COVID-19 pandemic has highlighted its importance, as the ocular region remained the only visible facial area even in controlled settings.
arXiv Detail & Related papers (2022-12-28T12:08:27Z) - Facial Soft Biometrics for Recognition in the Wild: Recent Works,
Annotation, and COTS Evaluation [63.05890836038913]
We study the role of soft biometrics to enhance person recognition systems in unconstrained scenarios.
We consider two assumptions: 1) manual estimation of soft biometrics and 2) automatic estimation from two commercial off-the-shelf systems.
Experiments are carried out fusing soft biometrics with two state-of-the-art face recognition systems based on deep learning.
arXiv Detail & Related papers (2022-10-24T11:29:57Z) - Compact multi-scale periocular recognition using SAFE features [63.48764893706088]
We present a new approach for periocular recognition based on the Symmetry Assessment by Feature Expansion (SAFE) descriptor.
We use the sclera center as single key point for feature extraction, highlighting the object-like identity properties that concentrates to this point unique of the eye.
arXiv Detail & Related papers (2022-10-18T11:46:38Z) - Periocular Embedding Learning with Consistent Knowledge Distillation
from Face [19.938772729998142]
Periocular biometric, the peripheral area of the ocular, is a collaborative alternative to the face.
We propose Knowledge Distillation (CKD) that imposes consistency between face and periocular networks across prediction and feature layers.
CKD achieves state-of-the-art results on standard periocular recognition benchmark datasets.
arXiv Detail & Related papers (2020-12-12T07:12:21Z) - View-Invariant Gait Recognition with Attentive Recurrent Learning of
Partial Representations [27.33579145744285]
We propose a network that first learns to extract gait convolutional energy maps (GCEM) from frame-level convolutional features.
It then adopts a bidirectional neural network to learn from split bins of the GCEM, thus exploiting the relations between learned partial recurrent representations.
Our proposed model has been extensively tested on two large-scale CASIA-B and OU-M gait datasets.
arXiv Detail & Related papers (2020-10-18T20:20:43Z) - SIP-SegNet: A Deep Convolutional Encoder-Decoder Network for Joint
Semantic Segmentation and Extraction of Sclera, Iris and Pupil based on
Periocular Region Suppression [8.64118000141143]
multimodal biometric recognition systems have the ability to deal with the limitations of unimodal biometric systems.
Such systems possess high distinctiveness, permanence, and performance while, technologies based on other biometric traits can be easily compromised.
This work presents a novel deep learning framework called SIP-SegNet, which performs the joint semantic segmentation of ocular traits.
arXiv Detail & Related papers (2020-02-15T15:20:44Z) - Unconstrained Periocular Recognition: Using Generative Deep Learning
Frameworks for Attribute Normalization [2.5288257442251107]
We propose an attribute normalization strategy based on deep learning generative frameworks.
It reduces the variability of the samples used in pairwise comparisons, without reducing their discriminability.
Our experiments were performed in two different datasets.
arXiv Detail & Related papers (2020-02-10T17:55:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.