Selfie Periocular Verification using an Efficient Super-Resolution
Approach
- URL: http://arxiv.org/abs/2102.08449v1
- Date: Tue, 16 Feb 2021 21:01:12 GMT
- Title: Selfie Periocular Verification using an Efficient Super-Resolution
Approach
- Authors: Juan Tapia, Marta Gomez-Barrero, Rodrigo Lara, Andres Valenzuela,
Christoph Busch
- Abstract summary: Super-resolution has to be used to increase the quality of the captured images.
Most of the state of the art super-resolution methods use deep networks with large filters.
We propose an Efficient Single Image Super-Resolution (ESISR) algorithm, which takes into account a trade-off between the efficiency of the deep neural network and the size of its filters.
- Score: 11.352465961204775
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Selfie-based biometrics has great potential for a wide range of applications
from marketing to higher security environments like online banking. This is now
especially relevant since e.g. periocular verification is contactless, and
thereby safe to use in pandemics such as COVID-19. However, selfie-based
biometrics faces some challenges since there is limited control over the data
acquisition conditions. Therefore, super-resolution has to be used to increase
the quality of the captured images. Most of the state of the art
super-resolution methods use deep networks with large filters, thereby needing
to train and store a correspondingly large number of parameters, and making
their use difficult for mobile devices commonly used for selfie-based.
In order to achieve an efficient super-resolution method, we propose an
Efficient Single Image Super-Resolution (ESISR) algorithm, which takes into
account a trade-off between the efficiency of the deep neural network and the
size of its filters. To that end, the method implements a novel loss function
based on the Sharpness metric. This metric turns out to be more suitable for
increasing the quality of the eye images. Our method drastically reduces the
number of parameters when compared with Deep CNNs with Skip Connection and
Network (DCSCN): from 2,170,142 to 28,654 parameters when the image size is
increased by a factor of x3. Furthermore, the proposed method keeps the sharp
quality of the images, which is highly relevant for biometric recognition
purposes. The results on remote verification systems with raw images reached an
Equal Error Rate (EER) of 8.7% for FaceNet and 10.05% for VGGFace. Where
embedding vectors were used from periocular images the best results reached an
EER of 8.9% (x3) for FaceNet and 9.90% (x4) for VGGFace.
Related papers
- Log-Likelihood Score Level Fusion for Improved Cross-Sensor Smartphone
Periocular Recognition [52.15994166413364]
We employ fusion of several comparators to improve periocular performance when images from different smartphones are compared.
We use a probabilistic fusion framework based on linear logistic regression, in which fused scores tend to be log-likelihood ratios.
Our framework also provides an elegant and simple solution to handle signals from different devices, since same-sensor and cross-sensor score distributions are aligned and mapped to a common probabilistic domain.
arXiv Detail & Related papers (2023-11-02T13:43:44Z) - SqueezerFaceNet: Reducing a Small Face Recognition CNN Even More Via
Filter Pruning [55.84746218227712]
We develop SqueezerFaceNet, a light face recognition network which less than 1M parameters.
We show that it can be further reduced (up to 40%) without an appreciable loss in performance.
arXiv Detail & Related papers (2023-07-20T08:38:50Z) - Octuplet Loss: Make Face Recognition Robust to Image Resolution [5.257115841810258]
We propose a novel combination of the popular triplet loss to improve robustness against image resolution.
We leverage the relationship between high-resolution images and their synthetically down-sampled variants jointly with their identity labels.
Fine-tuning several state-of-the-art approaches with our method proves that we can significantly boost performance for cross-resolution (high-to-low resolution) face verification.
arXiv Detail & Related papers (2022-07-14T08:22:58Z) - Super-Resolution for Selfie Biometrics: Introduction and Application to
Face and Iris [67.74999528342273]
Lack of resolution has a negative impact on the performance of image-based biometrics.
Super-resolution techniques have to be adapted for the particularities of images from a specific biometric modality.
This chapter presents an overview of recent advances in super-resolution reconstruction of face and iris images.
arXiv Detail & Related papers (2022-04-12T10:28:31Z) - On the Effect of Selfie Beautification Filters on Face Detection and
Recognition [53.561797148529664]
Social media image filters modify the image contrast or illumination or occlude parts of the face with for example artificial glasses or animal noses.
We develop a method to reconstruct the applied manipulation with a modified version of the U-NET segmentation network.
From a recognition perspective, we employ distance measures and trained machine learning algorithms applied to features extracted using a ResNet-34 network trained to recognize faces.
arXiv Detail & Related papers (2021-10-17T22:10:56Z) - Asymmetric CNN for image super-resolution [102.96131810686231]
Deep convolutional neural networks (CNNs) have been widely applied for low-level vision over the past five years.
We propose an asymmetric CNN (ACNet) comprising an asymmetric block (AB), a mem?ory enhancement block (MEB) and a high-frequency feature enhancement block (HFFEB) for image super-resolution.
Our ACNet can effectively address single image super-resolution (SISR), blind SISR and blind SISR of blind noise problems.
arXiv Detail & Related papers (2021-03-25T07:10:46Z) - Enhancing sensor resolution improves CNN accuracy given the same number
of parameters or FLOPS [53.10151901863263]
We show that it is almost always possible to modify a network such that it achieves higher accuracy at a higher input resolution while having the same number of parameters or/and FLOPS.
Preliminary empirical investigation over MNIST, Fashion MNIST, and CIFAR10 datasets demonstrates the efficiency of the proposed approach.
arXiv Detail & Related papers (2021-03-09T06:47:01Z) - Adaptive Pixel-wise Structured Sparse Network for Efficient CNNs [11.377052459168942]
This paper proposes a novel spatially adaptive framework that can generate pixel-wise sparsity according to the input image.
A sparse controlling method is presented to enable online adjustment for applications with different precision/latency requirements.
arXiv Detail & Related papers (2020-10-21T15:47:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.