Synthesis-Guided Feature Learning for Cross-Spectral Periocular Recognition

• URL: http://arxiv.org/abs/2111.08738v1
• Date: Tue, 16 Nov 2021 19:22:20 GMT
• Title: Synthesis-Guided Feature Learning for Cross-Spectral Periocular Recognition
• Authors: Domenick Poster and Nasser Nasrabadi
• Abstract summary: We propose a novel approach to cross-spectral periocular verification. It primarily focuses on learning a mapping from visible and NIR periocular images to a shared latent representational subspace. We show the auxiliary image reconstruction task results in learning a more discriminative, domain-invariant subspace.
• Score: 1.52292571922932
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A common yet challenging scenario in periocular biometrics is cross-spectral matching - in particular, the matching of visible wavelength against near-infrared (NIR) periocular images. We propose a novel approach to cross-spectral periocular verification that primarily focuses on learning a mapping from visible and NIR periocular images to a shared latent representational subspace, and supports this effort by simultaneously learning intra-spectral image reconstruction. We show the auxiliary image reconstruction task (and in particular the reconstruction of high-level, semantic features) results in learning a more discriminative, domain-invariant subspace compared to the baseline while incurring no additional computational or memory costs at test-time. The proposed Coupled Conditional Generative Adversarial Network (CoGAN) architecture uses paired generator networks (one operating on visible images and the other on NIR) composed of U-Nets with ResNet-18 encoders trained for feature learning via contrastive loss and for intra-spectral image reconstruction with adversarial, pixel-based, and perceptual reconstruction losses. Moreover, the proposed CoGAN model beats the current state-of-art (SotA) in cross-spectral periocular recognition. On the Hong Kong PolyU benchmark dataset, we achieve 98.65% AUC and 5.14% EER compared to the SotA EER of 8.02%. On the Cross-Eyed dataset, we achieve 99.31% AUC and 3.99% EER versus SotA EER of 4.39%.

Related papers

• Attention Incorporated Network for Sharing Low-rank, Image and K-space Information during MR Image Reconstruction to Achieve Single Breath-hold Cardiac Cine Imaging [9.531827741901662]
  We propose to embed information from multiple domains, including low-rank, image, and k-space, in a novel deep learning network for MRI reconstruction. A-LIKNet adopts a parallel-branch structure, enabling independent learning in the k-space and image domain.
  arXiv  Detail & Related papers  (2024-07-03T11:54:43Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• An Interactively Reinforced Paradigm for Joint Infrared-Visible Image Fusion and Saliency Object Detection [59.02821429555375]
  This research focuses on the discovery and localization of hidden objects in the wild and serves unmanned systems. Through empirical analysis, infrared and visible image fusion (IVIF) enables hard-to-find objects apparent. multimodal salient object detection (SOD) accurately delineates the precise spatial location of objects within the picture.
  arXiv  Detail & Related papers  (2023-05-17T06:48:35Z)
• A Novel end-to-end Framework for Occluded Pixel Reconstruction with Spatio-temporal Features for Improved Person Re-identification [0.842885453087587]
  Person re-identification is vital for monitoring and tracking crowd movement to enhance public security. In this work, we propose a plausible solution by developing effective occlusion detection and reconstruction framework for RGB images/videos consisting of Deep Neural Networks. Specifically, a CNN-based occlusion detection model classifies individual input frames, followed by a Conv-LSTM and Autoencoder to reconstruct the occluded pixels corresponding to the occluded frames for sequential (video) and non-sequential (image) data.
  arXiv  Detail & Related papers  (2023-04-16T08:14:29Z)
• Exploring Invariant Representation for Visible-Infrared Person Re-Identification [77.06940947765406]
  Cross-spectral person re-identification, which aims to associate identities to pedestrians across different spectra, faces a main challenge of the modality discrepancy. In this paper, we address the problem from both image-level and feature-level in an end-to-end hybrid learning framework named robust feature mining network (RFM) Experiment results on two standard cross-spectral person re-identification datasets, RegDB and SYSU-MM01, have demonstrated state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-02-02T05:24:50Z)
• Multi-Modal MRI Reconstruction with Spatial Alignment Network [51.74078260367654]
  In clinical practice, magnetic resonance imaging (MRI) with multiple contrasts is usually acquired in a single study. Recent researches demonstrate that, considering the redundancy between different contrasts or modalities, a target MRI modality under-sampled in the k-space can be better reconstructed with the helps from a fully-sampled sequence. In this paper, we integrate the spatial alignment network with reconstruction, to improve the quality of the reconstructed target modality.
  arXiv  Detail & Related papers  (2021-08-12T08:46:35Z)
• Deep GAN-Based Cross-Spectral Cross-Resolution Iris Recognition [15.425678759101203]
  Cross-spectral iris recognition has emerged as a promising biometric approach to establish the identity of individuals. matching iris images acquired at different spectral bands (i.e., matching a visible (VIS) iris probe to a gallery of near-infrared (NIR) iris images or vice versa) shows a significant performance degradation. We have investigated a range of deep convolutional generative adversarial network (DCGAN) architectures to further improve the accuracy of cross-spectral iris recognition methods.
  arXiv  Detail & Related papers  (2021-08-03T15:30:04Z)
• Cross-Spectral Iris Matching Using Conditional Coupled GAN [22.615156512223766]
  Cross-spectral iris recognition is emerging as a promising biometric approach to authenticating the identity of individuals. matching iris images acquired at different spectral bands shows significant performance degradation when compared to single-band near-infrared (NIR) matching. We propose a conditional coupled generative adversarial network (CpGAN) architecture for cross-spectral iris recognition.
  arXiv  Detail & Related papers  (2020-10-09T19:13:24Z)
• Cross-Spectral Periocular Recognition with Conditional Adversarial Networks [59.17685450892182]
  We propose Conditional Generative Adversarial Networks, trained to con-vert periocular images between visible and near-infrared spectra. We obtain a cross-spectral periocular performance of EER=1%, and GAR>99% @ FAR=1%, which is comparable to the state-of-the-art with the PolyU database.
  arXiv  Detail & Related papers  (2020-08-26T15:02:04Z)
• Spectrum Translation for Cross-Spectral Ocular Matching [59.17685450892182]
  Cross-spectral verification remains a big issue in biometrics, especially for the ocular area. We investigate the use of Conditional Adversarial Networks for spectrum translation between near infra-red and visual light images for ocular biometrics.
  arXiv  Detail & Related papers  (2020-02-14T19:30:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.