Rethinking the Domain Gap in Near-infrared Face Recognition

• URL: http://arxiv.org/abs/2312.00627v1
• Date: Fri, 1 Dec 2023 14:43:28 GMT
• Title: Rethinking the Domain Gap in Near-infrared Face Recognition
• Authors: Michail Tarasiou, Jiankang Deng, Stefanos Zafeiriou
• Abstract summary: Heterogeneous face recognition (HFR) involves the intricate task of matching face images across the visual domains of visible (VIS) and near-infrared (NIR) Much of the existing literature on HFR identifies the domain gap as a primary challenge and directs efforts towards bridging it at either the input or feature level. We observe that large neural networks, unlike their smaller counterparts, when pre-trained on large scale homogeneous VIS data, demonstrate exceptional zero-shot performance in HFR.
• Score: 65.7871950460781
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Heterogeneous face recognition (HFR) involves the intricate task of matching face images across the visual domains of visible (VIS) and near-infrared (NIR). While much of the existing literature on HFR identifies the domain gap as a primary challenge and directs efforts towards bridging it at either the input or feature level, our work deviates from this trend. We observe that large neural networks, unlike their smaller counterparts, when pre-trained on large scale homogeneous VIS data, demonstrate exceptional zero-shot performance in HFR, suggesting that the domain gap might be less pronounced than previously believed. By approaching the HFR problem as one of low-data fine-tuning, we introduce a straightforward framework: comprehensive pre-training, succeeded by a regularized fine-tuning strategy, that matches or surpasses the current state-of-the-art on four publicly available benchmarks. Corresponding codes can be found at https://github.com/michaeltrs/RethinkNIRVIS.

Related papers

• Heterogeneous Face Recognition Using Domain Invariant Units [4.910937238451485]
  We leverage a pretrained face recognition model as a teacher network to learn domaininvariant network layers called Domain-Invariant Units (DIU) The proposed DIU can be trained effectively even with a limited amount of paired training data, in a contrastive distillation framework. This proposed approach has the potential to enhance pretrained models, making them more adaptable to a wider range of variations in data.
  arXiv  Detail & Related papers  (2024-04-22T16:58:37Z)
• Adaptive Face Recognition Using Adversarial Information Network [57.29464116557734]
  Face recognition models often degenerate when training data are different from testing data. We propose a novel adversarial information network (AIN) to address it.
  arXiv  Detail & Related papers  (2023-05-23T02:14:11Z)
• Hierarchical Forgery Classifier On Multi-modality Face Forgery Clues [61.37306431455152]
  We propose a novel Hierarchical Forgery for Multi-modality Face Forgery Detection (HFC-MFFD) The HFC-MFFD learns robust patches-based hybrid representation to enhance forgery authentication in multiple-modality scenarios. The specific hierarchical face forgery is proposed to alleviate the class imbalance problem and further boost detection performance.
  arXiv  Detail & Related papers  (2022-12-30T10:54:29Z)
• Prepended Domain Transformer: Heterogeneous Face Recognition without Bells and Whistles [9.419177623349947]
  We propose a surprisingly simple, yet, very effective method for matching face images across different sensing modalities. The proposed approach is architecture agnostic, meaning they can be added to any pre-trained models. The source code and protocols will be made available publicly.
  arXiv  Detail & Related papers  (2022-10-12T18:54:57Z)
• Joint Feature Distribution Alignment Learning for NIR-VIS and VIS-VIS Face Recognition [5.249805590164902]
  heterogeneous face recognition (HFR) is still a difficult task due to the domain discrepancy and lack of large HFR dataset. We propose joint feature distribution alignment learning (JFDAL) which is a joint learning approach utilizing knowledge distillation. Our method achieves a comparable HFR performance on the Oulu-CASIA NIR&VIS dataset with less degradation of VIS performance.
  arXiv  Detail & Related papers  (2022-04-25T04:47:35Z)
• Escaping Data Scarcity for High-Resolution Heterogeneous Face Hallucination [68.78903256687697]
  In Heterogeneous Face Recognition (HFR), the objective is to match faces across two different domains such as visible and thermal. Recent methods attempting to fill the gap via synthesis have achieved promising results, but their performance is still limited by the scarcity of paired training data. In this paper, we propose a new face hallucination paradigm for HFR, which not only enables data-efficient synthesis but also allows to scale up model training without breaking any privacy policy.
  arXiv  Detail & Related papers  (2022-03-30T20:44:33Z)
• Heterogeneous Face Frontalization via Domain Agnostic Learning [74.86585699909459]
  We propose a domain agnostic learning-based generative adversarial network (DAL-GAN) which can synthesize frontal views in the visible domain from thermal faces with pose variations. DAL-GAN consists of a generator with an auxiliary classifier and two discriminators which capture both local and global texture discriminations for better synthesis.
  arXiv  Detail & Related papers  (2021-07-17T20:41:41Z)
• Inter-class Discrepancy Alignment for Face Recognition [55.578063356210144]
  We propose a unified framework calledInter-class DiscrepancyAlignment(IDA) IDA-DAO is used to align the similarity scores considering the discrepancy between the images and its neighbors. IDA-SSE can provide convincing inter-class neighbors by introducing virtual candidate images generated with GAN.
  arXiv  Detail & Related papers  (2021-03-02T08:20:08Z)
• Relational Deep Feature Learning for Heterogeneous Face Recognition [17.494718795454055]
  We propose a graph-structured module called Graph Module (NIR) that extracts global relational information in addition to general facial features. The proposed method outperforms other state-of-the-art methods on five Heterogeneous Face Recognition (HFR) databases.
  arXiv  Detail & Related papers  (2020-03-02T07:35:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.