RPG-Palm: Realistic Pseudo-data Generation for Palmprint Recognition

• URL: http://arxiv.org/abs/2307.14016v3
• Date: Tue, 8 Aug 2023 07:57:15 GMT
• Title: RPG-Palm: Realistic Pseudo-data Generation for Palmprint Recognition
• Authors: Lei Shen, Jianlong Jin, Ruixin Zhang, Huaen Li, Kai Zhao, Yingyi Zhang, Jingyun Zhang, Shouhong Ding, Yang Zhao, Wei Jia
• Abstract summary: We propose a novel realistic pseudo-palmprint generation model to synthesize palmprints with massive identities. Our model improves the state-of-the-art B'ezierPalm by more than $5%$ and $14%$ in terms of TAR@FAR=1e-6 under the $1:1$ and $1:3$ Open-set protocol. Our method still outperforms ArcFace with $100%$ real training data, indicating that we are closer to real-data-free palmprint recognition.
• Score: 26.82617300073746
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Palmprint recently shows great potential in recognition applications as it is a privacy-friendly and stable biometric. However, the lack of large-scale public palmprint datasets limits further research and development of palmprint recognition. In this paper, we propose a novel realistic pseudo-palmprint generation (RPG) model to synthesize palmprints with massive identities. We first introduce a conditional modulation generator to improve the intra-class diversity. Then an identity-aware loss is proposed to ensure identity consistency against unpaired training. We further improve the B\'ezier palm creases generation strategy to guarantee identity independence. Extensive experimental results demonstrate that synthetic pretraining significantly boosts the recognition model performance. For example, our model improves the state-of-the-art B\'ezierPalm by more than $5\%$ and $14\%$ in terms of TAR@FAR=1e-6 under the $1:1$ and $1:3$ Open-set protocol. When accessing only $10\%$ of the real training data, our method still outperforms ArcFace with $100\%$ real training data, indicating that we are closer to real-data-free palmprint recognition.

Related papers

• GenPalm: Contactless Palmprint Generation with Diffusion Models [25.738682467090335]
  This paper introduces a novel palmprint generation method using diffusion probabilistic models. We develop an end-to-end framework for synthesizing multiple palm identities and validate the realism and utility of the generated palmprints.
  arXiv  Detail & Related papers  (2024-06-01T03:33:25Z)
• Mobile Contactless Palmprint Recognition: Use of Multiscale, Multimodel Embeddings [26.774583290826193]
  This study integrates a vision transformer (ViT) and a convolutional neural network (CNN) to extract complementary local and global features. Next, a mobile-based, end-to-end palmprint recognition system is developed, referred to as Palm-ID. Palm-ID balances the trade-off between accuracy and latency, requiring just 18ms to extract a template of size 516 bytes.
  arXiv  Detail & Related papers  (2024-01-16T04:42:54Z)
• Segue: Side-information Guided Generative Unlearnable Examples for Facial Privacy Protection in Real World [64.4289385463226]
  We propose Segue: Side-information guided generative unlearnable examples. To improve transferability, we introduce side information such as true labels and pseudo labels. It can resist JPEG compression, adversarial training, and some standard data augmentations.
  arXiv  Detail & Related papers  (2023-10-24T06:22:37Z)
• Physics-Driven Spectrum-Consistent Federated Learning for Palmprint Verification [47.35171881187345]
  We propose a physics-driven spectrum-consistent federated learning method for palmprint verification, dubbed as PSFed-Palm. Our approach first partitions clients into short- and long-spectrum groups according to the wavelength range of their local spectrum images. We impose constraints on the local models to ensure their consistency with the global model, effectively preventing model drift.
  arXiv  Detail & Related papers  (2023-08-01T11:01:17Z)
• Accelerated Fingerprint Enhancement: A GPU-Optimized Mixed Architecture Approach [47.87570819350573]
  This document presents a preliminary approach to latent fingerprint enhancement, fundamentally designed around a mixed Unet architecture. It combines the capabilities of the Resnet-101 network and Unet encoder, aiming to form a potentially powerful composite. One innovative element of this approach includes a novel Fingerprint Enhancement Gabor layer, specifically designed for GPU computations.
  arXiv  Detail & Related papers  (2023-06-01T01:19:32Z)
• Geometric Synthesis: A Free lunch for Large-scale Palmprint Recognition Model Pretraining [27.81138870690135]
  We introduce an intuitive geometric model which represents palmar creases with parameterized B'ezier curves. By randomly sampling B'ezier parameters, we can synthesize massive training samples of diverse identities. Experimental results demonstrate that such synthetically pretrained models have a very strong generalization ability.
  arXiv  Detail & Related papers  (2022-03-11T01:20:22Z)
• Touchless Palmprint Recognition based on 3D Gabor Template and Block Feature Refinement [28.991303988737503]
  We build a large-scale touchless palmprint dataset containing 2334 palms from 1167 individuals. To our best knowledge, it is the largest contactless palmprint image benchmark ever collected. We propose a novel deep learning framework for touchless palmprint recognition named 3DCPN.
  arXiv  Detail & Related papers  (2021-03-03T04:22:24Z)
• Responsible Disclosure of Generative Models Using Scalable Fingerprinting [70.81987741132451]
  Deep generative models have achieved a qualitatively new level of performance. There are concerns on how this technology can be misused to spoof sensors, generate deep fakes, and enable misinformation at scale. Our work enables a responsible disclosure of such state-of-the-art generative models, that allows researchers and companies to fingerprint their models.
  arXiv  Detail & Related papers  (2020-12-16T03:51:54Z)
• Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data [64.65952078807086]
  Photorealistic image generation has reached a new level of quality due to the breakthroughs of generative adversarial networks (GANs) Yet, the dark side of such deepfakes, the malicious use of generated media, raises concerns about visual misinformation. We seek a proactive and sustainable solution on deepfake detection by introducing artificial fingerprints into the models.
  arXiv  Detail & Related papers  (2020-07-16T16:49:55Z)
• Towards Palmprint Verification On Smartphones [62.279124220123286]
  Studies in the past two decades have shown that palmprints have outstanding merits in uniqueness and permanence. We built a DCNN-based palmprint verification system named DeepMPV+ for smartphones. The efficiency and efficacy of DeepMPV+ have been corroborated by extensive experiments.
  arXiv  Detail & Related papers  (2020-03-30T08:31:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.