RPG-Palm: Realistic Pseudo-data Generation for Palmprint Recognition
- URL: http://arxiv.org/abs/2307.14016v3
- Date: Tue, 8 Aug 2023 07:57:15 GMT
- Title: RPG-Palm: Realistic Pseudo-data Generation for Palmprint Recognition
- Authors: Lei Shen, Jianlong Jin, Ruixin Zhang, Huaen Li, Kai Zhao, Yingyi
Zhang, Jingyun Zhang, Shouhong Ding, Yang Zhao, Wei Jia
- Abstract summary: We propose a novel realistic pseudo-palmprint generation model to synthesize palmprints with massive identities.
Our model improves the state-of-the-art B'ezierPalm by more than $5%$ and $14%$ in terms of TAR@FAR=1e-6 under the $1:1$ and $1:3$ Open-set protocol.
Our method still outperforms ArcFace with $100%$ real training data, indicating that we are closer to real-data-free palmprint recognition.
- Score: 26.82617300073746
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Palmprint recently shows great potential in recognition applications as it is
a privacy-friendly and stable biometric. However, the lack of large-scale
public palmprint datasets limits further research and development of palmprint
recognition. In this paper, we propose a novel realistic pseudo-palmprint
generation (RPG) model to synthesize palmprints with massive identities. We
first introduce a conditional modulation generator to improve the intra-class
diversity. Then an identity-aware loss is proposed to ensure identity
consistency against unpaired training. We further improve the B\'ezier palm
creases generation strategy to guarantee identity independence. Extensive
experimental results demonstrate that synthetic pretraining significantly
boosts the recognition model performance. For example, our model improves the
state-of-the-art B\'ezierPalm by more than $5\%$ and $14\%$ in terms of
TAR@FAR=1e-6 under the $1:1$ and $1:3$ Open-set protocol. When accessing only
$10\%$ of the real training data, our method still outperforms ArcFace with
$100\%$ real training data, indicating that we are closer to real-data-free
palmprint recognition.
Related papers
- Diff-Palm: Realistic Palmprint Generation with Polynomial Creases and Intra-Class Variation Controllable Diffusion Models [31.760874666742282]
Palm recognition is significantly limited by the lack of large-scale publicly available datasets.
Previous methods have adopted B'ezier curves to simulate the palm creases, which then serve as input for conditional GANs to generate realistic palmprints.
We introduce a new identity-based palm crease representation that provides a new palm crease generation mechanism more closely aligned with the real distribution.
arXiv Detail & Related papers (2025-03-24T03:30:58Z) - PVTree: Realistic and Controllable Palm Vein Generation for Recognition Tasks [32.3316737065653]
Palm vein recognition is an emerging biometric technology that offers enhanced security and privacy.
Existing methods, however, often produce unrealistic palm vein patterns or struggle with controlling identity and style attributes.
We propose a novel palm vein generation framework named PVTree to address these issues.
Our proposed palm vein generation method surpasses existing methods and achieves a higher TAR@FAR=1e-4 under the 1:1 Open-set protocol.
arXiv Detail & Related papers (2025-03-04T12:15:33Z) - Sample Correlation for Fingerprinting Deep Face Recognition [83.53005932513156]
We propose a novel model stealing detection method based on SA Corremplelation (SAC)
SAC successfully defends against various model stealing attacks in deep face recognition, encompassing face verification and face emotion recognition, exhibiting the highest performance in terms of AUC, p-value and F1 score.
We extend our evaluation of SAC-JC to object recognition including Tiny-ImageNet and CIFAR10, which also demonstrates the superior performance of SAC-JC to previous methods.
arXiv Detail & Related papers (2024-12-30T07:37:06Z) - GenPalm: Contactless Palmprint Generation with Diffusion Models [25.738682467090335]
This paper introduces a novel palmprint generation method using diffusion probabilistic models.
We develop an end-to-end framework for synthesizing multiple palm identities and validate the realism and utility of the generated palmprints.
arXiv Detail & Related papers (2024-06-01T03:33:25Z) - Mobile Contactless Palmprint Recognition: Use of Multiscale, Multimodel
Embeddings [26.774583290826193]
This study integrates a vision transformer (ViT) and a convolutional neural network (CNN) to extract complementary local and global features.
Next, a mobile-based, end-to-end palmprint recognition system is developed, referred to as Palm-ID.
Palm-ID balances the trade-off between accuracy and latency, requiring just 18ms to extract a template of size 516 bytes.
arXiv Detail & Related papers (2024-01-16T04:42:54Z) - Segue: Side-information Guided Generative Unlearnable Examples for
Facial Privacy Protection in Real World [64.4289385463226]
We propose Segue: Side-information guided generative unlearnable examples.
To improve transferability, we introduce side information such as true labels and pseudo labels.
It can resist JPEG compression, adversarial training, and some standard data augmentations.
arXiv Detail & Related papers (2023-10-24T06:22:37Z) - Physics-Driven Spectrum-Consistent Federated Learning for Palmprint
Verification [47.35171881187345]
We propose a physics-driven spectrum-consistent federated learning method for palmprint verification, dubbed as PSFed-Palm.
Our approach first partitions clients into short- and long-spectrum groups according to the wavelength range of their local spectrum images.
We impose constraints on the local models to ensure their consistency with the global model, effectively preventing model drift.
arXiv Detail & Related papers (2023-08-01T11:01:17Z) - Accelerated Fingerprint Enhancement: A GPU-Optimized Mixed Architecture
Approach [47.87570819350573]
This document presents a preliminary approach to latent fingerprint enhancement, fundamentally designed around a mixed Unet architecture.
It combines the capabilities of the Resnet-101 network and Unet encoder, aiming to form a potentially powerful composite.
One innovative element of this approach includes a novel Fingerprint Enhancement Gabor layer, specifically designed for GPU computations.
arXiv Detail & Related papers (2023-06-01T01:19:32Z) - Geometric Synthesis: A Free lunch for Large-scale Palmprint Recognition
Model Pretraining [27.81138870690135]
We introduce an intuitive geometric model which represents palmar creases with parameterized B'ezier curves.
By randomly sampling B'ezier parameters, we can synthesize massive training samples of diverse identities.
Experimental results demonstrate that such synthetically pretrained models have a very strong generalization ability.
arXiv Detail & Related papers (2022-03-11T01:20:22Z) - Touchless Palmprint Recognition based on 3D Gabor Template and Block
Feature Refinement [28.991303988737503]
We build a large-scale touchless palmprint dataset containing 2334 palms from 1167 individuals.
To our best knowledge, it is the largest contactless palmprint image benchmark ever collected.
We propose a novel deep learning framework for touchless palmprint recognition named 3DCPN.
arXiv Detail & Related papers (2021-03-03T04:22:24Z) - Responsible Disclosure of Generative Models Using Scalable
Fingerprinting [70.81987741132451]
Deep generative models have achieved a qualitatively new level of performance.
There are concerns on how this technology can be misused to spoof sensors, generate deep fakes, and enable misinformation at scale.
Our work enables a responsible disclosure of such state-of-the-art generative models, that allows researchers and companies to fingerprint their models.
arXiv Detail & Related papers (2020-12-16T03:51:54Z) - Artificial Fingerprinting for Generative Models: Rooting Deepfake
Attribution in Training Data [64.65952078807086]
Photorealistic image generation has reached a new level of quality due to the breakthroughs of generative adversarial networks (GANs)
Yet, the dark side of such deepfakes, the malicious use of generated media, raises concerns about visual misinformation.
We seek a proactive and sustainable solution on deepfake detection by introducing artificial fingerprints into the models.
arXiv Detail & Related papers (2020-07-16T16:49:55Z) - Towards Palmprint Verification On Smartphones [62.279124220123286]
Studies in the past two decades have shown that palmprints have outstanding merits in uniqueness and permanence.
We built a DCNN-based palmprint verification system named DeepMPV+ for smartphones.
The efficiency and efficacy of DeepMPV+ have been corroborated by extensive experiments.
arXiv Detail & Related papers (2020-03-30T08:31:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.