Motion Transfer-Driven intra-class data augmentation for Finger Vein Recognition

• URL: http://arxiv.org/abs/2412.20327v1
• Date: Sun, 29 Dec 2024 02:51:57 GMT
• Title: Motion Transfer-Driven intra-class data augmentation for Finger Vein Recognition
• Authors: Xiu-Feng Huang, Lai-Man Po, Wei-Feng Ou,
• Abstract summary: Finger vein recognition (FVR) has emerged as a secure biometric technique because of the confidentiality of vascular bio-information.<n>We propose a novel motion transfer model for finger vein image data augmentation via modeling the actual finger posture and rotational movements.<n> Experiments conducted on three public finger vein databases demonstrate that the proposed motion transfer model can effectively improve recognition accuracy.
• Score: 14.95018662462898
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Finger vein recognition (FVR) has emerged as a secure biometric technique because of the confidentiality of vascular bio-information. Recently, deep learning-based FVR has gained increased popularity and achieved promising performance. However, the limited size of public vein datasets has caused overfitting issues and greatly limits the recognition performance. Although traditional data augmentation can partially alleviate this data shortage issue, it cannot capture the real finger posture variations due to the rigid label-preserving image transformations, bringing limited performance improvement. To address this issue, we propose a novel motion transfer (MT) model for finger vein image data augmentation via modeling the actual finger posture and rotational movements. The proposed model first utilizes a key point detector to extract the key point and pose map of the source and drive finger vein images. We then utilize a dense motion module to estimate the motion optical flow, which is fed to an image generation module for generating the image with the target pose. Experiments conducted on three public finger vein databases demonstrate that the proposed motion transfer model can effectively improve recognition accuracy. Code is available at: https://github.com/kevinhuangxf/FingerVeinRecognition.

Related papers

• GIFDL: Generated Image Fluctuation Distortion Learning for Enhancing Steganographic Security [59.863152942470784]
  We propose GIFDL, a steganographic distortion learning method based on the fluctuations in generated images. GIFDL exhibits superior resistance to steganalysis, increasing the detection error rates by an average of 3.30% across three steganalyzers.
  arXiv  Detail & Related papers  (2025-04-21T14:43:00Z)
• Performance Evaluation of Image Enhancement Techniques on Transfer Learning for Touchless Fingerprint Recognition [0.6291443816903801]
  This study evaluates the impact of image enhancement tech-niques on the performance of pre-trained deep learning models. VGG-16 achieved an accuracy of 98% in training and 93% in testing when using the enhanced images.
  arXiv  Detail & Related papers  (2025-02-07T06:00:53Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models.<n>In this paper, we investigate how detection performance varies across model backbones, types, and datasets.<n>We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patches [12.221087476416056]
  We introduce "motion patches", a new representation of motion sequences, and propose using Vision Transformers (ViT) as motion encoders via transfer learning. These motion patches, created by dividing and sorting skeleton joints based on motion sequences, are robust to varying skeleton structures. We find that transfer learning with pre-trained weights of ViT obtained through training with 2D image data can boost the performance of motion analysis.
  arXiv  Detail & Related papers  (2024-05-08T02:42:27Z)
• Don't Judge by the Look: Towards Motion Coherent Video Representation [56.09346222721583]
  Motion Coherent Augmentation (MCA) is a data augmentation method for video understanding. MCA introduces appearance variation in videos and implicitly encourages the model to prioritize motion patterns, rather than static appearances.
  arXiv  Detail & Related papers  (2024-03-14T15:53:04Z)
• Finger-UNet: A U-Net based Multi-Task Architecture for Deep Fingerprint Enhancement [0.0]
  fingerprint enhancement plays a vital role in the early stages of the fingerprint recognition/verification pipeline. We suggest intuitive modifications to U-Net to enhance low-quality fingerprints effectively. We replace regular convolutions with depthwise separable convolutions, which significantly reduces the memory footprint of the model.
  arXiv  Detail & Related papers  (2023-10-01T09:49:10Z)
• Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurement [25.27559386977351]
  Body motion is one of the most significant sources of noise when attempting to recover the subtle cardiac pulse from a video. We adapt a neural video synthesis approach to augment videos for the task of remote photoplethys. We demonstrate a 47% improvement over existing inter-dataset results using various state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-03-21T17:51:23Z)
• Deep Convolutional Pooling Transformer for Deepfake Detection [54.10864860009834]
  We propose a deep convolutional Transformer to incorporate decisive image features both locally and globally. Specifically, we apply convolutional pooling and re-attention to enrich the extracted features and enhance efficacy. The proposed solution consistently outperforms several state-of-the-art baselines on both within- and cross-dataset experiments.
  arXiv  Detail & Related papers  (2022-09-12T15:05:41Z)
• TransCamP: Graph Transformer for 6-DoF Camera Pose Estimation [77.09542018140823]
  We propose a neural network approach with a graph transformer backbone, namely TransCamP, to address the camera relocalization problem. TransCamP effectively fuses the image features, camera pose information and inter-frame relative camera motions into encoded graph attributes.
  arXiv  Detail & Related papers  (2021-05-28T19:08:43Z)
• From Hand-Perspective Visual Information to Grasp Type Probabilities: Deep Learning via Ranking Labels [6.772076545800592]
  We build a novel probabilistic classifier according to the Plackett-Luce model to predict the probability distribution over grasps. We indicate that the proposed model is applicable to the most popular and productive convolutional neural network frameworks.
  arXiv  Detail & Related papers  (2021-03-08T16:12:38Z)
• HM4: Hidden Markov Model with Memory Management for Visual Place Recognition [54.051025148533554]
  We develop a Hidden Markov Model approach for visual place recognition in autonomous driving. Our algorithm, dubbed HM$4$, exploits temporal look-ahead to transfer promising candidate images between passive storage and active memory. We show that this allows constant time and space inference for a fixed coverage area.
  arXiv  Detail & Related papers  (2020-11-01T08:49:24Z)
• Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition [131.6328804788164]
  We propose a framework, named Semantics-aware Adaptive Knowledge Distillation Networks (SAKDN), to enhance action recognition in vision-sensor modality (videos) The SAKDN uses multiple wearable-sensors as teacher modalities and uses RGB videos as student modality.
  arXiv  Detail & Related papers  (2020-09-01T03:38:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.