Differential Morph Face Detection using Discriminative Wavelet Sub-bands
- URL: http://arxiv.org/abs/2106.13178v1
- Date: Thu, 24 Jun 2021 16:55:34 GMT
- Title: Differential Morph Face Detection using Discriminative Wavelet Sub-bands
- Authors: Baaria Chaudhary, Poorya Aghdaie, Sobhan Soleymani, Jeremy Dawson,
Nasser M. Nasrabadi
- Abstract summary: Face recognition systems are vulnerable to morphing attacks.
We propose a morph attack detection algorithm that leverages an undecimated 2D Discrete Wavelet Transform.
A discriminative wavelet sub-band can accentuate the disparity between a real and a morphed image.
- Score: 18.22557507385582
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Face recognition systems are extremely vulnerable to morphing attacks, in
which a morphed facial reference image can be successfully verified as two or
more distinct identities. In this paper, we propose a morph attack detection
algorithm that leverages an undecimated 2D Discrete Wavelet Transform (DWT) for
identifying morphed face images. The core of our framework is that artifacts
resulting from the morphing process that are not discernible in the image
domain can be more easily identified in the spatial frequency domain. A
discriminative wavelet sub-band can accentuate the disparity between a real and
a morphed image. To this end, multi-level DWT is applied to all images,
yielding 48 mid and high-frequency sub-bands each. The entropy distributions
for each sub-band are calculated separately for both bona fide and morph
images. For some of the sub-bands, there is a marked difference between the
entropy of the sub-band in a bona fide image and the identical sub-band's
entropy in a morphed image. Consequently, we employ Kullback-Liebler Divergence
(KLD) to exploit these differences and isolate the sub-bands that are the most
discriminative. We measure how discriminative a sub-band is by its KLD value
and the 22 sub-bands with the highest KLD values are chosen for network
training. Then, we train a deep Siamese neural network using these 22 selected
sub-bands for differential morph attack detection. We examine the efficacy of
discriminative wavelet sub-bands for morph attack detection and show that a
deep neural network trained on these sub-bands can accurately identify morph
imagery.
Related papers
- Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network.
Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
arXiv Detail & Related papers (2024-08-28T10:07:17Z) - MorphGANFormer: Transformer-based Face Morphing and De-Morphing [55.211984079735196]
StyleGAN-based approaches to face morphing are among the leading techniques.
We propose a transformer-based alternative to face morphing and demonstrate its superiority to StyleGAN-based methods.
arXiv Detail & Related papers (2023-02-18T19:09:11Z) - Exploring Invariant Representation for Visible-Infrared Person
Re-Identification [77.06940947765406]
Cross-spectral person re-identification, which aims to associate identities to pedestrians across different spectra, faces a main challenge of the modality discrepancy.
In this paper, we address the problem from both image-level and feature-level in an end-to-end hybrid learning framework named robust feature mining network (RFM)
Experiment results on two standard cross-spectral person re-identification datasets, RegDB and SYSU-MM01, have demonstrated state-of-the-art performance.
arXiv Detail & Related papers (2023-02-02T05:24:50Z) - Landmark Enforcement and Style Manipulation for Generative Morphing [24.428843425522107]
We propose a novel StyleGAN morph generation technique by introducing a landmark enforcement method to resolve this issue.
Exploration of the latent space of our model is conducted using Principal Component Analysis (PCA) to accentuate the effect of both the bona fide faces on the morphed latent representation.
To improve high frequency reconstruction in the morphs, we study the train-ability of the noise input for the StyleGAN2 model.
arXiv Detail & Related papers (2022-10-18T22:10:25Z) - Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth
Uncertainty Learning [54.15303628138665]
Face anti-spoofing (FAS) plays a vital role in preventing face recognition systems from presentation attacks.
Existing face anti-spoofing datasets lack diversity due to the insufficient identity and insignificant variance.
We propose Dual Spoof Disentanglement Generation framework to tackle this challenge by "anti-spoofing via generation"
arXiv Detail & Related papers (2021-12-01T15:36:59Z) - Morph Detection Enhanced by Structured Group Sparsity [18.22557507385582]
We consider the challenge of face morphing attacks, which substantially undermine the integrity of face recognition systems.
We use wavelet domain analysis to gain insight into the spatial-frequency content of a morphed face.
We train a Deep Neural Network (DNN) morph detector using the decomposed wavelet sub-bands of the morphed and bona fide images.
arXiv Detail & Related papers (2021-11-29T20:45:03Z) - Adversarially Perturbed Wavelet-based Morphed Face Generation [16.98806338782858]
Morphed images can fool Facial Recognition Systems into falsely accepting multiple people.
As morphed image synthesis becomes easier, it is vital to expand the research community's available data.
We leverage both methods to generate high-quality adversarially perturbed from the FERET, FRGC, and FRLL datasets.
arXiv Detail & Related papers (2021-11-03T01:18:29Z) - Attention Aware Wavelet-based Detection of Morphed Face Images [18.22557507385582]
We propose a wavelet-based morph detection methodology which adopts an end-to-end trainable soft attention mechanism.
We evaluate performance of the proposed framework using three datasets, VISAPP17, LMA, and MorGAN.
arXiv Detail & Related papers (2021-06-29T19:29:19Z) - Detection of Morphed Face Images Using Discriminative Wavelet Sub-bands [18.22557507385582]
We propose a method which is based on a discriminative 2D Discrete Wavelet Transform (2D-DWT)
A discriminative wavelet sub-band can highlight inconsistencies between a real and a morphed image.
We show that a Deep Neural Network (DNN) trained on the 22 discriminative sub-bands can detect morphed samples precisely.
arXiv Detail & Related papers (2021-06-16T06:03:08Z) - Invariant Deep Compressible Covariance Pooling for Aerial Scene
Categorization [80.55951673479237]
We propose a novel invariant deep compressible covariance pooling (IDCCP) to solve nuisance variations in aerial scene categorization.
We conduct extensive experiments on the publicly released aerial scene image data sets and demonstrate the superiority of this method compared with state-of-the-art methods.
arXiv Detail & Related papers (2020-11-11T11:13:07Z) - DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition [85.94331736287765]
We formulate HFR as a dual generation problem, and tackle it via a novel Dual Variational Generation (DVG-Face) framework.
We integrate abundant identity information of large-scale visible data into the joint distribution.
Massive new diverse paired heterogeneous images with the same identity can be generated from noises.
arXiv Detail & Related papers (2020-09-20T09:48:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.