Attention Aware Wavelet-based Detection of Morphed Face Images
- URL: http://arxiv.org/abs/2106.15686v1
- Date: Tue, 29 Jun 2021 19:29:19 GMT
- Title: Attention Aware Wavelet-based Detection of Morphed Face Images
- Authors: Poorya Aghdaie, Baaria Chaudhary, Sobhan Soleymani, Jeremy Dawson,
Nasser M. Nasrabadi
- Abstract summary: We propose a wavelet-based morph detection methodology which adopts an end-to-end trainable soft attention mechanism.
We evaluate performance of the proposed framework using three datasets, VISAPP17, LMA, and MorGAN.
- Score: 18.22557507385582
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Morphed images have exploited loopholes in the face recognition checkpoints,
e.g., Credential Authentication Technology (CAT), used by Transportation
Security Administration (TSA), which is a non-trivial security concern. To
overcome the risks incurred due to morphed presentations, we propose a
wavelet-based morph detection methodology which adopts an end-to-end trainable
soft attention mechanism . Our attention-based deep neural network (DNN)
focuses on the salient Regions of Interest (ROI) which have the most spatial
support for morph detector decision function, i.e, morph class binary softmax
output. A retrospective of morph synthesizing procedure aids us to speculate
the ROI as regions around facial landmarks , particularly for the case of
landmark-based morphing techniques. Moreover, our attention-based DNN is
adapted to the wavelet space, where inputs of the network are coarse-to-fine
spectral representations, 48 stacked wavelet sub-bands to be exact. We evaluate
performance of the proposed framework using three datasets, VISAPP17, LMA, and
MorGAN. In addition, as attention maps can be a robust indicator whether a
probe image under investigation is genuine or counterfeit, we analyze the
estimated attention maps for both a bona fide image and its corresponding
morphed image. Finally, we present an ablation study on the efficacy of
utilizing attention mechanism for the sake of morph detection.
Related papers
- UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization.
We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
arXiv Detail & Related papers (2024-07-26T20:51:54Z) - Attention Consistency Refined Masked Frequency Forgery Representation
for Generalizing Face Forgery Detection [96.539862328788]
Existing forgery detection methods suffer from unsatisfactory generalization ability to determine the authenticity in the unseen domain.
We propose a novel Attention Consistency Refined masked frequency forgery representation model toward generalizing face forgery detection algorithm (ACMF)
Experiment results on several public face forgery datasets demonstrate the superior performance of the proposed method compared with the state-of-the-art methods.
arXiv Detail & Related papers (2023-07-21T08:58:49Z) - Face Feature Visualisation of Single Morphing Attack Detection [13.680968065638108]
This paper proposes an explainable visualisation of different face feature extraction algorithms.
It enables the detection of bona fide and morphing images for single morphing attack detection.
The visualisation may help to develop a Graphical User Interface for border policies.
arXiv Detail & Related papers (2023-04-25T17:51:23Z) - MorphGANFormer: Transformer-based Face Morphing and De-Morphing [55.211984079735196]
StyleGAN-based approaches to face morphing are among the leading techniques.
We propose a transformer-based alternative to face morphing and demonstrate its superiority to StyleGAN-based methods.
arXiv Detail & Related papers (2023-02-18T19:09:11Z) - Morph Detection Enhanced by Structured Group Sparsity [18.22557507385582]
We consider the challenge of face morphing attacks, which substantially undermine the integrity of face recognition systems.
We use wavelet domain analysis to gain insight into the spatial-frequency content of a morphed face.
We train a Deep Neural Network (DNN) morph detector using the decomposed wavelet sub-bands of the morphed and bona fide images.
arXiv Detail & Related papers (2021-11-29T20:45:03Z) - Single Morphing Attack Detection using Feature Selection and
Visualisation based on Mutual Information [13.725021925072603]
This paper explores features extracted from intensity, shape, texture, and proposes a feature selection stage based on the Mutual Information filter.
The eyes and nose are identified as the most critical areas to be analysed.
arXiv Detail & Related papers (2021-10-26T10:27:06Z) - Detect and Locate: A Face Anti-Manipulation Approach with Semantic and
Noise-level Supervision [67.73180660609844]
We propose a conceptually simple but effective method to efficiently detect forged faces in an image.
The proposed scheme relies on a segmentation map that delivers meaningful high-level semantic information clues about the image.
The proposed model achieves state-of-the-art detection accuracy and remarkable localization performance.
arXiv Detail & Related papers (2021-07-13T02:59:31Z) - Focused LRP: Explainable AI for Face Morphing Attack Detection [3.145455301228176]
We present a framework to explain to a human inspector on a precise pixel level, which image regions are used by a Deep Neural Network to distinguish between a genuine and a morphed face image.
We also propose a framework to objectively analyze the quality of our method and compare FLRP to other interpretability methods.
arXiv Detail & Related papers (2021-03-26T19:05:01Z) - Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in
Frequency Domain [88.7339322596758]
We present a novel Spatial-Phase Shallow Learning (SPSL) method, which combines spatial image and phase spectrum to capture the up-sampling artifacts of face forgery.
SPSL can achieve the state-of-the-art performance on cross-datasets evaluation as well as multi-class classification and obtain comparable results on single dataset evaluation.
arXiv Detail & Related papers (2021-03-02T16:45:08Z) - Ventral-Dorsal Neural Networks: Object Detection via Selective Attention [51.79577908317031]
We propose a new framework called Ventral-Dorsal Networks (VDNets)
Inspired by the structure of the human visual system, we propose the integration of a "Ventral Network" and a "Dorsal Network"
Our experimental results reveal that the proposed method outperforms state-of-the-art object detection approaches.
arXiv Detail & Related papers (2020-05-15T23:57:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.