Cross-resolution Face Recognition via Identity-Preserving Network and
Knowledge Distillation
- URL: http://arxiv.org/abs/2303.08665v2
- Date: Tue, 5 Sep 2023 12:35:36 GMT
- Title: Cross-resolution Face Recognition via Identity-Preserving Network and
Knowledge Distillation
- Authors: Yuhang Lu, Touradj Ebrahimi
- Abstract summary: Cross-resolution face recognition is a challenging problem for modern deep face recognition systems.
This paper proposes a new approach that enforces the network to focus on the discriminative information stored in the low-frequency components of a low-resolution image.
- Score: 12.090322373964124
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Cross-resolution face recognition has become a challenging problem for modern
deep face recognition systems. It aims at matching a low-resolution probe image
with high-resolution gallery images registered in a database. Existing methods
mainly leverage prior information from high-resolution images by either
reconstructing facial details with super-resolution techniques or learning a
unified feature space. To address this challenge, this paper proposes a new
approach that enforces the network to focus on the discriminative information
stored in the low-frequency components of a low-resolution image. A
cross-resolution knowledge distillation paradigm is first employed as the
learning framework. Then, an identity-preserving network, WaveResNet, and a
wavelet similarity loss are designed to capture low-frequency details and boost
performance. Finally, an image degradation model is conceived to simulate more
realistic low-resolution training data. Consequently, extensive experimental
results show that the proposed method consistently outperforms the baseline
model and other state-of-the-art methods across a variety of image resolutions.
Related papers
- Research on Image Super-Resolution Reconstruction Mechanism based on Convolutional Neural Network [8.739451985459638]
Super-resolution algorithms transform one or more sets of low-resolution images captured from the same scene into high-resolution images.
The extraction of image features and nonlinear mapping methods in the reconstruction process remain challenging for existing algorithms.
The objective is to recover high-quality, high-resolution images from low-resolution images.
arXiv Detail & Related papers (2024-07-18T06:50:39Z) - DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake
Detection [67.3143177137102]
Deepfake detection refers to detecting artificially generated or edited faces in images or videos.
We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
arXiv Detail & Related papers (2023-12-07T07:19:45Z) - An Enhanced Low-Resolution Image Recognition Method for Traffic
Environments [3.018656336329545]
Low-resolution images suffer from small size, low quality, and lack of detail, leading to a decrease in the accuracy of traditional neural network recognition algorithms.
This paper introduces a dual-branch residual network structure that leverages the basic architecture of residual networks and a common feature subspace algorithm.
It incorporates the utilization of intermediate-layer features to enhance the accuracy of low-resolution image recognition.
arXiv Detail & Related papers (2023-09-28T12:38:31Z) - Learning Discriminative Shrinkage Deep Networks for Image Deconvolution [122.79108159874426]
We propose an effective non-blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms.
Experimental results show that the proposed method performs favorably against the state-of-the-art ones in terms of efficiency and accuracy.
arXiv Detail & Related papers (2021-11-27T12:12:57Z) - High-Frequency aware Perceptual Image Enhancement [0.08460698440162888]
We introduce a novel deep neural network suitable for multi-scale analysis and propose efficient model-agnostic methods.
Our model can be applied to multi-scale image enhancement problems including denoising, deblurring and single image super-resolution.
arXiv Detail & Related papers (2021-05-25T07:33:14Z) - Hierarchical Deep CNN Feature Set-Based Representation Learning for
Robust Cross-Resolution Face Recognition [59.29808528182607]
Cross-resolution face recognition (CRFR) is important in intelligent surveillance and biometric forensics.
Existing shallow learning-based and deep learning-based methods focus on mapping the HR-LR face pairs into a joint feature space.
In this study, we desire to fully exploit the multi-level deep convolutional neural network (CNN) feature set for robust CRFR.
arXiv Detail & Related papers (2021-03-25T14:03:42Z) - Multi Scale Identity-Preserving Image-to-Image Translation Network for
Low-Resolution Face Recognition [7.6702700993064115]
We propose an identity-preserving end-to-end image-to-image translation deep neural network.
It is capable of super-resolving very low-resolution faces to their high-resolution counterparts while preserving identity-related information.
arXiv Detail & Related papers (2020-10-23T09:21:06Z) - Invertible Image Rescaling [118.2653765756915]
We develop an Invertible Rescaling Net (IRN) to produce visually-pleasing low-resolution images.
We capture the distribution of the lost information using a latent variable following a specified distribution in the downscaling process.
arXiv Detail & Related papers (2020-05-12T09:55:53Z) - Feature Super-Resolution Based Facial Expression Recognition for
Multi-scale Low-Resolution Faces [7.634398926381845]
Super-resolution method is often used to enhance low-resolution images, but the performance on FER task is limited when on images of very low resolution.
In this work, inspired by feature super-resolution methods for object detection, we proposed a novel generative adversary network-based super-resolution method for robust facial expression recognition.
arXiv Detail & Related papers (2020-04-05T15:38:47Z) - Learning Enriched Features for Real Image Restoration and Enhancement [166.17296369600774]
convolutional neural networks (CNNs) have achieved dramatic improvements over conventional approaches for image restoration task.
We present a novel architecture with the collective goals of maintaining spatially-precise high-resolution representations through the entire network.
Our approach learns an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
arXiv Detail & Related papers (2020-03-15T11:04:30Z) - Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
We propose a dual-branch convolutional neural network to extract base features and recovered features separately.
By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
arXiv Detail & Related papers (2020-03-02T13:28:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.