Exploiting Semantics for Face Image Deblurring
- URL: http://arxiv.org/abs/2001.06822v2
- Date: Mon, 6 Apr 2020 06:00:17 GMT
- Title: Exploiting Semantics for Face Image Deblurring
- Authors: Ziyi Shen, Wei-Sheng Lai, Tingfa Xu, Jan Kautz, and Ming-Hsuan Yang
- Abstract summary: We propose an effective and efficient face deblurring algorithm by exploiting semantic cues via deep convolutional neural networks.
We incorporate face semantic labels as input priors and propose an adaptive structural loss to regularize facial local structures.
The proposed method restores sharp images with more accurate facial features and details.
- Score: 121.44928934662063
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we propose an effective and efficient face deblurring
algorithm by exploiting semantic cues via deep convolutional neural networks.
As the human faces are highly structured and share unified facial components
(e.g., eyes and mouths), such semantic information provides a strong prior for
restoration. We incorporate face semantic labels as input priors and propose an
adaptive structural loss to regularize facial local structures within an
end-to-end deep convolutional neural network. Specifically, we first use a
coarse deblurring network to reduce the motion blur on the input face image. We
then adopt a parsing network to extract the semantic features from the coarse
deblurred image. Finally, the fine deblurring network utilizes the semantic
information to restore a clear face image. We train the network with perceptual
and adversarial losses to generate photo-realistic results. The proposed method
restores sharp images with more accurate facial features and details.
Quantitative and qualitative evaluations demonstrate that the proposed face
deblurring algorithm performs favorably against the state-of-the-art methods in
terms of restoration quality, face recognition and execution speed.
Related papers
- A survey on facial image deblurring [3.6775758132528877]
When the facial image is blurred, it has a great impact on high-level vision tasks such as face recognition.
This paper surveys and summarizes recently published methods for facial image deblurring, most of which are based on deep learning.
We show the performance of classical methods on datasets and metrics and give a brief discussion on the differences of model-based and learning-based methods.
arXiv Detail & Related papers (2023-02-10T02:24:56Z) - Multi-Prior Learning via Neural Architecture Search for Blind Face
Restoration [61.27907052910136]
Blind Face Restoration (BFR) aims to recover high-quality face images from low-quality ones.
Current methods still suffer from two major difficulties: 1) how to derive a powerful network architecture without extensive hand tuning; 2) how to capture complementary information from multiple facial priors in one network to improve restoration performance.
We propose a Face Restoration Searching Network (FRSNet) to adaptively search the suitable feature extraction architecture within our specified search space.
arXiv Detail & Related papers (2022-06-28T12:29:53Z) - Human Face Recognition from Part of a Facial Image based on Image
Stitching [0.0]
Most of the current techniques for face recognition require the presence of a full face of the person to be recognized.
In this work, we adopted the process of stitching the face by completing the missing part with the flipping of the part shown in the picture.
The selected face recognition algorithms that are applied here are Eigenfaces and geometrical methods.
arXiv Detail & Related papers (2022-03-10T19:31:57Z) - Face Deblurring Based on Separable Normalization and Adaptive
Denormalization [25.506065804812522]
Face deblurring aims to restore a clear face image from a blurred input image with more explicit structure and facial details.
We design an effective face deblurring network based on separable normalization and adaptive denormalization.
Experimental results on both CelebA and CelebA-HQ datasets demonstrate that the proposed face deblurring network restores face structure with more facial details.
arXiv Detail & Related papers (2021-12-18T03:42:23Z) - TANet: A new Paradigm for Global Face Super-resolution via
Transformer-CNN Aggregation Network [72.41798177302175]
We propose a novel paradigm based on the self-attention mechanism (i.e., the core of Transformer) to fully explore the representation capacity of the facial structure feature.
Specifically, we design a Transformer-CNN aggregation network (TANet) consisting of two paths, in which one path uses CNNs responsible for restoring fine-grained facial details.
By aggregating the features from the above two paths, the consistency of global facial structure and fidelity of local facial detail restoration are strengthened simultaneously.
arXiv Detail & Related papers (2021-09-16T18:15:07Z) - End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
State-of-the-art general face recognition models do not generalize well to occluded face images.
This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network.
Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
arXiv Detail & Related papers (2021-08-21T09:08:41Z) - Network Architecture Search for Face Enhancement [82.25775020564654]
We present a multi-task face restoration network, called Network Architecture Search for Face Enhancement (NASFE)
NASFE can enhance poor quality face images containing a single degradation (i.e. noise or blur) or multiple degradations (noise+blur+low-light)
arXiv Detail & Related papers (2021-05-13T19:46:05Z) - Structure-Preserving Progressive Low-rank Image Completion for Defending
Adversarial Attacks [20.700098449823024]
Deep neural networks recognize objects by analyzing local image details and summarizing their information along the inference layers to derive the final decision.
Small sophisticated noise in the input images can accumulate along the network inference path and produce wrong decisions at the network output.
Human eyes recognize objects based on their global structure and semantic cues, instead of local image textures.
arXiv Detail & Related papers (2021-03-04T01:24:15Z) - Do We Need Depth in State-Of-The-Art Face Authentication? [8.755493949976492]
We introduce a novel method that learns to recognize faces from stereo camera systems without the need to explicitly compute the facial surface or depth map.
The raw face stereo images along with the location in the image from which the face is extracted allow the proposed CNN to improve the recognition task.
We demonstrate that the suggested method outperforms both single-image and explicit depth based methods on large-scale benchmarks.
arXiv Detail & Related papers (2020-03-24T14:51:25Z) - Joint Deep Learning of Facial Expression Synthesis and Recognition [97.19528464266824]
We propose a novel joint deep learning of facial expression synthesis and recognition method for effective FER.
The proposed method involves a two-stage learning procedure. Firstly, a facial expression synthesis generative adversarial network (FESGAN) is pre-trained to generate facial images with different facial expressions.
In order to alleviate the problem of data bias between the real images and the synthetic images, we propose an intra-class loss with a novel real data-guided back-propagation (RDBP) algorithm.
arXiv Detail & Related papers (2020-02-06T10:56:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.