Teacher-Student Network for Real-World Face Super-Resolution with Progressive Embedding of Edge Information

• URL: http://arxiv.org/abs/2405.04778v1
• Date: Wed, 8 May 2024 02:48:52 GMT
• Title: Teacher-Student Network for Real-World Face Super-Resolution with Progressive Embedding of Edge Information
• Authors: Zhilei Liu, Chenggong Zhang,
• Abstract summary: A real-world face super-resolution teacher-student model is proposed, which considers the domain gap between real and synthetic data. Our proposed approach surpasses state-of-the-art methods in obtaining high-quality face images for real-world FSR.
• Score: 2.280954956645056
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Traditional face super-resolution (FSR) methods trained on synthetic datasets usually have poor generalization ability for real-world face images. Recent work has utilized complex degradation models or training networks to simulate the real degradation process, but this limits the performance of these methods due to the domain differences that still exist between the generated low-resolution images and the real low-resolution images. Moreover, because of the existence of a domain gap, the semantic feature information of the target domain may be affected when synthetic data and real data are utilized to train super-resolution models simultaneously. In this study, a real-world face super-resolution teacher-student model is proposed, which considers the domain gap between real and synthetic data and progressively includes diverse edge information by using the recurrent network's intermediate outputs. Extensive experiments demonstrate that our proposed approach surpasses state-of-the-art methods in obtaining high-quality face images for real-world FSR.

Related papers

• Towards Realistic Data Generation for Real-World Super-Resolution [58.88039242455039]
  RealDGen is an unsupervised learning data generation framework designed for real-world super-resolution. We develop content and degradation extraction strategies, which are integrated into a novel content-degradation decoupled diffusion model. Experiments demonstrate that RealDGen excels in generating large-scale, high-quality paired data that mirrors real-world degradations.
  arXiv  Detail & Related papers  (2024-06-11T13:34:57Z)
• Real-GDSR: Real-World Guided DSM Super-Resolution via Edge-Enhancing Residual Network [2.3020018305241337]
  A low-resolution digital surface model (DSM) features distinctive attributes impacted by noise, sensor limitations and data acquisition conditions. This causes super-resolution models trained on synthetic data does not perform effectively on real ones. We introduce a novel methodology to address the intricacies of real-world DSM super-resolution, named REAL-GDSR.
  arXiv  Detail & Related papers  (2024-04-05T07:24:10Z)
• Learning Dual-Level Deformable Implicit Representation for Real-World Scale Arbitrary Super-Resolution [81.74583887661794]
  We build a new real-world super-resolution benchmark with both integer and non-integer scaling factors for the training and evaluation of real-world scale arbitrary super-resolution. Specifically, we design the appearance embedding and deformation field to handle both image-level and pixel-level deformations caused by real-world degradations. Our trained model achieves state-of-the-art performance on the RealArbiSR and RealSR benchmarks for real-world scale arbitrary super-resolution.
  arXiv  Detail & Related papers  (2024-03-16T13:44:42Z)
• Uni-Removal: A Semi-Supervised Framework for Simultaneously Addressing Multiple Degradations in Real-World Images [6.3351090376024155]
  Uni-Removal is a twostage semi-supervised framework for addressing the removal of multiple degradations in real-world images. In the knowledge transfer stage, Uni-Removal leverages a supervised multi-teacher and student architecture. In the domain adaptation stage, unsupervised fine-tuning is performed by incorporating an adversarial discriminator on real-world images.
  arXiv  Detail & Related papers  (2023-07-11T07:18:15Z)
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
  We propose a domain transfer approach based on conditional invertible neural networks (cINNs) Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood. Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
  arXiv  Detail & Related papers  (2023-03-17T18:00:27Z)
• Rethinking Blur Synthesis for Deep Real-World Image Deblurring [4.00114307523959]
  We propose a novel realistic blur synthesis pipeline to simulate the camera imaging process. We develop an effective deblurring model that captures non-local dependencies and local context in the feature domain simultaneously. A comprehensive experiment on three real-world datasets shows that the proposed deblurring model performs better than state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-09-28T06:50:16Z)
• Real-World Image Super-Resolution by Exclusionary Dual-Learning [98.36096041099906]
  Real-world image super-resolution is a practical image restoration problem that aims to obtain high-quality images from in-the-wild input. Deep learning-based methods have achieved promising restoration quality on real-world image super-resolution datasets. We propose Real-World image Super-Resolution by Exclusionary Dual-Learning (RWSR-EDL) to address the feature diversity in perceptual- and L1-based cooperative learning.
  arXiv  Detail & Related papers  (2022-06-06T13:28:15Z)
• SelFSR: Self-Conditioned Face Super-Resolution in the Wild via Flow Field Degradation Network [12.976199676093442]
  We propose a novel domain-adaptive degradation network for face super-resolution in the wild. Our model achieves state-of-the-art performance on both CelebA and real-world face dataset.
  arXiv  Detail & Related papers  (2021-12-20T17:04:00Z)
• Learning Inverse Rendering of Faces from Real-world Videos [52.313931830408386]
  Existing methods decompose a face image into three components (albedo, normal, and illumination) by supervised training on synthetic data. We propose a weakly supervised training approach to train our model on real face videos, based on the assumption of consistency of albedo and normal. Our network is trained on both real and synthetic data, benefiting from both.
  arXiv  Detail & Related papers  (2020-03-26T17:26:40Z)
• Joint Deep Learning of Facial Expression Synthesis and Recognition [97.19528464266824]
  We propose a novel joint deep learning of facial expression synthesis and recognition method for effective FER. The proposed method involves a two-stage learning procedure. Firstly, a facial expression synthesis generative adversarial network (FESGAN) is pre-trained to generate facial images with different facial expressions. In order to alleviate the problem of data bias between the real images and the synthetic images, we propose an intra-class loss with a novel real data-guided back-propagation (RDBP) algorithm.
  arXiv  Detail & Related papers  (2020-02-06T10:56:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.