Frequency Consistent Adaptation for Real World Super Resolution
- URL: http://arxiv.org/abs/2012.10102v1
- Date: Fri, 18 Dec 2020 08:25:39 GMT
- Title: Frequency Consistent Adaptation for Real World Super Resolution
- Authors: Xiaozhong Ji, Guangpin Tao, Yun Cao, Ying Tai, Tong Lu, Chengjie Wang,
Jilin Li, Feiyue Huang
- Abstract summary: We propose a novel Frequency Consistent Adaptation (FCA) that ensures the frequency domain consistency when applying Super-Resolution (SR) methods to the real scene.
We estimate degradation kernels from unsupervised images and generate the corresponding Low-Resolution (LR) images.
Based on the domain-consistent LR-HR pairs, we train easy-implemented Convolutional Neural Network (CNN) SR models.
- Score: 64.91914552787668
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recent deep-learning based Super-Resolution (SR) methods have achieved
remarkable performance on images with known degradation. However, these methods
always fail in real-world scene, since the Low-Resolution (LR) images after the
ideal degradation (e.g., bicubic down-sampling) deviate from real source
domain. The domain gap between the LR images and the real-world images can be
observed clearly on frequency density, which inspires us to explictly narrow
the undesired gap caused by incorrect degradation. From this point of view, we
design a novel Frequency Consistent Adaptation (FCA) that ensures the frequency
domain consistency when applying existing SR methods to the real scene. We
estimate degradation kernels from unsupervised images and generate the
corresponding LR images. To provide useful gradient information for kernel
estimation, we propose Frequency Density Comparator (FDC) by distinguishing the
frequency density of images on different scales. Based on the domain-consistent
LR-HR pairs, we train easy-implemented Convolutional Neural Network (CNN) SR
models. Extensive experiments show that the proposed FCA improves the
performance of the SR model under real-world setting achieving state-of-the-art
results with high fidelity and plausible perception, thus providing a novel
effective framework for real-world SR application.
Related papers
- Learning Correction Errors via Frequency-Self Attention for Blind Image
Super-Resolution [1.734165485480267]
We introduce a novel blind SR approach that focuses on Learning Correction Errors (LCE)
Within an SR network, we jointly optimize SR performance by utilizing both the original LR image and the frequency learning of the CLR image.
Our approach effectively addresses the challenges associated with degradation estimation and correction errors, paving the way for more accurate blind image SR.
arXiv Detail & Related papers (2024-03-12T07:58:14Z) - Efficient Test-Time Adaptation for Super-Resolution with Second-Order
Degradation and Reconstruction [62.955327005837475]
Image super-resolution (SR) aims to learn a mapping from low-resolution (LR) to high-resolution (HR) using paired HR-LR training images.
We present an efficient test-time adaptation framework for SR, named SRTTA, which is able to quickly adapt SR models to test domains with different/unknown degradation types.
arXiv Detail & Related papers (2023-10-29T13:58:57Z) - ICF-SRSR: Invertible scale-Conditional Function for Self-Supervised
Real-world Single Image Super-Resolution [60.90817228730133]
Single image super-resolution (SISR) is a challenging problem that aims to up-sample a given low-resolution (LR) image to a high-resolution (HR) counterpart.
Recent approaches are trained on simulated LR images degraded by simplified down-sampling operators.
We propose a novel Invertible scale-Conditional Function (ICF) which can scale an input image and then restore the original input with different scale conditions.
arXiv Detail & Related papers (2023-07-24T12:42:45Z) - DCS-RISR: Dynamic Channel Splitting for Efficient Real-world Image
Super-Resolution [15.694407977871341]
Real-world image super-resolution (RISR) has received increased focus for improving the quality of SR images under unknown complex degradation.
Existing methods rely on the heavy SR models to enhance low-resolution (LR) images of different degradation levels.
We propose a novel Dynamic Channel Splitting scheme for efficient Real-world Image Super-Resolution, termed DCS-RISR.
arXiv Detail & Related papers (2022-12-15T04:34:57Z) - Real Image Super-Resolution using GAN through modeling of LR and HR
process [20.537597542144916]
We propose a learnable adaptive sinusoidal nonlinearities incorporated in LR and SR models by directly learn degradation distributions.
We demonstrate the effectiveness of our proposed approach in quantitative and qualitative experiments.
arXiv Detail & Related papers (2022-10-19T09:23:37Z) - Hierarchical Conditional Flow: A Unified Framework for Image
Super-Resolution and Image Rescaling [139.25215100378284]
We propose a hierarchical conditional flow (HCFlow) as a unified framework for image SR and image rescaling.
HCFlow learns a mapping between HR and LR image pairs by modelling the distribution of the LR image and the rest high-frequency component simultaneously.
To further enhance the performance, other losses such as perceptual loss and GAN loss are combined with the commonly used negative log-likelihood loss in training.
arXiv Detail & Related papers (2021-08-11T16:11:01Z) - Kernel Agnostic Real-world Image Super-resolution [82.3963188538938]
We introduce a new kernel agnostic SR framework to deal with real-world image SR problem.
In the proposed framework, the degradation kernels and noises are adaptively modeled rather than explicitly specified.
The experiments validate the effectiveness of the proposed framework on multiple real-world datasets.
arXiv Detail & Related papers (2021-04-19T01:51:21Z) - Perception Consistency Ultrasound Image Super-resolution via
Self-supervised CycleGAN [63.49373689654419]
We propose a new perception consistency ultrasound image super-resolution (SR) method based on self-supervision and cycle generative adversarial network (CycleGAN)
We first generate the HR fathers and the LR sons of the test ultrasound LR image through image enhancement.
We then make full use of the cycle loss of LR-SR-LR and HR-LR-SR and the adversarial characteristics of the discriminator to promote the generator to produce better perceptually consistent SR results.
arXiv Detail & Related papers (2020-12-28T08:24:04Z) - Deep Cyclic Generative Adversarial Residual Convolutional Networks for
Real Image Super-Resolution [20.537597542144916]
We consider a deep cyclic network structure to maintain the domain consistency between the LR and HR data distributions.
We propose the Super-Resolution Residual Cyclic Generative Adversarial Network (SRResCycGAN) by training with a generative adversarial network (GAN) framework for the LR to HR domain translation.
arXiv Detail & Related papers (2020-09-07T11:11:18Z) - Deep Generative Adversarial Residual Convolutional Networks for
Real-World Super-Resolution [31.934084942626257]
We propose a deep Super-Resolution Residual Convolutional Generative Adversarial Network (SRResCGAN)
It follows the real-world degradation settings by adversarial training the model with pixel-wise supervision in the HR domain from its generated LR counterpart.
The proposed network exploits the residual learning by minimizing the energy-based objective function with powerful image regularization and convex optimization techniques.
arXiv Detail & Related papers (2020-05-03T00:12:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.