Unfolded Deep Kernel Estimation for Blind Image Super-resolution
- URL: http://arxiv.org/abs/2203.05568v1
- Date: Thu, 10 Mar 2022 07:54:59 GMT
- Title: Unfolded Deep Kernel Estimation for Blind Image Super-resolution
- Authors: Hongyi Zheng, Hongwei Yong, Lei Zhang
- Abstract summary: Blind image super-resolution (BISR) aims to reconstruct a high-resolution image from its low-resolution counterpart degraded by unknown blur kernel and noise.
We propose a novel unfolded deep kernel estimation (UDKE) method, which, for the first time to our best knowledge, explicitly solves the data term with high efficiency.
- Score: 23.798845090992728
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Blind image super-resolution (BISR) aims to reconstruct a high-resolution
image from its low-resolution counterpart degraded by unknown blur kernel and
noise. Many deep neural network based methods have been proposed to tackle this
challenging problem without considering the image degradation model. However,
they largely rely on the training sets and often fail to handle images with
unseen blur kernels during inference. Deep unfolding methods have also been
proposed to perform BISR by utilizing the degradation model. Nonetheless, the
existing deep unfolding methods cannot explicitly solve the data term of the
unfolding objective function, limiting their capability in blur kernel
estimation. In this work, we propose a novel unfolded deep kernel estimation
(UDKE) method, which, for the first time to our best knowledge, explicitly
solves the data term with high efficiency. The UDKE based BISR method can
jointly learn image and kernel priors in an end-to-end manner, and it can
effectively exploit the information in both training data and image degradation
model. Experiments on benchmark datasets and real-world data demonstrate that
the proposed UDKE method could well predict complex unseen non-Gaussian blur
kernels in inference, achieving significantly better BISR performance than
state-of-the-art. The source code of UDKE is available at:
https://github.com/natezhenghy/UDKE.
Related papers
- NSD-DIL: Null-Shot Deblurring Using Deep Identity Learning [0.02932486408310998]
We introduce Deep Identity Learning (DIL), a novel learning strategy that includes a dedicated regularization term based on the properties of linear systems.
Since it is purely image-data-independent, we term our model as Null-Shot deblurring Using Deep Identity Learning (NSD-DIL)
Our experiments show that the proposed method outperforms both traditional and deep learning based deblurring methods.
arXiv Detail & Related papers (2024-07-05T18:56:31Z) - BlindDiff: Empowering Degradation Modelling in Diffusion Models for Blind Image Super-Resolution [52.47005445345593]
BlindDiff is a DM-based blind SR method to tackle the blind degradation settings in SISR.
BlindDiff seamlessly integrates the MAP-based optimization into DMs.
Experiments on both synthetic and real-world datasets show that BlindDiff achieves the state-of-the-art performance.
arXiv Detail & Related papers (2024-03-15T11:21:34Z) - Meta-Learned Kernel For Blind Super-Resolution Kernel Estimation [22.437479940607332]
We introduce a learning-to-learn approach that meta-learns from the information contained in a distribution of images.
We show that our method leads to a faster inference with a speedup between 14.24 to 102.1x over existing methods.
arXiv Detail & Related papers (2022-12-15T15:11:38Z) - Uncertainty-Aware Unsupervised Image Deblurring with Deep Residual Prior [23.417096880297702]
Non-blind deblurring methods achieve decent performance under the accurate blur kernel assumption.
Hand-crafted prior, incorporating domain knowledge, generally performs well but may lead to poor performance when kernel (or induced) error is complex.
Data-driven prior, which excessively depends on the diversity and abundance of training data, is vulnerable to out-of-distribution blurs and images.
We propose an unsupervised semi-blind deblurring model which recovers the latent image from the blurry image and inaccurate blur kernel.
arXiv Detail & Related papers (2022-10-09T11:10:59Z) - Real-World Image Super-Resolution by Exclusionary Dual-Learning [98.36096041099906]
Real-world image super-resolution is a practical image restoration problem that aims to obtain high-quality images from in-the-wild input.
Deep learning-based methods have achieved promising restoration quality on real-world image super-resolution datasets.
We propose Real-World image Super-Resolution by Exclusionary Dual-Learning (RWSR-EDL) to address the feature diversity in perceptual- and L1-based cooperative learning.
arXiv Detail & Related papers (2022-06-06T13:28:15Z) - Deep Constrained Least Squares for Blind Image Super-Resolution [36.71106982590893]
We tackle the problem of blind image super-resolution(SR) with a reformulated degradation model and two novel modules.
To be more specific, we first reformulate the degradation model such that the deblurring kernel estimation can be transferred into the low resolution space.
Our experiments demonstrate that the proposed method achieves better accuracy and visual improvements against state-of-the-art methods.
arXiv Detail & Related papers (2022-02-15T15:32:11Z) - Kernel-aware Raw Burst Blind Super-Resolution [0.0]
Burst super-resolution (SR) provides a possibility of restoring rich details from low-quality images.
Existing non-blind networks usually lead to a severe performance drop in recovering high-resolution (HR) images.
We introduce a kernel-aware deformable alignment module which can effectively align the raw images with consideration of the blurry priors.
arXiv Detail & Related papers (2021-12-14T11:49:13Z) - Kernel Agnostic Real-world Image Super-resolution [82.3963188538938]
We introduce a new kernel agnostic SR framework to deal with real-world image SR problem.
In the proposed framework, the degradation kernels and noises are adaptively modeled rather than explicitly specified.
The experiments validate the effectiveness of the proposed framework on multiple real-world datasets.
arXiv Detail & Related papers (2021-04-19T01:51:21Z) - Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
Blind image restoration is a common yet challenging problem in computer vision.
We propose a novel blind image restoration method, aiming to integrate both the advantages of them.
Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
arXiv Detail & Related papers (2020-08-25T03:30:53Z) - Deep Unfolding Network for Image Super-Resolution [159.50726840791697]
This paper proposes an end-to-end trainable unfolding network which leverages both learning-based methods and model-based methods.
The proposed network inherits the flexibility of model-based methods to super-resolve blurry, noisy images for different scale factors via a single model.
arXiv Detail & Related papers (2020-03-23T17:55:42Z) - Deep Blind Video Super-resolution [85.79696784460887]
We propose a deep convolutional neural network (CNN) model to solve video SR by a blur kernel modeling approach.
The proposed CNN model consists of motion blur estimation, motion estimation, and latent image restoration modules.
We show that the proposed algorithm is able to generate clearer images with finer structural details.
arXiv Detail & Related papers (2020-03-10T13:43:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.