Kernelized Back-Projection Networks for Blind Super Resolution

• URL: http://arxiv.org/abs/2302.08478v3
• Date: Fri, 27 Oct 2023 15:03:18 GMT
• Title: Kernelized Back-Projection Networks for Blind Super Resolution
• Authors: Tomoki Yoshida, Yuki Kondo, Takahiro Maeda, Kazutoshi Akita, Norimichi Ukita
• Abstract summary: Super Resolution (SR) fails to super-resolve Low-Resolution (LR) images degraded by arbitrary degradations. This paper reveals that non-blind SR that is trained simply with various blur kernels exhibits comparable performance as those with the degradation model for blind SR.
• Score: 14.422263486129811
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Since non-blind Super Resolution (SR) fails to super-resolve Low-Resolution (LR) images degraded by arbitrary degradations, SR with the degradation model is required. However, this paper reveals that non-blind SR that is trained simply with various blur kernels exhibits comparable performance as those with the degradation model for blind SR. This result motivates us to revisit high-performance non-blind SR and extend it to blind SR with blur kernels. This paper proposes two SR networks by integrating kernel estimation and SR branches in an iterative end-to-end manner. In the first model, which is called the Kernel Conditioned Back-Projection Network (KCBPN), the low-dimensional kernel representations are estimated for conditioning the SR branch. In our second model, the Kernelized BackProjection Network (KBPN), a raw kernel is estimated and directly employed for modeling the image degradation. The estimated kernel is employed not only for back-propagating its residual but also for forward-propagating the residual to iterative stages. This forward-propagation encourages these stages to learn a variety of different features in different stages by focusing on pixels with large residuals in each stage. Experimental results validate the effectiveness of our proposed networks for kernel estimation and SR. We will release the code for this work.

Related papers

• Dual-Diffusion: Dual Conditional Denoising Diffusion Probabilistic Models for Blind Super-Resolution Reconstruction in RSIs [6.2678394285548755]
  We propose a novel blind SR framework based on conditional denoising diffusion probabilistic models (DDPM) In our work, we introduce conditional denoising diffusion probabilistic models (DDPM) from two aspects: kernel estimation progress and re-construction progress. We construct a DDPM-based reconstructor to learning the mapping from the LR images to HR images.
  arXiv  Detail & Related papers  (2023-05-20T11:18:38Z)
• Knowledge Distillation based Degradation Estimation for Blind Super-Resolution [146.0988597062618]
  Blind image super-resolution (Blind-SR) aims to recover a high-resolution (HR) image from its corresponding low-resolution (LR) input image with unknown degradations. It is infeasible to provide concrete labels of multiple degradation combinations to supervise the degradation estimator training. We propose a knowledge distillation based implicit degradation estimator network (KD-IDE) and an efficient SR network.
  arXiv  Detail & Related papers  (2022-11-30T11:59:07Z)
• Deep Constrained Least Squares for Blind Image Super-Resolution [36.71106982590893]
  We tackle the problem of blind image super-resolution(SR) with a reformulated degradation model and two novel modules. To be more specific, we first reformulate the degradation model such that the deblurring kernel estimation can be transferred into the low resolution space. Our experiments demonstrate that the proposed method achieves better accuracy and visual improvements against state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-02-15T15:32:11Z)
• Kernel-aware Raw Burst Blind Super-Resolution [0.0]
  Burst super-resolution (SR) provides a possibility of restoring rich details from low-quality images. Existing non-blind networks usually lead to a severe performance drop in recovering high-resolution (HR) images. We introduce a kernel-aware deformable alignment module which can effectively align the raw images with consideration of the blurry priors.
  arXiv  Detail & Related papers  (2021-12-14T11:49:13Z)
• Spectrum-to-Kernel Translation for Accurate Blind Image Super-Resolution [33.59749785182318]
  We propose a novel blind SR framework to super-resolve LR images degraded by arbitrary blur kernel. We first demonstrate that feature representation in frequency domain is more conducive for blur kernel reconstruction than in spatial domain. Experiments on both synthetic and real-world images demonstrate that our proposed method sufficiently reduces blur kernel estimation error.
  arXiv  Detail & Related papers  (2021-10-23T06:03:22Z)
• Mutual Affine Network for Spatially Variant Kernel Estimation in Blind Image Super-Resolution [130.32026819172256]
  Existing blind image super-resolution (SR) methods mostly assume blur kernels are spatially invariant across the whole image. This paper proposes a mutual affine network (MANet) for spatially variant kernel estimation.
  arXiv  Detail & Related papers  (2021-08-11T16:11:17Z)
• Blind Image Super-Resolution via Contrastive Representation Learning [41.17072720686262]
  We design a contrastive representation learning network that focuses on blind SR of images with multi-modal and spatially variant distributions. We show that the proposed CRL-SR can handle multi-modal and spatially variant degradation effectively under blind settings. It also outperforms state-of-the-art SR methods qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2021-07-01T19:34:23Z)
• End-to-end Alternating Optimization for Blind Super Resolution [68.395664154041]
  Two-step solution involves two independently trained models, which may not be well compatible with each other. We adopt an alternating optimization algorithm, which can estimate the blur kernel and restore the SR image in a single model. Our model can largely outperform state-of-the-art methods and produce more visually favorable results at a much higher speed.
  arXiv  Detail & Related papers  (2021-05-14T15:05:30Z)
• Flow-based Kernel Prior with Application to Blind Super-Resolution [143.21527713002354]
  Kernel estimation is generally one of the key problems for blind image super-resolution (SR) This paper proposes a normalizing flow-based kernel prior (FKP) for kernel modeling. Experiments on synthetic and real-world images demonstrate that the proposed FKP can significantly improve the kernel estimation accuracy.
  arXiv  Detail & Related papers  (2021-03-29T22:37:06Z)
• Unfolding the Alternating Optimization for Blind Super Resolution [60.39409203244474]
  Two-step solution involves two independently trained models, which may not be well compatible with each other. We adopt an alternating optimization algorithm, which can estimate blur kernel and restore SR image in a single model. Our model can largely outperform state-of-the-art methods and produce more visually favorable results at much higher speed.
  arXiv  Detail & Related papers  (2020-10-06T11:27:27Z)
• Structure-Preserving Super Resolution with Gradient Guidance [87.79271975960764]
  Structures matter in single image super resolution (SISR) Recent studies benefiting from generative adversarial network (GAN) have promoted the development of SISR. However, there are always undesired structural distortions in the recovered images.
  arXiv  Detail & Related papers  (2020-03-29T17:26:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.