Deep Constrained Least Squares for Blind Image Super-Resolution

• URL: http://arxiv.org/abs/2202.07508v1
• Date: Tue, 15 Feb 2022 15:32:11 GMT
• Title: Deep Constrained Least Squares for Blind Image Super-Resolution
• Authors: Ziwei Luo, Haibin Huang, Lei Yu, Youwei Li, Haoqiang Fan, and Shuaicheng Liu
• Abstract summary: We tackle the problem of blind image super-resolution(SR) with a reformulated degradation model and two novel modules. To be more specific, we first reformulate the degradation model such that the deblurring kernel estimation can be transferred into the low resolution space. Our experiments demonstrate that the proposed method achieves better accuracy and visual improvements against state-of-the-art methods.
• Score: 36.71106982590893
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we tackle the problem of blind image super-resolution(SR) with a reformulated degradation model and two novel modules. Following the common practices of blind SR, our method proposes to improve both the kernel estimation as well as the kernel based high resolution image restoration. To be more specific, we first reformulate the degradation model such that the deblurring kernel estimation can be transferred into the low resolution space. On top of this, we introduce a dynamic deep linear filter module. Instead of learning a fixed kernel for all images, it can adaptively generate deblurring kernel weights conditional on the input and yields more robust kernel estimation. Subsequently, a deep constrained least square filtering module is applied to generate clean features based on the reformulation and estimated kernel. The deblurred feature and the low input image feature are then fed into a dual-path structured SR network and restore the final high resolution result. To evaluate our method, we further conduct evaluations on several benchmarks, including Gaussian8 and DIV2KRK. Our experiments demonstrate that the proposed method achieves better accuracy and visual improvements against state-of-the-art methods.

Related papers

• BlindDiff: Empowering Degradation Modelling in Diffusion Models for Blind Image Super-Resolution [52.47005445345593]
  BlindDiff is a DM-based blind SR method to tackle the blind degradation settings in SISR. BlindDiff seamlessly integrates the MAP-based optimization into DMs. Experiments on both synthetic and real-world datasets show that BlindDiff achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-03-15T11:21:34Z)
• Kernelized Back-Projection Networks for Blind Super Resolution [14.422263486129811]
  Super Resolution (SR) fails to super-resolve Low-Resolution (LR) images degraded by arbitrary degradations. This paper reveals that non-blind SR that is trained simply with various blur kernels exhibits comparable performance as those with the degradation model for blind SR.
  arXiv  Detail & Related papers  (2023-02-16T18:35:39Z)
• Meta-Learned Kernel For Blind Super-Resolution Kernel Estimation [22.437479940607332]
  We introduce a learning-to-learn approach that meta-learns from the information contained in a distribution of images. We show that our method leads to a faster inference with a speedup between 14.24 to 102.1x over existing methods.
  arXiv  Detail & Related papers  (2022-12-15T15:11:38Z)
• Unfolded Deep Kernel Estimation for Blind Image Super-resolution [23.798845090992728]
  Blind image super-resolution (BISR) aims to reconstruct a high-resolution image from its low-resolution counterpart degraded by unknown blur kernel and noise. We propose a novel unfolded deep kernel estimation (UDKE) method, which, for the first time to our best knowledge, explicitly solves the data term with high efficiency.
  arXiv  Detail & Related papers  (2022-03-10T07:54:59Z)
• Kernel-aware Raw Burst Blind Super-Resolution [0.0]
  Burst super-resolution (SR) provides a possibility of restoring rich details from low-quality images. Existing non-blind networks usually lead to a severe performance drop in recovering high-resolution (HR) images. We introduce a kernel-aware deformable alignment module which can effectively align the raw images with consideration of the blurry priors.
  arXiv  Detail & Related papers  (2021-12-14T11:49:13Z)
• Spectrum-to-Kernel Translation for Accurate Blind Image Super-Resolution [33.59749785182318]
  We propose a novel blind SR framework to super-resolve LR images degraded by arbitrary blur kernel. We first demonstrate that feature representation in frequency domain is more conducive for blur kernel reconstruction than in spatial domain. Experiments on both synthetic and real-world images demonstrate that our proposed method sufficiently reduces blur kernel estimation error.
  arXiv  Detail & Related papers  (2021-10-23T06:03:22Z)
• Flow-based Kernel Prior with Application to Blind Super-Resolution [143.21527713002354]
  Kernel estimation is generally one of the key problems for blind image super-resolution (SR) This paper proposes a normalizing flow-based kernel prior (FKP) for kernel modeling. Experiments on synthetic and real-world images demonstrate that the proposed FKP can significantly improve the kernel estimation accuracy.
  arXiv  Detail & Related papers  (2021-03-29T22:37:06Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)
• Deep Blind Video Super-resolution [85.79696784460887]
  We propose a deep convolutional neural network (CNN) model to solve video SR by a blur kernel modeling approach. The proposed CNN model consists of motion blur estimation, motion estimation, and latent image restoration modules. We show that the proposed algorithm is able to generate clearer images with finer structural details.
  arXiv  Detail & Related papers  (2020-03-10T13:43:24Z)
• Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
  We propose a dual-branch convolutional neural network to extract base features and recovered features separately. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
  arXiv  Detail & Related papers  (2020-03-02T13:28:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.