End-to-end Alternating Optimization for Real-World Blind Super Resolution

• URL: http://arxiv.org/abs/2308.08816v1
• Date: Thu, 17 Aug 2023 06:55:09 GMT
• Title: End-to-end Alternating Optimization for Real-World Blind Super Resolution
• Authors: Zhengxiong Luo, Yan Huang, Shang Li, Liang Wang, Tieniu Tan
• Abstract summary: Blind Super-Resolution (SR) usually involves two sub-problems. estimating the degradation of the given low-resolution (LR) image and super-resolving the LR image to its high-resolution (HR) counterpart. We propose an alternating optimization algorithm, which can estimate the degradation and restore the SR image in a single model.
• Score: 43.95832398891317
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Blind Super-Resolution (SR) usually involves two sub-problems: 1) estimating the degradation of the given low-resolution (LR) image; 2) super-resolving the LR image to its high-resolution (HR) counterpart. Both problems are ill-posed due to the information loss in the degrading process. Most previous methods try to solve the two problems independently, but often fall into a dilemma: a good super-resolved HR result requires an accurate degradation estimation, which however, is difficult to be obtained without the help of original HR information. To address this issue, instead of considering these two problems independently, we adopt an alternating optimization algorithm, which can estimate the degradation and restore the SR image in a single model. Specifically, we design two convolutional neural modules, namely \textit{Restorer} and \textit{Estimator}. \textit{Restorer} restores the SR image based on the estimated degradation, and \textit{Estimator} estimates the degradation with the help of the restored SR image. We alternate these two modules repeatedly and unfold this process to form an end-to-end trainable network. In this way, both \textit{Restorer} and \textit{Estimator} could get benefited from the intermediate results of each other, and make each sub-problem easier. Moreover, \textit{Restorer} and \textit{Estimator} are optimized in an end-to-end manner, thus they could get more tolerant of the estimation deviations of each other and cooperate better to achieve more robust and accurate final results. Extensive experiments on both synthetic datasets and real-world images show that the proposed method can largely outperform state-of-the-art methods and produce more visually favorable results. The codes are rleased at \url{https://github.com/greatlog/RealDAN.git}.

Related papers

• Efficient Test-Time Adaptation for Super-Resolution with Second-Order Degradation and Reconstruction [62.955327005837475]
  Image super-resolution (SR) aims to learn a mapping from low-resolution (LR) to high-resolution (HR) using paired HR-LR training images. We present an efficient test-time adaptation framework for SR, named SRTTA, which is able to quickly adapt SR models to test domains with different/unknown degradation types.
  arXiv  Detail & Related papers  (2023-10-29T13:58:57Z)
• Robust Reference-based Super-Resolution via C2-Matching [77.51610726936657]
  Super-Resolution (Ref-SR) has recently emerged as a promising paradigm to enhance a low-resolution (LR) input image by introducing an additional high-resolution (HR) reference image. Existing Ref-SR methods mostly rely on implicit correspondence matching to borrow HR textures from reference images to compensate for the information loss in input images. We propose C2-Matching, which produces explicit robust matching crossing transformation and resolution.
  arXiv  Detail & Related papers  (2021-06-03T16:40:36Z)
• End-to-end Alternating Optimization for Blind Super Resolution [68.395664154041]
  Two-step solution involves two independently trained models, which may not be well compatible with each other. We adopt an alternating optimization algorithm, which can estimate the blur kernel and restore the SR image in a single model. Our model can largely outperform state-of-the-art methods and produce more visually favorable results at a much higher speed.
  arXiv  Detail & Related papers  (2021-05-14T15:05:30Z)
• Unfolding the Alternating Optimization for Blind Super Resolution [60.39409203244474]
  Two-step solution involves two independently trained models, which may not be well compatible with each other. We adopt an alternating optimization algorithm, which can estimate blur kernel and restore SR image in a single model. Our model can largely outperform state-of-the-art methods and produce more visually favorable results at much higher speed.
  arXiv  Detail & Related papers  (2020-10-06T11:27:27Z)
• Benefiting from Bicubically Down-Sampled Images for Learning Real-World Image Super-Resolution [22.339751911637077]
  We propose to handle real-world SR by splitting this ill-posed problem into two comparatively more well-posed steps. First, we train a network to transform real LR images to the space of bicubically downsampled images in a supervised manner. Second, we take a generic SR network trained on bicubically downsampled images to super-resolve the transformed LR image.
  arXiv  Detail & Related papers  (2020-07-06T20:27:58Z)
• Closed-loop Matters: Dual Regression Networks for Single Image Super-Resolution [73.86924594746884]
  Deep neural networks have exhibited promising performance in image super-resolution. These networks learn a nonlinear mapping function from low-resolution (LR) images to high-resolution (HR) images. We propose a dual regression scheme by introducing an additional constraint on LR data to reduce the space of the possible functions.
  arXiv  Detail & Related papers  (2020-03-16T04:23:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.