SRWarp: Generalized Image Super-Resolution under Arbitrary Transformation

• URL: http://arxiv.org/abs/2104.10325v1
• Date: Wed, 21 Apr 2021 02:50:41 GMT
• Title: SRWarp: Generalized Image Super-Resolution under Arbitrary Transformation
• Authors: Sanghyun Son and Kyoung Mu Lee
• Abstract summary: Deep CNNs have achieved significant successes in image processing and its applications, including single image super-resolution. Recent approaches extend the scope to real-valued upsampling factors. We propose the SRWarp framework to further generalize the SR tasks toward an arbitrary image transformation.
• Score: 65.88321755969677
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Deep CNNs have achieved significant successes in image processing and its applications, including single image super-resolution (SR). However, conventional methods still resort to some predetermined integer scaling factors, e.g., x2 or x4. Thus, they are difficult to be applied when arbitrary target resolutions are required. Recent approaches extend the scope to real-valued upsampling factors, even with varying aspect ratios to handle the limitation. In this paper, we propose the SRWarp framework to further generalize the SR tasks toward an arbitrary image transformation. We interpret the traditional image warping task, specifically when the input is enlarged, as a spatially-varying SR problem. We also propose several novel formulations, including the adaptive warping layer and multiscale blending, to reconstruct visually favorable results in the transformation process. Compared with previous methods, we do not constrain the SR model on a regular grid but allow numerous possible deformations for flexible and diverse image editing. Extensive experiments and ablation studies justify the necessity and demonstrate the advantage of the proposed SRWarp method under various transformations.

Related papers

• Perception-Distortion Trade-off in the SR Space Spanned by Flow Models [21.597478894658263]
  Flow-based generative super-resolution (SR) models learn to produce a diverse set of feasible SR solutions, called the SR space. We present a simple but effective image ensembling/fusion approach to obtain a single SR image eliminating random artifacts and improving fidelity without significantly compromising perceptual quality.
  arXiv  Detail & Related papers  (2022-09-18T13:12:21Z)
• Learning Resolution-Adaptive Representations for Cross-Resolution Person Re-Identification [49.57112924976762]
  Cross-resolution person re-identification problem aims to match low-resolution (LR) query identity images against high resolution (HR) gallery images. It is a challenging and practical problem since the query images often suffer from resolution degradation due to the different capturing conditions from real-world cameras. This paper explores an alternative SR-free paradigm to directly compare HR and LR images via a dynamic metric, which is adaptive to the resolution of a query image.
  arXiv  Detail & Related papers  (2022-07-09T03:49:51Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• Single Image Super-Resolution Methods: A Survey [0.0]
  Super-resolution (SR) is the process of obtaining high-resolution images from one or more low-resolution observations of the same scene. Recently, this popularity has spread into video processing areas to the lengths of developing SR models that work in real-time. In this paper, we compare different SR models that specialize in single image processing and will take a glance at how they evolved to take on many different objectives and shapes over the years.
  arXiv  Detail & Related papers  (2022-02-17T12:01:05Z)
• Blind Image Super-Resolution via Contrastive Representation Learning [41.17072720686262]
  We design a contrastive representation learning network that focuses on blind SR of images with multi-modal and spatially variant distributions. We show that the proposed CRL-SR can handle multi-modal and spatially variant degradation effectively under blind settings. It also outperforms state-of-the-art SR methods qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2021-07-01T19:34:23Z)
• SRFlow: Learning the Super-Resolution Space with Normalizing Flow [176.07982398988747]
  Super-resolution is an ill-posed problem, since it allows for multiple predictions for a given low-resolution image. We propose SRFlow: a normalizing flow based super-resolution method capable of learning the conditional distribution of the output. Our model is trained in a principled manner using a single loss, namely the negative log-likelihood.
  arXiv  Detail & Related papers  (2020-06-25T06:34:04Z)
• PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models [77.32079593577821]
  PULSE (Photo Upsampling via Latent Space Exploration) generates high-resolution, realistic images at resolutions previously unseen in the literature. Our method outperforms state-of-the-art methods in perceptual quality at higher resolutions and scale factors than previously possible.
  arXiv  Detail & Related papers  (2020-03-08T16:44:31Z)
• DDet: Dual-path Dynamic Enhancement Network for Real-World Image Super-Resolution [69.2432352477966]
  Real image super-resolution(Real-SR) focus on the relationship between real-world high-resolution(HR) and low-resolution(LR) image. In this article, we propose a Dual-path Dynamic Enhancement Network(DDet) for Real-SR. Unlike conventional methods which stack up massive convolutional blocks for feature representation, we introduce a content-aware framework to study non-inherently aligned image pair.
  arXiv  Detail & Related papers  (2020-02-25T18:24:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.