VSpSR: Explorable Super-Resolution via Variational Sparse Representation
- URL: http://arxiv.org/abs/2104.08575v1
- Date: Sat, 17 Apr 2021 15:36:24 GMT
- Title: VSpSR: Explorable Super-Resolution via Variational Sparse Representation
- Authors: Hangqi Zhou, Chao Huang, Shangqi Gao, Xiahai Zhuang
- Abstract summary: Super-resolution (SR) is an ill-posed problem, which means that infinitely many high-resolution (HR) images can be degraded to the same low-resolution (LR) image.
We develop a Vari Sparseational framework for Super-Resolution (VSpSR) via neural networks.
- Score: 15.810502797317502
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Super-resolution (SR) is an ill-posed problem, which means that infinitely
many high-resolution (HR) images can be degraded to the same low-resolution
(LR) image. To study the one-to-many stochastic SR mapping, we implicitly
represent the non-local self-similarity of natural images and develop a
Variational Sparse framework for Super-Resolution (VSpSR) via neural networks.
Since every small patch of a HR image can be well approximated by the sparse
representation of atoms in an over-complete dictionary, we design a two-branch
module, i.e., VSpM, to explore the SR space. Concretely, one branch of VSpM
extracts patch-level basis from the LR input, and the other branch infers
pixel-wise variational distributions with respect to the sparse coefficients.
By repeatedly sampling coefficients, we could obtain infinite sparse
representations, and thus generate diverse HR images. According to the
preliminary results of NTIRE 2021 challenge on learning SR space, our team
(FudanZmic21) ranks 7-th in terms of released scores. The implementation of
VSpSR is released at https://zmiclab.github.io/.
Related papers
- Learning Many-to-Many Mapping for Unpaired Real-World Image
Super-resolution and Downscaling [60.80788144261183]
We propose an image downscaling and SR model dubbed as SDFlow, which simultaneously learns a bidirectional many-to-many mapping between real-world LR and HR images unsupervisedly.
Experimental results on real-world image SR datasets indicate that SDFlow can generate diverse realistic LR and SR images both quantitatively and qualitatively.
arXiv Detail & Related papers (2023-10-08T01:48:34Z) - Dual-Diffusion: Dual Conditional Denoising Diffusion Probabilistic
Models for Blind Super-Resolution Reconstruction in RSIs [6.2678394285548755]
We propose a novel blind SR framework based on conditional denoising diffusion probabilistic models (DDPM)
In our work, we introduce conditional denoising diffusion probabilistic models (DDPM) from two aspects: kernel estimation progress and re-construction progress.
We construct a DDPM-based reconstructor to learning the mapping from the LR images to HR images.
arXiv Detail & Related papers (2023-05-20T11:18:38Z) - Towards Lightweight Super-Resolution with Dual Regression Learning [58.98801753555746]
Deep neural networks have exhibited remarkable performance in image super-resolution (SR) tasks.
The SR problem is typically an ill-posed problem and existing methods would come with several limitations.
We propose a dual regression learning scheme to reduce the space of possible SR mappings.
arXiv Detail & Related papers (2022-07-16T12:46:10Z) - Mutual Affine Network for Spatially Variant Kernel Estimation in Blind
Image Super-Resolution [130.32026819172256]
Existing blind image super-resolution (SR) methods mostly assume blur kernels are spatially invariant across the whole image.
This paper proposes a mutual affine network (MANet) for spatially variant kernel estimation.
arXiv Detail & Related papers (2021-08-11T16:11:17Z) - One-to-many Approach for Improving Super-Resolution [0.0]
We propose adding weighted pixel-wise noise after every Residual-in-Residual Dense Block (RRDB) to enable the generator to generate various images.
We modify the strict content loss to not penalize variation in reconstructed images as long as it has consistent content.
We were able to improve the performance of ESRGAN in x4 perceptual SR and achieve the state-of-the-art LPIPS score in x16 perceptual extreme SR.
arXiv Detail & Related papers (2021-06-19T06:41:29Z) - LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single
Image Super-Resolution and Beyond [75.37541439447314]
Single image super-resolution (SISR) deals with a fundamental problem of upsampling a low-resolution (LR) image to its high-resolution (HR) version.
This paper proposes a linearly-assembled pixel-adaptive regression network (LAPAR) to strike a sweet spot of deep model complexity and resulting SISR quality.
arXiv Detail & Related papers (2021-05-21T15:47:18Z) - SRDiff: Single Image Super-Resolution with Diffusion Probabilistic
Models [19.17571465274627]
Single image super-resolution (SISR) aims to reconstruct high-resolution (HR) images from the given low-resolution (LR) ones.
We propose a novel single image super-resolution diffusion probabilistic model (SRDiff)
SRDiff is optimized with a variant of the variational bound on the data likelihood and can provide diverse and realistic SR predictions.
arXiv Detail & Related papers (2021-04-30T12:31:25Z) - Super-Resolution of Real-World Faces [3.4376560669160394]
Real low-resolution (LR) face images contain degradations which are too varied and complex to be captured by known downsampling kernels.
In this paper, we propose a two module super-resolution network where the feature extractor module extracts robust features from the LR image.
We train a degradation GAN to convert bicubically downsampled clean images to real degraded images, and interpolate between the obtained degraded LR image and its clean LR counterpart.
arXiv Detail & Related papers (2020-11-04T17:25:54Z) - Benefiting from Bicubically Down-Sampled Images for Learning Real-World
Image Super-Resolution [22.339751911637077]
We propose to handle real-world SR by splitting this ill-posed problem into two comparatively more well-posed steps.
First, we train a network to transform real LR images to the space of bicubically downsampled images in a supervised manner.
Second, we take a generic SR network trained on bicubically downsampled images to super-resolve the transformed LR image.
arXiv Detail & Related papers (2020-07-06T20:27:58Z) - Cross-Scale Internal Graph Neural Network for Image Super-Resolution [147.77050877373674]
Non-local self-similarity in natural images has been well studied as an effective prior in image restoration.
For single image super-resolution (SISR), most existing deep non-local methods only exploit similar patches within the same scale of the low-resolution (LR) input image.
This is achieved using a novel cross-scale internal graph neural network (IGNN)
arXiv Detail & Related papers (2020-06-30T10:48:40Z) - Closed-loop Matters: Dual Regression Networks for Single Image
Super-Resolution [73.86924594746884]
Deep neural networks have exhibited promising performance in image super-resolution.
These networks learn a nonlinear mapping function from low-resolution (LR) images to high-resolution (HR) images.
We propose a dual regression scheme by introducing an additional constraint on LR data to reduce the space of the possible functions.
arXiv Detail & Related papers (2020-03-16T04:23:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.