Unsupervised Real Image Super-Resolution via Generative Variational AutoEncoder

• URL: http://arxiv.org/abs/2004.12811v1
• Date: Mon, 27 Apr 2020 13:49:36 GMT
• Title: Unsupervised Real Image Super-Resolution via Generative Variational AutoEncoder
• Authors: Zhi-Song Liu, Wan-Chi Siu, Li-Wen Wang, Chu-Tak Li, Marie-Paule Cani, Yui-Lam Chan
• Abstract summary: We revisit the classic example based image super-resolution approaches and come up with a novel generative model for perceptual image super-resolution. We propose a joint image denoising and super-resolution model via Variational AutoEncoder. With the aid of the discriminator, an additional overhead of super-resolution subnetwork is attached to super-resolve the denoised image with photo-realistic visual quality.
• Score: 47.53609520395504
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Benefited from the deep learning, image Super-Resolution has been one of the most developing research fields in computer vision. Depending upon whether using a discriminator or not, a deep convolutional neural network can provide an image with high fidelity or better perceptual quality. Due to the lack of ground truth images in real life, people prefer a photo-realistic image with low fidelity to a blurry image with high fidelity. In this paper, we revisit the classic example based image super-resolution approaches and come up with a novel generative model for perceptual image super-resolution. Given that real images contain various noise and artifacts, we propose a joint image denoising and super-resolution model via Variational AutoEncoder. We come up with a conditional variational autoencoder to encode the reference for dense feature vector which can then be transferred to the decoder for target image denoising. With the aid of the discriminator, an additional overhead of super-resolution subnetwork is attached to super-resolve the denoised image with photo-realistic visual quality. We participated the NTIRE2020 Real Image Super-Resolution Challenge. Experimental results show that by using the proposed approach, we can obtain enlarged images with clean and pleasant features compared to other supervised methods. We also compared our approach with state-of-the-art methods on various datasets to demonstrate the efficiency of our proposed unsupervised super-resolution model.

Related papers

• AccDiffusion: An Accurate Method for Higher-Resolution Image Generation [63.53163540340026]
  We propose AccDiffusion, an accurate method for patch-wise higher-resolution image generation without training. An in-depth analysis in this paper reveals an identical text prompt for different patches causes repeated object generation. Our AccDiffusion, for the first time, proposes to decouple the vanilla image-content-aware prompt into a set of patch-content-aware prompts.
  arXiv  Detail & Related papers  (2024-07-15T14:06:29Z)
• ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models [126.35334860896373]
  We investigate the capability of generating images from pre-trained diffusion models at much higher resolutions than the training image sizes. Existing works for higher-resolution generation, such as attention-based and joint-diffusion approaches, cannot well address these issues. We propose a simple yet effective re-dilation that can dynamically adjust the convolutional perception field during inference.
  arXiv  Detail & Related papers  (2023-10-11T17:52:39Z)
• Learning Enriched Features for Fast Image Restoration and Enhancement [166.17296369600774]
  This paper presents a holistic goal of maintaining spatially-precise high-resolution representations through the entire network. We learn an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details. Our approach achieves state-of-the-art results for a variety of image processing tasks, including defocus deblurring, image denoising, super-resolution, and image enhancement.
  arXiv  Detail & Related papers  (2022-04-19T17:59:45Z)
• High-Frequency aware Perceptual Image Enhancement [0.08460698440162888]
  We introduce a novel deep neural network suitable for multi-scale analysis and propose efficient model-agnostic methods. Our model can be applied to multi-scale image enhancement problems including denoising, deblurring and single image super-resolution.
  arXiv  Detail & Related papers  (2021-05-25T07:33:14Z)
• A Generative Model for Hallucinating Diverse Versions of Super Resolution Images [0.3222802562733786]
  We are tackling in this work the problem of obtaining different high-resolution versions from the same low-resolution image using Generative Adversarial Models. Our learning approach makes use of high frequencies available in the training high-resolution images for preserving and exploring in an unsupervised manner.
  arXiv  Detail & Related papers  (2021-02-12T17:11:42Z)
• Exploiting Raw Images for Real-Scene Super-Resolution [105.18021110372133]
  We study the problem of real-scene single image super-resolution to bridge the gap between synthetic data and real captured images. We propose a method to generate more realistic training data by mimicking the imaging process of digital cameras. We also develop a two-branch convolutional neural network to exploit the radiance information originally-recorded in raw images.
  arXiv  Detail & Related papers  (2021-02-02T16:10:15Z)
• Multi Scale Identity-Preserving Image-to-Image Translation Network for Low-Resolution Face Recognition [7.6702700993064115]
  We propose an identity-preserving end-to-end image-to-image translation deep neural network. It is capable of super-resolving very low-resolution faces to their high-resolution counterparts while preserving identity-related information.
  arXiv  Detail & Related papers  (2020-10-23T09:21:06Z)
• Deep Attentive Generative Adversarial Network for Photo-Realistic Image De-Quantization [25.805568996596783]
  De-quantization can improve the visual quality of low bit-depth image to display on high bit-depth screen. This paper proposes DAGAN algorithm to perform super-resolution on image intensity resolution. DenseResAtt module consists of dense residual blocks armed with self-attention mechanism.
  arXiv  Detail & Related papers  (2020-04-07T06:45:01Z)
• Learning Enriched Features for Real Image Restoration and Enhancement [166.17296369600774]
  convolutional neural networks (CNNs) have achieved dramatic improvements over conventional approaches for image restoration task. We present a novel architecture with the collective goals of maintaining spatially-precise high-resolution representations through the entire network. Our approach learns an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
  arXiv  Detail & Related papers  (2020-03-15T11:04:30Z)
• Perceptual Image Super-Resolution with Progressive Adversarial Network [17.289101902846358]
  Single Image Super-Resolution (SISR) aims to improve resolution of small-size low-quality image from a single one. In this paper, we argue that the curse of dimensionality is the underlying reason of limiting the performance of state-of-the-art algorithms. We propose Progressive Adversarial Network (PAN) that is capable of coping with this difficulty for domain-specific image super-resolution.
  arXiv  Detail & Related papers  (2020-03-08T10:19:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.