Exploiting Raw Images for Real-Scene Super-Resolution

• URL: http://arxiv.org/abs/2102.01579v1
• Date: Tue, 2 Feb 2021 16:10:15 GMT
• Title: Exploiting Raw Images for Real-Scene Super-Resolution
• Authors: Xiangyu Xu, Yongrui Ma, Wenxiu Sun, Ming-Hsuan Yang
• Abstract summary: We study the problem of real-scene single image super-resolution to bridge the gap between synthetic data and real captured images. We propose a method to generate more realistic training data by mimicking the imaging process of digital cameras. We also develop a two-branch convolutional neural network to exploit the radiance information originally-recorded in raw images.
• Score: 105.18021110372133
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Super-resolution is a fundamental problem in computer vision which aims to overcome the spatial limitation of camera sensors. While significant progress has been made in single image super-resolution, most algorithms only perform well on synthetic data, which limits their applications in real scenarios. In this paper, we study the problem of real-scene single image super-resolution to bridge the gap between synthetic data and real captured images. We focus on two issues of existing super-resolution algorithms: lack of realistic training data and insufficient utilization of visual information obtained from cameras. To address the first issue, we propose a method to generate more realistic training data by mimicking the imaging process of digital cameras. For the second issue, we develop a two-branch convolutional neural network to exploit the radiance information originally-recorded in raw images. In addition, we propose a dense channel-attention block for better image restoration as well as a learning-based guided filter network for effective color correction. Our model is able to generalize to different cameras without deliberately training on images from specific camera types. Extensive experiments demonstrate that the proposed algorithm can recover fine details and clear structures, and achieve high-quality results for single image super-resolution in real scenes.

Related papers

• Iris super-resolution using CNNs: is photo-realism important to iris recognition? [67.42500312968455]
  Single image super-resolution techniques are emerging, especially with the use of convolutional neural networks (CNNs) In this work, the authors explore single image super-resolution using CNNs for iris recognition. They validate their approach on a database of 1.872 near infrared iris images and on a mobile phone image database.
  arXiv  Detail & Related papers  (2022-10-24T11:19:18Z)
• High Dynamic Range and Super-Resolution from Raw Image Bursts [52.341483902624006]
  This paper introduces the first approach to reconstruct high-resolution, high-dynamic range color images from raw photographic bursts captured by a handheld camera with exposure bracketing. The proposed algorithm is fast, with low memory requirements compared to state-of-the-art learning-based approaches to image restoration. Experiments demonstrate its excellent performance with super-resolution factors of up to $times 4$ on real photographs taken in the wild with hand-held cameras.
  arXiv  Detail & Related papers  (2022-07-29T13:31:28Z)
• RBSRICNN: Raw Burst Super-Resolution through Iterative Convolutional Neural Network [23.451063587138393]
  We propose a Raw Burst Super-Resolution Iterative Convolutional Neural Network (RBSRICNN) The proposed network produces the final output by an iterative refinement of the intermediate SR estimates. We demonstrate the effectiveness of our proposed approach in quantitative and qualitative experiments.
  arXiv  Detail & Related papers  (2021-10-25T19:01:28Z)
• Dual-reference Training Data Acquisition and CNN Construction for Image Super-Resolution [33.388234549922025]
  We propose a novel method to capture a large set of realistic LR$sim$HR image pairs using real cameras. Our innovation is to shoot images displayed on an ultra-high quality screen at different resolutions. Experimental results show that training a super-resolution CNN by our LR$sim$HR dataset has superior restoration performance than training it by existing datasets on real world images.
  arXiv  Detail & Related papers  (2021-08-05T03:31:50Z)
• Unsupervised Real Image Super-Resolution via Generative Variational AutoEncoder [47.53609520395504]
  We revisit the classic example based image super-resolution approaches and come up with a novel generative model for perceptual image super-resolution. We propose a joint image denoising and super-resolution model via Variational AutoEncoder. With the aid of the discriminator, an additional overhead of super-resolution subnetwork is attached to super-resolve the denoised image with photo-realistic visual quality.
  arXiv  Detail & Related papers  (2020-04-27T13:49:36Z)
• ImagePairs: Realistic Super Resolution Dataset via Beam Splitter Camera Rig [13.925480922578869]
  We propose a new data acquisition technique for gathering real image data set. We use a beam-splitter to capture the same scene by a low resolution camera and a high resolution camera. Unlike current small-scale dataset used for these tasks, our proposed dataset includes 11,421 pairs of low-resolution high-resolution images.
  arXiv  Detail & Related papers  (2020-04-18T03:06:41Z)
• PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models [77.32079593577821]
  PULSE (Photo Upsampling via Latent Space Exploration) generates high-resolution, realistic images at resolutions previously unseen in the literature. Our method outperforms state-of-the-art methods in perceptual quality at higher resolutions and scale factors than previously possible.
  arXiv  Detail & Related papers  (2020-03-08T16:44:31Z)
• Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
  We propose a dual-branch convolutional neural network to extract base features and recovered features separately. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
  arXiv  Detail & Related papers  (2020-03-02T13:28:32Z)
• Self-Supervised Linear Motion Deblurring [112.75317069916579]
  Deep convolutional neural networks are state-of-the-art for image deblurring. We present a differentiable reblur model for self-supervised motion deblurring. Our experiments demonstrate that self-supervised single image deblurring is really feasible.
  arXiv  Detail & Related papers  (2020-02-10T20:15:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.