Semi-Supervised Super-Resolution

• URL: http://arxiv.org/abs/2204.08192v2
• Date: Tue, 19 Apr 2022 17:49:23 GMT
• Title: Semi-Supervised Super-Resolution
• Authors: Ankur Singh, Piyush Rai
• Abstract summary: Super-Resolution is the technique to improve the quality of a low-resolution photo by boosting its plausible resolution. Previous Super-Resolution methods require vast amounts of data for training which becomes problematic in domains where very few low-resolution, high-resolution pairs might be available. This paper introduces a semi-supervised way to perform super-resolution that can generate sharp, high-resolution images with as few as 500 paired examples.
• Score: 30.872605139672086
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Super-Resolution is the technique to improve the quality of a low-resolution photo by boosting its plausible resolution. The computer vision community has extensively explored the area of Super-Resolution. However, previous Super-Resolution methods require vast amounts of data for training which becomes problematic in domains where very few low-resolution, high-resolution pairs might be available. One such area is statistical downscaling, where super-resolution is increasingly being used to obtain high-resolution climate information from low-resolution data. Acquiring high-resolution climate data is extremely expensive and challenging. To reduce the cost of generating high-resolution climate information, Super-Resolution algorithms should be able to train with a limited number of low-resolution, high-resolution pairs. This paper tries to solve the aforementioned problem by introducing a semi-supervised way to perform super-resolution that can generate sharp, high-resolution images with as few as 500 paired examples. The proposed semi-supervised technique can be used as a plug-and-play module with any supervised GAN-based Super-Resolution method to enhance its performance. We quantitatively and qualitatively analyze the performance of the proposed model and compare it with completely supervised methods as well as other unsupervised techniques. Comprehensive evaluations show the superiority of our method over other methods on different metrics. We also offer the applicability of our approach in statistical downscaling to obtain high-resolution climate images.

Related papers

• ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution [84.73658185158222]
  We propose a diffusion model-based super-resolution method called ACDMSR. Our method adapts the standard diffusion model to perform super-resolution through a deterministic iterative denoising process. Our approach generates more visually realistic counterparts for low-resolution images, emphasizing its effectiveness in practical scenarios.
  arXiv  Detail & Related papers  (2023-07-03T06:49:04Z)
• LSwinSR: UAV Imagery Super-Resolution based on Linear Swin Transformer [7.3817359680010615]
  Super-resolution technology is especially beneficial for Unmanned Aerial Vehicles (UAV) In this paper, for the super-resolution of UAV images, a novel network based on the state-of-the-art Swin Transformer is proposed with better efficiency and competitive accuracy.
  arXiv  Detail & Related papers  (2023-03-17T20:14:10Z)
• How Real is Real: Evaluating the Robustness of Real-World Super Resolution [0.0]
  Super-resolution is a well-known problem as most methods rely on the downsampling method performed on the high-resolution image to form the low-resolution image to be known. We will evaluate multiple state-of-the-art super-resolution methods and gauge their performance when presented with various types of real-life images. We will present a potential solution to alleviate the generalization problem which is imminent in most state-of-the-art super-resolution models.
  arXiv  Detail & Related papers  (2022-10-22T18:53:45Z)
• Efficient High-Resolution Deep Learning: A Survey [90.76576712433595]
  Cameras in modern devices such as smartphones, satellites and medical equipment are capable of capturing very high resolution images and videos. Such high-resolution data often need to be processed by deep learning models for cancer detection, automated road navigation, weather prediction, surveillance, optimizing agricultural processes and many other applications. Using high-resolution images and videos as direct inputs for deep learning models creates many challenges due to their high number of parameters, computation cost, inference latency and GPU memory consumption. Several works in the literature propose better alternatives in order to deal with the challenges of high-resolution data and improve accuracy and speed while complying with hardware limitations
  arXiv  Detail & Related papers  (2022-07-26T17:13:53Z)
• Uncovering the Over-smoothing Challenge in Image Super-Resolution: Entropy-based Quantification and Contrastive Optimization [67.99082021804145]
  We propose an explicit solution to the COO problem, called Detail Enhanced Contrastive Loss (DECLoss) DECLoss utilizes the clustering property of contrastive learning to directly reduce the variance of the potential high-resolution distribution. We evaluate DECLoss on multiple super-resolution benchmarks and demonstrate that it improves the perceptual quality of PSNR-oriented models.
  arXiv  Detail & Related papers  (2022-01-04T08:30:09Z)
• Best-Buddy GANs for Highly Detailed Image Super-Resolution [71.13466303340192]
  We consider the single image super-resolution (SISR) problem, where a high-resolution (HR) image is generated based on a low-resolution (LR) input. Most methods along this line rely on a predefined single-LR-single-HR mapping, which is not flexible enough for the SISR task. We propose best-buddy GANs (Beby-GAN) for rich-detail SISR. Relaxing the immutable one-to-one constraint, we allow the estimated patches to dynamically seek the best supervision.
  arXiv  Detail & Related papers  (2021-03-29T02:58:27Z)
• A new public Alsat-2B dataset for single-image super-resolution [1.284647943889634]
  The paper introduces a novel public remote sensing dataset (Alsat2B) of low and high spatial resolution images (10m and 2.5m respectively) for the single-image super-resolution task. The high-resolution images are obtained through pan-sharpening. The obtained results reveal that the proposed scheme is promising and highlight the challenges in the dataset.
  arXiv  Detail & Related papers  (2021-03-21T10:47:38Z)
• A Generative Model for Hallucinating Diverse Versions of Super Resolution Images [0.3222802562733786]
  We are tackling in this work the problem of obtaining different high-resolution versions from the same low-resolution image using Generative Adversarial Models. Our learning approach makes use of high frequencies available in the training high-resolution images for preserving and exploring in an unsupervised manner.
  arXiv  Detail & Related papers  (2021-02-12T17:11:42Z)
• Deep Learning-based Face Super-resolution: A Survey [78.11274281686246]
  Face super-resolution, also known as face hallucination, is a domain-specific image super-resolution problem. To date, few summaries of the studies on the deep learning-based face super-resolution are available. In this survey, we present a comprehensive review of deep learning techniques in face super-resolution in a systematic manner.
  arXiv  Detail & Related papers  (2021-01-11T08:17:11Z)
• Joint-SRVDNet: Joint Super Resolution and Vehicle Detection Network [17.57284924547865]
  We propose a Joint Super-Resolution and Vehicle DetectionNetwork (Joint-SRVDNet) to generate discriminative, high-resolution images of vehicles. Aerial images are up-scaled by a factor of 4x using a Multi-scaleGenerative Adversarial Network (MsGAN), which has multiple intermediate outputs with increasingresolutions. The network jointlylearns hierarchical and discriminative features of targets and produces optimal super-resolution results.
  arXiv  Detail & Related papers  (2020-05-03T04:28:44Z)
• Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
  We propose a dual-branch convolutional neural network to extract base features and recovered features separately. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
  arXiv  Detail & Related papers  (2020-03-02T13:28:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.