Fusion of Deep and Non-Deep Methods for Fast Super-Resolution of Satellite Images

• URL: http://arxiv.org/abs/2008.00878v1
• Date: Mon, 3 Aug 2020 13:55:39 GMT
• Title: Fusion of Deep and Non-Deep Methods for Fast Super-Resolution of Satellite Images
• Authors: Gaurav Kumar Nayak, Saksham Jain, R Venkatesh Babu, Anirban Chakraborty
• Abstract summary: This work proposes to bridge the gap between image quality and the price by improving the image quality via super-resolution (SR) We design an SR framework that analyzes the regional information content on each patch of the low-resolution image. We show substantial decrease in inference time while achieving similar performance to that of existing deep SR methods.
• Score: 54.44842669325082
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the emerging commercial space industry there is a drastic increase in access to low cost satellite imagery. The price for satellite images depends on the sensor quality and revisit rate. This work proposes to bridge the gap between image quality and the price by improving the image quality via super-resolution (SR). Recently, a number of deep SR techniques have been proposed to enhance satellite images. However, none of these methods utilize the region-level context information, giving equal importance to each region in the image. This, along with the fact that most state-of-the-art SR methods are complex and cumbersome deep models, the time taken to process very large satellite images can be impractically high. We, propose to handle this challenge by designing an SR framework that analyzes the regional information content on each patch of the low-resolution image and judiciously chooses to use more computationally complex deep models to super-resolve more structure-rich regions on the image, while using less resource-intensive non-deep methods on non-salient regions. Through extensive experiments on a large satellite image, we show substantial decrease in inference time while achieving similar performance to that of existing deep SR methods over several evaluation measures like PSNR, MSE and SSIM.

Related papers

• SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models [3.839322642354617]
  We propose a novel diffusion-based fusion algorithm called textbfSatDiffMoE. Our algorithm is highly flexible and allows training and inference on arbitrary number of low-resolution images. Experimental results show that our proposed SatDiffMoE method achieves superior performance for the satellite image super-resolution tasks.
  arXiv  Detail & Related papers  (2024-06-14T17:58:28Z)
• HRFNet: High-Resolution Forgery Network for Localizing Satellite Image Manipulation [16.668334854459143]
  Existing high-resolution satellite image forgery localization methods rely on patch-based or downsampling-based training. We propose a novel model called HRFNet to enable satellite image forgery localization effectively.
  arXiv  Detail & Related papers  (2023-07-20T17:33:57Z)
• Effectivity of super resolution convolutional neural network for the enhancement of land cover classification from medium resolution satellite images [0.0]
  Super-Resolution Convolutional Neural Network (SRCNN) will lessen the chance of misclassification of pixels, even under the established recognition methods. We tested the method on original LANDSAT-7 images of different regions of Sundarbans and their upscaled versions which were produced by bilinearvolution, bicubic, and SRCNN respectively.
  arXiv  Detail & Related papers  (2022-07-05T20:48:03Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis [66.50914391487747]
  We propose a new conditional pixel synthesis model that uses abundant, low-cost, low-resolution imagery to generate accurate high-resolution imagery. We show that our model attains photo-realistic sample quality and outperforms competing baselines on a key downstream task -- object counting.
  arXiv  Detail & Related papers  (2021-06-22T02:16:24Z)
• Unsupervised Remote Sensing Super-Resolution via Migration Image Prior [12.728430583409997]
  We propose a new unsupervised learning framework, called "MIP", which achieves super-resolution tasks without low/high resolution image pairs. In this paper, we show that MIP achieves significant improvements over state-of-the-art methods both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2021-05-08T03:29:35Z)
• High-resolution Depth Maps Imaging via Attention-based Hierarchical Multi-modal Fusion [84.24973877109181]
  We propose a novel attention-based hierarchical multi-modal fusion network for guided DSR. We show that our approach outperforms state-of-the-art methods in terms of reconstruction accuracy, running speed and memory efficiency.
  arXiv  Detail & Related papers  (2021-04-04T03:28:33Z)
• Super-Resolving Beyond Satellite Hardware Using Realistically Degraded Images [0.23090185577016442]
  We test the feasibility of using deep SR in real remote sensing payloads by assessing SR performance in reconstructing realistically degraded satellite images. We demonstrate that a state-of-the-art SR technique called Enhanced Deep Super-Resolution Network (EDSR) can recover encoded pixel data on images with poor ground sampling distance.
  arXiv  Detail & Related papers  (2021-03-10T00:20:33Z)
• Frequency Consistent Adaptation for Real World Super Resolution [64.91914552787668]
  We propose a novel Frequency Consistent Adaptation (FCA) that ensures the frequency domain consistency when applying Super-Resolution (SR) methods to the real scene. We estimate degradation kernels from unsupervised images and generate the corresponding Low-Resolution (LR) images. Based on the domain-consistent LR-HR pairs, we train easy-implemented Convolutional Neural Network (CNN) SR models.
  arXiv  Detail & Related papers  (2020-12-18T08:25:39Z)
• HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagery [55.253395881190436]
  Multi-frame Super-Resolution (MFSR) offers a more grounded approach to the ill-posed problem. This is important for satellite monitoring of human impact on the planet. We present HighRes-net, the first deep learning approach to MFSR that learns its sub-tasks in an end-to-end fashion.
  arXiv  Detail & Related papers  (2020-02-15T22:17:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.