Multi-Spectral Multi-Image Super-Resolution of Sentinel-2 with Radiometric Consistency Losses and Its Effect on Building Delineation

• URL: http://arxiv.org/abs/2111.03231v1
• Date: Fri, 5 Nov 2021 02:49:04 GMT
• Title: Multi-Spectral Multi-Image Super-Resolution of Sentinel-2 with Radiometric Consistency Losses and Its Effect on Building Delineation
• Authors: Muhammed Razzak, Gonzalo Mateo-Garcia, Luis G\'omez-Chova, Yarin Gal, Freddie Kalaitzis
• Abstract summary: We present the first results of applying multi-image super-resolution (MISR) to multi-spectral remote sensing imagery. We show that MISR is superior to single-image super-resolution and other baselines on a range of image fidelity metrics.
• Score: 23.025397327720874
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: High resolution remote sensing imagery is used in broad range of tasks, including detection and classification of objects. High-resolution imagery is however expensive, while lower resolution imagery is often freely available and can be used by the public for range of social good applications. To that end, we curate a multi-spectral multi-image super-resolution dataset, using PlanetScope imagery from the SpaceNet 7 challenge as the high resolution reference and multiple Sentinel-2 revisits of the same imagery as the low-resolution imagery. We present the first results of applying multi-image super-resolution (MISR) to multi-spectral remote sensing imagery. We, additionally, introduce a radiometric consistency module into MISR model the to preserve the high radiometric resolution of the Sentinel-2 sensor. We show that MISR is superior to single-image super-resolution and other baselines on a range of image fidelity metrics. Furthermore, we conduct the first assessment of the utility of multi-image super-resolution on building delineation, showing that utilising multiple images results in better performance in these downstream tasks.

Related papers

• Self-Supervised Learning for Real-World Super-Resolution from Dual and Multiple Zoomed Observations [61.448005005426666]
  We consider two challenging issues in reference-based super-resolution (RefSR) for smartphone. We propose a novel self-supervised learning approach for real-world RefSR from observations at dual and multiple camera zooms.
  arXiv  Detail & Related papers  (2024-05-03T15:20:30Z)
• Cross-sensor super-resolution of irregularly sampled Sentinel-2 time series [2.9748898344267785]
  We introduce BreizhSR, a new dataset for 4x super-resolution of Sentinel-2 time series. We show that using multiple images significantly improves super-resolution performance. We observe a trade-off between spectral fidelity and perceptual quality of the reconstructed HR images.
  arXiv  Detail & Related papers  (2024-04-25T08:36:09Z)
• Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI [23.50915512118989]
  Multi-contrast Super-Resolution (SR) reconstruction is promising to yield SR images with higher quality. radiologists are accustomed to zooming the MR images at arbitrary scales rather than using a fixed scale. We propose an implicit neural representations based dual-arbitrary multi-contrast MRI super-resolution method, called Dual-ArbNet.
  arXiv  Detail & Related papers  (2023-07-05T14:43:26Z)
• Multi-Modal and Multi-Resolution Data Fusion for High-Resolution Cloud Removal: A Novel Baseline and Benchmark [21.255966041023083]
  We introduce M3R-CR, a benchmark dataset for high-resolution Cloud Removal with Multi-Modal and Multi-Resolution data fusion. We consider the problem of cloud removal in high-resolution optical remote sensing imagery by integrating multi-modal and multi-resolution information. We design a new baseline named Align-CR to perform the low-resolution SAR image guided high-resolution optical image cloud removal.
  arXiv  Detail & Related papers  (2023-01-09T15:31:28Z)
• MuS2: A Benchmark for Sentinel-2 Multi-Image Super-Resolution [6.480645418615952]
  Insufficient spatial resolution of satellite imagery, including Sentinel-2 data, is a serious limitation in many practical use cases. Super-resolution reconstruction is receiving considerable attention from the remote sensing community. We introduce a new MuS2 benchmark for multi-image super-resolution reconstruction of Sentinel-2 images.
  arXiv  Detail & Related papers  (2022-10-06T08:29:54Z)
• Decoupled-and-Coupled Networks: Self-Supervised Hyperspectral Image Super-Resolution with Subpixel Fusion [67.35540259040806]
  We propose a subpixel-level HS super-resolution framework by devising a novel decoupled-and-coupled network, called DCNet. As the name suggests, DC-Net first decouples the input into common (or cross-sensor) and sensor-specific components. We append a self-supervised learning module behind the CSU net by guaranteeing the material consistency to enhance the detailed appearances of the restored HS product.
  arXiv  Detail & Related papers  (2022-05-07T23:40:36Z)
• Dual-Camera Super-Resolution with Aligned Attention Modules [56.54073689003269]
  We present a novel approach to reference-based super-resolution (RefSR) with the focus on dual-camera super-resolution (DCSR) Our proposed method generalizes the standard patch-based feature matching with spatial alignment operations. To bridge the domain gaps between real-world images and the training images, we propose a self-supervised domain adaptation strategy.
  arXiv  Detail & Related papers  (2021-09-03T07:17:31Z)
• Joint-SRVDNet: Joint Super Resolution and Vehicle Detection Network [17.57284924547865]
  We propose a Joint Super-Resolution and Vehicle DetectionNetwork (Joint-SRVDNet) to generate discriminative, high-resolution images of vehicles. Aerial images are up-scaled by a factor of 4x using a Multi-scaleGenerative Adversarial Network (MsGAN), which has multiple intermediate outputs with increasingresolutions. The network jointlylearns hierarchical and discriminative features of targets and produces optimal super-resolution results.
  arXiv  Detail & Related papers  (2020-05-03T04:28:44Z)
• Learning Enriched Features for Real Image Restoration and Enhancement [166.17296369600774]
  convolutional neural networks (CNNs) have achieved dramatic improvements over conventional approaches for image restoration task. We present a novel architecture with the collective goals of maintaining spatially-precise high-resolution representations through the entire network. Our approach learns an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
  arXiv  Detail & Related papers  (2020-03-15T11:04:30Z)
• DDet: Dual-path Dynamic Enhancement Network for Real-World Image Super-Resolution [69.2432352477966]
  Real image super-resolution(Real-SR) focus on the relationship between real-world high-resolution(HR) and low-resolution(LR) image. In this article, we propose a Dual-path Dynamic Enhancement Network(DDet) for Real-SR. Unlike conventional methods which stack up massive convolutional blocks for feature representation, we introduce a content-aware framework to study non-inherently aligned image pair.
  arXiv  Detail & Related papers  (2020-02-25T18:24:51Z)
• HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagery [55.253395881190436]
  Multi-frame Super-Resolution (MFSR) offers a more grounded approach to the ill-posed problem. This is important for satellite monitoring of human impact on the planet. We present HighRes-net, the first deep learning approach to MFSR that learns its sub-tasks in an end-to-end fashion.
  arXiv  Detail & Related papers  (2020-02-15T22:17:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.