MuS2: A Benchmark for Sentinel-2 Multi-Image Super-Resolution

• URL: http://arxiv.org/abs/2210.02745v1
• Date: Thu, 6 Oct 2022 08:29:54 GMT
• Title: MuS2: A Benchmark for Sentinel-2 Multi-Image Super-Resolution
• Authors: Pawel Kowaleczko, Tomasz Tarasiewicz, Maciej Ziaja, Daniel Kostrzewa, Jakub Nalepa, Przemyslaw Rokita, Michal Kawulok
• Abstract summary: Insufficient spatial resolution of satellite imagery, including Sentinel-2 data, is a serious limitation in many practical use cases. Super-resolution reconstruction is receiving considerable attention from the remote sensing community. We introduce a new MuS2 benchmark for multi-image super-resolution reconstruction of Sentinel-2 images.
• Score: 6.480645418615952
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Insufficient spatial resolution of satellite imagery, including Sentinel-2 data, is a serious limitation in many practical use cases. To mitigate this problem, super-resolution reconstruction is receiving considerable attention from the remote sensing community. When it is performed from multiple images captured at subsequent revisits, it may benefit from information fusion, leading to enhanced reconstruction accuracy. One of the obstacles in multi-image super-resolution consists in the scarcity of real-life benchmark datasets -- most of the research was performed for simulated data which do not fully reflect the operating conditions. In this letter, we introduce a new MuS2 benchmark for multi-image super-resolution reconstruction of Sentinel-2 images, with WorldView-2 imagery used as the high-resolution reference. Within MuS2, we publish the first end-to-end evaluation procedure for this problem which we expect to help the researchers in advancing the state of the art in multi-image super-resolution for Sentinel-2 imagery.

Related papers

• Self-Supervised Learning for Real-World Super-Resolution from Dual and Multiple Zoomed Observations [61.448005005426666]
  We consider two challenging issues in reference-based super-resolution (RefSR) for smartphone. We propose a novel self-supervised learning approach for real-world RefSR from observations at dual and multiple camera zooms.
  arXiv  Detail & Related papers  (2024-05-03T15:20:30Z)
• Cross-sensor super-resolution of irregularly sampled Sentinel-2 time series [2.9748898344267785]
  We introduce BreizhSR, a new dataset for 4x super-resolution of Sentinel-2 time series. We show that using multiple images significantly improves super-resolution performance. We observe a trade-off between spectral fidelity and perceptual quality of the reconstructed HR images.
  arXiv  Detail & Related papers  (2024-04-25T08:36:09Z)
• On The Role of Alias and Band-Shift for Sentinel-2 Super-Resolution [5.897281612951907]
  In this work, we study the problem of single-image super-resolution (SISR) of Sentinel-2 imagery. We show that thanks to its unique sensor specification, namely the inter-band shift and alias, that deep-learning methods are able to recover fine details.
  arXiv  Detail & Related papers  (2023-02-22T17:08:45Z)
• Multitemporal and multispectral data fusion for super-resolution of Sentinel-2 images [11.169492436455423]
  DeepSent is a new deep network for super-resolving multitemporal series of Sentinel-2 images. We show that our solution outperforms other state-of-the-art techniques that realize either multitemporal or multispectral data fusion. We have applied our method to super-resolve real-world Sentinel-2 images, enhancing the spatial resolution of all the spectral bands to 3.3 m nominal ground sampling distance.
  arXiv  Detail & Related papers  (2023-01-26T15:01:25Z)
• Reference-based Image and Video Super-Resolution via C2-Matching [100.0808130445653]
  We propose C2-Matching, which performs explicit robust matching crossing transformation and resolution. C2-Matching significantly outperforms state of the arts on the standard CUFED5 benchmark. We also extend C2-Matching to Reference-based Video Super-Resolution task, where an image taken in a similar scene serves as the HR reference image.
  arXiv  Detail & Related papers  (2022-12-19T16:15:02Z)
• Multi-Spectral Multi-Image Super-Resolution of Sentinel-2 with Radiometric Consistency Losses and Its Effect on Building Delineation [23.025397327720874]
  We present the first results of applying multi-image super-resolution (MISR) to multi-spectral remote sensing imagery. We show that MISR is superior to single-image super-resolution and other baselines on a range of image fidelity metrics.
  arXiv  Detail & Related papers  (2021-11-05T02:49:04Z)
• Dual-Camera Super-Resolution with Aligned Attention Modules [56.54073689003269]
  We present a novel approach to reference-based super-resolution (RefSR) with the focus on dual-camera super-resolution (DCSR) Our proposed method generalizes the standard patch-based feature matching with spatial alignment operations. To bridge the domain gaps between real-world images and the training images, we propose a self-supervised domain adaptation strategy.
  arXiv  Detail & Related papers  (2021-09-03T07:17:31Z)
• Robust Reference-based Super-Resolution via C2-Matching [77.51610726936657]
  Super-Resolution (Ref-SR) has recently emerged as a promising paradigm to enhance a low-resolution (LR) input image by introducing an additional high-resolution (HR) reference image. Existing Ref-SR methods mostly rely on implicit correspondence matching to borrow HR textures from reference images to compensate for the information loss in input images. We propose C2-Matching, which produces explicit robust matching crossing transformation and resolution.
  arXiv  Detail & Related papers  (2021-06-03T16:40:36Z)
• Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
  We propose a dual-branch convolutional neural network to extract base features and recovered features separately. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
  arXiv  Detail & Related papers  (2020-03-02T13:28:32Z)
• HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagery [55.253395881190436]
  Multi-frame Super-Resolution (MFSR) offers a more grounded approach to the ill-posed problem. This is important for satellite monitoring of human impact on the planet. We present HighRes-net, the first deep learning approach to MFSR that learns its sub-tasks in an end-to-end fashion.
  arXiv  Detail & Related papers  (2020-02-15T22:17:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.