Exploring the Potential of SAR Data for Cloud Removal in Optical Satellite Imagery

• URL: http://arxiv.org/abs/2206.02850v1
• Date: Mon, 6 Jun 2022 18:53:19 GMT
• Title: Exploring the Potential of SAR Data for Cloud Removal in Optical Satellite Imagery
• Authors: Fang Xu and Yilei Shi and Patrick Ebel and Lei Yu and Gui-Song Xia and Wen Yang and Xiao Xiang Zhu
• Abstract summary: We propose a novel global-local fusion based cloud removal (GLF-CR) algorithm to leverage the complementary information embedded in SAR images. The proposed algorithm can yield high quality cloud-free images and performs favorably against state-of-the-art cloud removal algorithms.
• Score: 41.40522618945897
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The challenge of the cloud removal task can be alleviated with the aid of Synthetic Aperture Radar (SAR) images that can penetrate cloud cover. However, the large domain gap between optical and SAR images as well as the severe speckle noise of SAR images may cause significant interference in SAR-based cloud removal, resulting in performance degeneration. In this paper, we propose a novel global-local fusion based cloud removal (GLF-CR) algorithm to leverage the complementary information embedded in SAR images. Exploiting the power of SAR information to promote cloud removal entails two aspects. The first, global fusion, guides the relationship among all local optical windows to maintain the structure of the recovered region consistent with the remaining cloud-free regions. The second, local fusion, transfers complementary information embedded in the SAR image that corresponds to cloudy areas to generate reliable texture details of the missing regions, and uses dynamic filtering to alleviate the performance degradation caused by speckle noise. Extensive evaluation demonstrates that the proposed algorithm can yield high quality cloud-free images and performs favorably against state-of-the-art cloud removal algorithms.

Related papers

• AllClear: A Comprehensive Dataset and Benchmark for Cloud Removal in Satellite Imagery [38.538566901989526]
  We introduce the largest public dataset -- $textitAllClear$ for cloud removal, featuring 23,742 globally distributed regions of interest. This dataset aims to provide comprehensive coverage of the Earth's surface and promote better cloud removal results.
  arXiv  Detail & Related papers  (2024-10-31T12:52:52Z)
• IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-sensing Images [55.40601468843028]
  We present an iterative diffusion process for cloud removal (IDF-CR) IDF-CR is divided into two-stage models that address pixel space and latent space. In the latent space stage, the diffusion model transforms low-quality cloud removal into high-quality clean output.
  arXiv  Detail & Related papers  (2024-03-18T15:23:48Z)
• Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery [48.14610248492785]
  Cloud layers severely compromise the quality and effectiveness of optical remote sensing (RS) images. Existing deep-learning (DL)-based Cloud Removal (CR) techniques encounter difficulties in accurately reconstructing the original visual authenticity and detailed semantic content of the images. This work proposes enhancements at the data and methodology fronts to tackle this challenge.
  arXiv  Detail & Related papers  (2024-01-25T13:14:17Z)
• Enhancing Low-light Light Field Images with A Deep Compensation Unfolding Network [52.77569396659629]
  This paper presents the deep compensation network unfolding (DCUNet) for restoring light field (LF) images captured under low-light conditions. The framework uses the intermediate enhanced result to estimate the illumination map, which is then employed in the unfolding process to produce a new enhanced result. To properly leverage the unique characteristics of LF images, this paper proposes a pseudo-explicit feature interaction module.
  arXiv  Detail & Related papers  (2023-08-10T07:53:06Z)
• Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Dark [57.85378202032541]
  Rain in the dark poses a significant challenge to deploying real-world applications such as autonomous driving, surveillance systems, and night photography. Existing low-light enhancement or deraining methods struggle to brighten low-light conditions and remove rain simultaneously. We introduce an end-to-end model called L$2$RIRNet, designed to manage both low-light enhancement and deraining in real-world settings.
  arXiv  Detail & Related papers  (2023-05-06T10:17:42Z)
• UnCRtainTS: Uncertainty Quantification for Cloud Removal in Optical Satellite Time Series [19.32220113046804]
  We introduce UnCRtainTS, a method for multi-temporal cloud removal combining a novel attention-based architecture. We show how the well-calibrated predicted uncertainties enable a precise control of the reconstruction quality.
  arXiv  Detail & Related papers  (2023-04-11T19:27:18Z)
• MM811 Project Report: Cloud Detection and Removal in Satellite Images [0.0]
  We aim to address cloud removal from satellite images using AttentionGAN. We compare our results by reproducing the results obtained using traditional GANs and auto-encoders. The outcome of this project can be used to develop applications that require cloud-free satellite images.
  arXiv  Detail & Related papers  (2022-12-21T21:14:35Z)
• Boosting Point Clouds Rendering via Radiance Mapping [49.24193509772339]
  We focus on boosting the image quality of point clouds rendering with a compact model design. We simplify the NeRF representation to a spatial mapping function which only requires single evaluation per pixel. Our method achieves the state-of-the-art rendering on point clouds, outperforming prior works by notable margins.
  arXiv  Detail & Related papers  (2022-10-27T01:25:57Z)
• Cloud removal in remote sensing images using generative adversarial networks and SAR-to-optical image translation [0.618778092044887]
  Cloud removal has received much attention due to the wide range of satellite image applications. In this study, we attempt to solve the problem using two generative adversarial networks (GANs) The first translates SAR images into optical images, and the second removes clouds using the translated images of prior GAN.
  arXiv  Detail & Related papers  (2020-12-22T17:19:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.