Cloud removal in remote sensing images using generative adversarial networks and SAR-to-optical image translation

• URL: http://arxiv.org/abs/2012.12180v1
• Date: Tue, 22 Dec 2020 17:19:14 GMT
• Title: Cloud removal in remote sensing images using generative adversarial networks and SAR-to-optical image translation
• Authors: Faramarz Naderi Darbaghshahi, Mohammad Reza Mohammadi, Mohsen Soryani
• Abstract summary: Cloud removal has received much attention due to the wide range of satellite image applications. In this study, we attempt to solve the problem using two generative adversarial networks (GANs) The first translates SAR images into optical images, and the second removes clouds using the translated images of prior GAN.
• Score: 0.618778092044887
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Satellite images are often contaminated by clouds. Cloud removal has received much attention due to the wide range of satellite image applications. As the clouds thicken, the process of removing the clouds becomes more challenging. In such cases, using auxiliary images such as near-infrared or synthetic aperture radar (SAR) for reconstructing is common. In this study, we attempt to solve the problem using two generative adversarial networks (GANs). The first translates SAR images into optical images, and the second removes clouds using the translated images of prior GAN. Also, we propose dilated residual inception blocks (DRIBs) instead of vanilla U-net in the generator networks and use structural similarity index measure (SSIM) in addition to the L1 Loss function. Reducing the number of downsamplings and expanding receptive fields by dilated convolutions increase the quality of output images. We used the SEN1-2 dataset to train and test both GANs, and we made cloudy images by adding synthetic clouds to optical images. The restored images are evaluated with PSNR and SSIM. We compare the proposed method with state-of-the-art deep learning models and achieve more accurate results in both SAR-to-optical translation and cloud removal parts.

Related papers

• Removing cloud shadows from ground-based solar imagery [0.33748750222488655]
  We propose a new method to remove cloud shadows, based on a U-Net architecture, and compare classical supervision with conditional GAN. We evaluate our method on two different imaging modalities, using both real images and a new dataset of synthetic clouds.
  arXiv  Detail & Related papers  (2024-07-18T10:38:24Z)
• Few-shot point cloud reconstruction and denoising via learned Guassian splats renderings and fine-tuned diffusion features [52.62053703535824]
  We propose a method to reconstruct point clouds from few images and to denoise point clouds from their rendering. To improve reconstruction in constraint settings, we regularize the training of a differentiable with hybrid surface and appearance. We demonstrate how these learned filters can be used to remove point cloud noise coming without 3D supervision.
  arXiv  Detail & Related papers  (2024-04-01T13:38:16Z)
• IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-sensing Images [55.40601468843028]
  We present an iterative diffusion process for cloud removal (IDF-CR) IDF-CR is divided into two-stage models that address pixel space and latent space. In the latent space stage, the diffusion model transforms low-quality cloud removal into high-quality clean output.
  arXiv  Detail & Related papers  (2024-03-18T15:23:48Z)
• Dynamic Association Learning of Self-Attention and Convolution in Image Restoration [56.49098856632478]
  CNNs and Self attention have achieved great success in multimedia applications for dynamic association learning of self-attention and convolution in image restoration. This paper proposes an association learning method to utilize the advantages and suppress their shortcomings, so as to achieve high-quality and efficient inpainting.
  arXiv  Detail & Related papers  (2023-11-09T05:11:24Z)
• Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Dark [57.85378202032541]
  Rain in the dark poses a significant challenge to deploying real-world applications such as autonomous driving, surveillance systems, and night photography. Existing low-light enhancement or deraining methods struggle to brighten low-light conditions and remove rain simultaneously. We introduce an end-to-end model called L$2$RIRNet, designed to manage both low-light enhancement and deraining in real-world settings.
  arXiv  Detail & Related papers  (2023-05-06T10:17:42Z)
• MM811 Project Report: Cloud Detection and Removal in Satellite Images [0.0]
  We aim to address cloud removal from satellite images using AttentionGAN. We compare our results by reproducing the results obtained using traditional GANs and auto-encoders. The outcome of this project can be used to develop applications that require cloud-free satellite images.
  arXiv  Detail & Related papers  (2022-12-21T21:14:35Z)
• Exploring the Potential of SAR Data for Cloud Removal in Optical Satellite Imagery [41.40522618945897]
  We propose a novel global-local fusion based cloud removal (GLF-CR) algorithm to leverage the complementary information embedded in SAR images. The proposed algorithm can yield high quality cloud-free images and performs favorably against state-of-the-art cloud removal algorithms.
  arXiv  Detail & Related papers  (2022-06-06T18:53:19Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• Multi-Head Linear Attention Generative Adversarial Network for Thin Cloud Removal [5.753245638190626]
  thin cloud removal is an indispensable procedure to enhance the utilization of remote sensing images. We propose a Multi-Head Linear Attention Generative Adversarial Network (MLAGAN) for Thin Cloud Removal. Compared with six deep learning-based thin cloud removal benchmarks, the experimental results on the RICE1 and RICE2 datasets demonstrate that the proposed framework MLA-GAN has dominant advantages in thin cloud removal.
  arXiv  Detail & Related papers  (2020-12-20T11:50:54Z)
• Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance [78.34235841168031]
  We present a novel two-stage network with reflection-aware guidance (RAGNet) for single image reflection removal (SIRR) RAG can be used (i) to mitigate the effect of reflection from the observation, and (ii) to generate mask in partial convolution for mitigating the effect of deviating from linear combination hypothesis. Experiments on five commonly used datasets demonstrate the quantitative and qualitative superiority of our RAGNet in comparison to the state-of-the-art SIRR methods.
  arXiv  Detail & Related papers  (2020-12-02T03:14:57Z)
• Cloud and Cloud Shadow Segmentation for Remote Sensing Imagery via Filtered Jaccard Loss Function and Parametric Augmentation [8.37609145576126]
  Current methods for cloud/shadow identification in geospatial imagery are not as accurate as they should, especially in the presence of snow and haze. This paper presents a deep learning-based framework for the detection of cloud/shadow in Landsat 8 images.
  arXiv  Detail & Related papers  (2020-01-23T19:13:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.