Multi-Sensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagery

• URL: http://arxiv.org/abs/2009.07683v1
• Date: Wed, 16 Sep 2020 13:40:42 GMT
• Title: Multi-Sensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagery
• Authors: Patrick Ebel, Andrea Meraner, Michael Schmitt, Xiaoxiang Zhu
• Abstract summary: The majority of optical observations acquired via spaceborne earth imagery are affected by clouds. We target the challenge of generalization by curating a large novel data set for training new cloud removal approaches. Based on the observation that cloud coverage varies widely between clear skies and absolute coverage, we propose a novel model that can deal with either extremes.
• Score: 15.459106705735376
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This work has been accepted by IEEE TGRS for publication. The majority of optical observations acquired via spaceborne earth imagery are affected by clouds. While there is numerous prior work on reconstructing cloud-covered information, previous studies are oftentimes confined to narrowly-defined regions of interest, raising the question of whether an approach can generalize to a diverse set of observations acquired at variable cloud coverage or in different regions and seasons. We target the challenge of generalization by curating a large novel data set for training new cloud removal approaches and evaluate on two recently proposed performance metrics of image quality and diversity. Our data set is the first publically available to contain a global sample of co-registered radar and optical observations, cloudy as well as cloud-free. Based on the observation that cloud coverage varies widely between clear skies and absolute coverage, we propose a novel model that can deal with either extremes and evaluate its performance on our proposed data set. Finally, we demonstrate the superiority of training models on real over synthetic data, underlining the need for a carefully curated data set of real observations. To facilitate future research, our data set is made available online

Related papers

• Zero-shot Point Cloud Completion Via 2D Priors [52.72867922938023]
  3D point cloud completion is designed to recover complete shapes from partially observed point clouds. We propose a zero-shot framework aimed at completing partially observed point clouds across any unseen categories.
  arXiv  Detail & Related papers  (2024-04-10T08:02:17Z)
• SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation [69.42764583465508]
  We explore the potential of generative image diffusion to address the scarcity of annotated data in earth observation tasks. To the best of our knowledge, we are the first to generate both images and corresponding masks for satellite segmentation.
  arXiv  Detail & Related papers  (2024-03-25T10:30:22Z)
• Creating and Leveraging a Synthetic Dataset of Cloud Optical Thickness Measures for Cloud Detection in MSI [3.4764766275808583]
  Cloud formations often obscure optical satellite-based monitoring of the Earth's surface. We propose a novel synthetic dataset for cloud optical thickness estimation. We leverage for obtaining reliable and versatile cloud masks on real data.
  arXiv  Detail & Related papers  (2023-11-23T14:28:28Z)
• Segment Any Point Cloud Sequences by Distilling Vision Foundation Models [55.12618600523729]
  Seal is a framework that harnesses vision foundation models (VFMs) for segmenting diverse automotive point cloud sequences. Seal exhibits three appealing properties: Scalability, consistency and generalizability.
  arXiv  Detail & Related papers  (2023-06-15T17:59:54Z)
• Exploring the Application of Large-scale Pre-trained Models on Adverse Weather Removal [97.53040662243768]
  We propose a CLIP embedding module to make the network handle different weather conditions adaptively. This module integrates the sample specific weather prior extracted by CLIP image encoder together with the distribution specific information learned by a set of parameters.
  arXiv  Detail & Related papers  (2023-06-15T10:06:13Z)
• Effective Utilisation of Multiple Open-Source Datasets to Improve Generalisation Performance of Point Cloud Segmentation Models [0.0]
  Semantic segmentation of aerial point cloud data can be utilised to differentiate which points belong to classes such as ground, buildings, or vegetation. Point clouds generated from aerial sensors mounted to drones or planes can utilise LIDAR sensors or cameras along with photogrammetry. We show that a naive combination of datasets produces a model with improved generalisation performance as expected.
  arXiv  Detail & Related papers  (2022-11-29T02:31:01Z)
• Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey [104.71816962689296]
  Unsupervised point cloud representation learning has attracted increasing attention due to the constraint in large-scale point cloud labelling. This paper provides a comprehensive review of unsupervised point cloud representation learning using deep neural networks.
  arXiv  Detail & Related papers  (2022-02-28T07:46:05Z)
• A Recommender System-Inspired Cloud Data Filling Scheme for Satellite-based Coastal Observation [0.0]
  This study is inspired by the success of data imputation methods in recommender systems that are designed for online shopping. A numerical experiment was designed and conducted for a LandSat dataset with a range of synthetic cloud covers. The recommender system-inspired matrix factorization algorithm called Funk-SVD showed superior performance in computational accuracy and efficiency.
  arXiv  Detail & Related papers  (2021-11-27T18:26:11Z)
• Sentinel-1 and Sentinel-2 Spatio-Temporal Data Fusion for Clouds Removal [51.9654625216266]
  A novel method for clouds-corrupted optical image restoration has been presented and developed based on a joint data fusion paradigm. It is worth highlighting that the Sentinel code and the dataset have been implemented from scratch and made available to interested research for further analysis and investigation.
  arXiv  Detail & Related papers  (2021-06-23T08:15:01Z)
• Data-driven Cloud Clustering via a Rotationally Invariant Autoencoder [10.660968055962325]
  We describe an automated rotation-invariant cloud clustering (RICC) method. It organizes cloud imagery within large datasets in an unsupervised fashion. Results suggest that the resultant cloud clusters capture meaningful aspects of cloud physics.
  arXiv  Detail & Related papers  (2021-03-08T16:45:14Z)
• CloudCast: A Satellite-Based Dataset and Baseline for Forecasting Clouds [0.0]
  In this paper, we present a novel satellite-based dataset called CloudCast''. It consists of 70,080 images with 10 different cloud types for multiple layers of the atmosphere annotated on a pixel level. The spatial resolution of the dataset is 928 x 1530 pixels (3x3 km per pixel) with 15-min intervals between frames for the period 2017-01-01 to 2018-12-31.
  arXiv  Detail & Related papers  (2020-07-15T20:20:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.