Weakly Supervised Cloud Detection Combining Spectral Features and Multi-Scale Deep Network

• URL: http://arxiv.org/abs/2510.00654v1
• Date: Wed, 01 Oct 2025 08:32:49 GMT
• Title: Weakly Supervised Cloud Detection Combining Spectral Features and Multi-Scale Deep Network
• Authors: Shaocong Zhu, Zhiwei Li, Xinghua Li, Huanfeng Shen,
• Abstract summary: We propose a weakly supervised cloud detection method that combines spectral features and multi-scale scene-level deep network (SpecMCD) to obtain highly accurate pixel-level cloud masks.<n>The F1-score of the proposed SpecMCD method shows an improvement of over 7.82%, highlighting the superiority and potential of the SpecMCD method for cloud detection.
• Score: 12.520904004953344
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Clouds significantly affect the quality of optical satellite images, which seriously limits their precise application. Recently, deep learning has been widely applied to cloud detection and has achieved satisfactory results. However, the lack of distinctive features in thin clouds and the low quality of training samples limit the cloud detection accuracy of deep learning methods, leaving space for further improvements. In this paper, we propose a weakly supervised cloud detection method that combines spectral features and multi-scale scene-level deep network (SpecMCD) to obtain highly accurate pixel-level cloud masks. The method first utilizes a progressive training framework with a multi-scale scene-level dataset to train the multi-scale scene-level cloud detection network. Pixel-level cloud probability maps are then obtained by combining the multi-scale probability maps and cloud thickness map based on the characteristics of clouds in dense cloud coverage and large cloud-area coverage images. Finally, adaptive thresholds are generated based on the differentiated regions of the scene-level cloud masks at different scales and combined with distance-weighted optimization to obtain binary cloud masks. Two datasets, WDCD and GF1MS-WHU, comprising a total of 60 Gaofen-1 multispectral (GF1-MS) images, were used to verify the effectiveness of the proposed method. Compared to the other weakly supervised cloud detection methods such as WDCD and WSFNet, the F1-score of the proposed SpecMCD method shows an improvement of over 7.82%, highlighting the superiority and potential of the SpecMCD method for cloud detection under different cloud coverage conditions.

Related papers

• CBEN -- A Multimodal Machine Learning Dataset for Cloud Robust Remote Sensing Image Understanding [4.405830705915443]
  Cloudless analysis is often performed where cloudy images are excluded from machine learning datasets and methods.<n>Cloud robust methods can be achieved by combining optical data with radar, a modality unaffected by clouds.<n>We show that state-of-the-art methods trained on combined clear-sky optical and radar imagery suffer performance drops of 23-33 percentage points when evaluated on cloudy images.
  arXiv  Detail & Related papers  (2026-02-13T06:24:55Z)
• CloudMatch: Weak-to-Strong Consistency Learning for Semi-Supervised Cloud Detection [10.250611987029254]
  CloudMatch is a semi-supervised framework that effectively leverages unlabeled remote sensing imagery.<n>Our key insight is that enforcing prediction consistency across diversely augmented views, incorporating both inter-scene and intra-scene mixing.<n>Experiments show that CloudMatch achieves good performance, demonstrating its capability to utilize unlabeled data efficiently.
  arXiv  Detail & Related papers  (2026-01-07T02:31:17Z)
• Not every day is a sunny day: Synthetic cloud injection for deep land cover segmentation robustness evaluation across data sources [1.5052861873036498]
  Supervised deep learning for land cover semantic segmentation (LCS) relies on labeled satellite data.<n>Most existing Sentinel-2 datasets are cloud-free, which limits their usefulness in tropical regions where clouds are common.<n>We develop a cloud injection algorithm that simulates realistic cloud cover, allowing us to test how Sentinel-1 radar data can fill in the gaps caused by cloud-obstructed optical imagery.
  arXiv  Detail & Related papers  (2025-10-03T13:51:35Z)
• DiffPCN: Latent Diffusion Model Based on Multi-view Depth Images for Point Cloud Completion [63.89701893364156]
  We propose DiffPCN, a novel diffusion-based coarse-to-fine framework for point cloud completion.<n>Our approach comprises two stages: an initial stage for generating coarse point clouds, and a refinement stage that improves their quality.<n> Experimental results demonstrate that our DiffPCN achieves state-of-the-art performance in geometric accuracy and shape completeness.
  arXiv  Detail & Related papers  (2025-09-28T08:05:43Z)
• Point Cloud Compression with Implicit Neural Representations: A Unified Framework [54.119415852585306]
  We present a pioneering point cloud compression framework capable of handling both geometry and attribute components. Our framework utilizes two coordinate-based neural networks to implicitly represent a voxelized point cloud. Our method exhibits high universality when contrasted with existing learning-based techniques.
  arXiv  Detail & Related papers  (2024-05-19T09:19:40Z)
• IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-sensing Images [55.40601468843028]
  We present an iterative diffusion process for cloud removal (IDF-CR) IDF-CR is divided into two-stage models that address pixel space and latent space. In the latent space stage, the diffusion model transforms low-quality cloud removal into high-quality clean output.
  arXiv  Detail & Related papers  (2024-03-18T15:23:48Z)
• Point Cloud Pre-training with Diffusion Models [62.12279263217138]
  We propose a novel pre-training method called Point cloud Diffusion pre-training (PointDif) PointDif achieves substantial improvement across various real-world datasets for diverse downstream tasks such as classification, segmentation and detection.
  arXiv  Detail & Related papers  (2023-11-25T08:10:05Z)
• Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey [104.71816962689296]
  Unsupervised point cloud representation learning has attracted increasing attention due to the constraint in large-scale point cloud labelling. This paper provides a comprehensive review of unsupervised point cloud representation learning using deep neural networks.
  arXiv  Detail & Related papers  (2022-02-28T07:46:05Z)
• A lightweight deep learning based cloud detection method for Sentinel-2A imagery fusing multi-scale spectral and spatial features [17.914305435378783]
  We propose a lightweight network for cloud detection, fusing multi-scale spectral and spatial features (CDFM3SF) CDFM3SF outperforms traditional cloud detection methods and state-of-theart deep learning-based methods in both accuracy and speed.
  arXiv  Detail & Related papers  (2021-04-29T09:36:42Z)
• City-scale Scene Change Detection using Point Clouds [71.73273007900717]
  We propose a method for detecting structural changes in a city using images captured from mounted cameras over two different times. A direct comparison of the two point clouds for change detection is not ideal due to inaccurate geo-location information. To circumvent this problem, we propose a deep learning-based non-rigid registration on the point clouds. Experiments show that our method is able to detect scene changes effectively, even in the presence of viewpoint and illumination differences.
  arXiv  Detail & Related papers  (2021-03-26T08:04:13Z)
• Multi-Head Linear Attention Generative Adversarial Network for Thin Cloud Removal [5.753245638190626]
  thin cloud removal is an indispensable procedure to enhance the utilization of remote sensing images. We propose a Multi-Head Linear Attention Generative Adversarial Network (MLAGAN) for Thin Cloud Removal. Compared with six deep learning-based thin cloud removal benchmarks, the experimental results on the RICE1 and RICE2 datasets demonstrate that the proposed framework MLA-GAN has dominant advantages in thin cloud removal.
  arXiv  Detail & Related papers  (2020-12-20T11:50:54Z)
• Cloud detection machine learning algorithms for PROBA-V [6.950862982117125]
  The objective of the algorithms presented in this paper is to detect clouds accurately providing a cloud flag per pixel. The effectiveness of the proposed method is successfully illustrated using a large number of real Proba-V images.
  arXiv  Detail & Related papers  (2020-12-09T18:23:59Z)
• Thick Cloud Removal of Remote Sensing Images Using Temporal Smoothness and Sparsity-Regularized Tensor Optimization [3.65794756599491]
  In remote sensing images, the presence of thick cloud accompanying cloud shadow is a high probability event. A novel thick cloud removal method for remote sensing images based on temporal smoothness and sparsity-regularized tensor optimization is proposed.
  arXiv  Detail & Related papers  (2020-08-11T05:59:20Z)
• Single Image Cloud Detection via Multi-Image Fusion [23.641624507709274]
  A primary challenge in developing algorithms is the cost of collecting annotated training data. We demonstrate how recent advances in multi-image fusion can be leveraged to bootstrap single image cloud detection. We collect a large dataset of Sentinel-2 images along with a per-pixel semantic labelling for land cover.
  arXiv  Detail & Related papers  (2020-07-29T22:52:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.