Joint Retrieval of Cloud properties using Attention-based Deep Learning Models

• URL: http://arxiv.org/abs/2504.03133v2
• Date: Wed, 09 Apr 2025 13:19:52 GMT
• Title: Joint Retrieval of Cloud properties using Attention-based Deep Learning Models
• Authors: Zahid Hassan Tushar, Adeleke Ademakinwa, Jianwu Wang, Zhibo Zhang, Sanjay Purushotham,
• Abstract summary: We introduce CloudUNet with Attention Module (CAM), a compact UNet-based model that employs attention mechanisms to reduce errors in thick, overlapping cloud regions.<n>Our CAM model outperforms state-of-the-art deep learning methods, reducing mean absolute errors (MAE) by 34% for COT and 42% for CER, and achieving 76% and 86% lower MAE for COT and CER retrievals compared to the IPA method.
• Score: 7.86932319873743
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate cloud property retrieval is vital for understanding cloud behavior and its impact on climate, including applications in weather forecasting, climate modeling, and estimating Earth's radiation balance. The Independent Pixel Approximation (IPA), a widely used physics-based approach, simplifies radiative transfer calculations by assuming each pixel is independent of its neighbors. While computationally efficient, IPA has significant limitations, such as inaccuracies from 3D radiative effects, errors at cloud edges, and ineffectiveness for overlapping or heterogeneous cloud fields. Recent AI/ML-based deep learning models have improved retrieval accuracy by leveraging spatial relationships across pixels. However, these models are often memory-intensive, retrieve only a single cloud property, or struggle with joint property retrievals. To overcome these challenges, we introduce CloudUNet with Attention Module (CAM), a compact UNet-based model that employs attention mechanisms to reduce errors in thick, overlapping cloud regions and a specialized loss function for joint retrieval of Cloud Optical Thickness (COT) and Cloud Effective Radius (CER). Experiments on a Large Eddy Simulation (LES) dataset show that our CAM model outperforms state-of-the-art deep learning methods, reducing mean absolute errors (MAE) by 34% for COT and 42% for CER, and achieving 76% and 86% lower MAE for COT and CER retrievals compared to the IPA method.

Related papers

• MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling [68.69647625472464]
  Downscaling, a crucial task in meteorological forecasting, enables the reconstruction of high-resolution meteorological states for target regions. Previous downscaling methods lacked tailored designs for meteorology and encountered structural limitations. We propose a novel model called MambaDS, which enhances the utilization of multivariable correlations and topography information.
  arXiv  Detail & Related papers  (2024-08-20T13:45:49Z)
• Distilling Machine Learning's Added Value: Pareto Fronts in Atmospheric Applications [0.3696370044051793]
  Inspired by climate model hierarchies, we propose that a full hierarchy of Pareto-optimal models can guide model development and help understand the models' added value.<n>We demonstrate the use of Pareto fronts in atmospheric physics through three sample applications, with hierarchies ranging from semi-empirical models with minimal parameters to deep learning algorithms.
  arXiv  Detail & Related papers  (2024-08-04T23:05:42Z)
• Learned 3D volumetric recovery of clouds and its uncertainty for climate analysis [16.260663741590253]
  Uncertainty in climate prediction and cloud physics is tied to observational gaps relating to shallow scattered clouds. We design a learning-based model (ProbCT) to achieve CT of such clouds, based on noisy multi-view spaceborne images. We demonstrate the approach in simulations and on real-world data, and indicate the relevance of 3D recovery and uncertainty to precipitation and renewable energy.
  arXiv  Detail & Related papers  (2024-03-09T14:57:03Z)
• ModelNet-O: A Large-Scale Synthetic Dataset for Occlusion-Aware Point Cloud Classification [28.05358017259757]
  We propose ModelNet-O, a large-scale synthetic dataset of 123,041 samples. ModelNet-O emulates real-world point clouds with self-occlusion caused by scanning from monocular cameras. We propose a robust point cloud processing method called PointMLS.
  arXiv  Detail & Related papers  (2024-01-16T08:54:21Z)
• Creating and Leveraging a Synthetic Dataset of Cloud Optical Thickness Measures for Cloud Detection in MSI [3.4764766275808583]
  Cloud formations often obscure optical satellite-based monitoring of the Earth's surface. We propose a novel synthetic dataset for cloud optical thickness estimation. We leverage for obtaining reliable and versatile cloud masks on real data.
  arXiv  Detail & Related papers  (2023-11-23T14:28:28Z)
• Bidirectional Knowledge Reconfiguration for Lightweight Point Cloud Analysis [74.00441177577295]
  Point cloud analysis faces computational system overhead, limiting its application on mobile or edge devices. This paper explores feature distillation for lightweight point cloud models. We propose bidirectional knowledge reconfiguration to distill informative contextual knowledge from the teacher to the student.
  arXiv  Detail & Related papers  (2023-10-08T11:32:50Z)
• StarNet: Style-Aware 3D Point Cloud Generation [82.30389817015877]
  StarNet is able to reconstruct and generate high-fidelity and even 3D point clouds using a mapping network. Our framework achieves comparable state-of-the-art performance on various metrics in the point cloud reconstruction and generation tasks.
  arXiv  Detail & Related papers  (2023-03-28T08:21:44Z)
• Cloud removal Using Atmosphere Model [7.259230333873744]
  Cloud removal is an essential task in remote sensing data analysis. We propose to use scattering model for temporal sequence of images of any scene in the framework of low rank and sparse models. We develop a semi-realistic simulation method to produce cloud cover so that various methods can be quantitatively analysed.
  arXiv  Detail & Related papers  (2022-10-05T01:29:19Z)
• Deep Learning Based Cloud Cover Parameterization for ICON [55.49957005291674]
  We train NN based cloud cover parameterizations with coarse-grained data based on realistic regional and global ICON simulations. Globally trained NNs can reproduce sub-grid scale cloud cover of the regional simulation. We identify an overemphasis on specific humidity and cloud ice as the reason why our column-based NN cannot perfectly generalize from the global to the regional coarse-grained data.
  arXiv  Detail & Related papers  (2021-12-21T16:10:45Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Pseudo-LiDAR Point Cloud Interpolation Based on 3D Motion Representation and Spatial Supervision [68.35777836993212]
  We propose a Pseudo-LiDAR point cloud network to generate temporally and spatially high-quality point cloud sequences. By exploiting the scene flow between point clouds, the proposed network is able to learn a more accurate representation of the 3D spatial motion relationship.
  arXiv  Detail & Related papers  (2020-06-20T03:11:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.