Generating the Cloud Motion Winds Field from Satellite Cloud Imagery
Using Deep Learning Approach
- URL: http://arxiv.org/abs/2010.01283v2
- Date: Sun, 30 May 2021 07:21:57 GMT
- Title: Generating the Cloud Motion Winds Field from Satellite Cloud Imagery
Using Deep Learning Approach
- Authors: Chao Tan
- Abstract summary: We explore the cloud motion winds algorithm based on data-driven deep learning approach.
We use deep learning model to automatically learn the motion feature representations and directly output the field of cloud motion winds.
We also try to use a single cloud imagery to predict the cloud motion winds field in a fixed region, which is impossible to achieve using traditional algorithms.
- Score: 1.8655840060559172
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Cloud motion winds (CMW) are routinely derived by tracking features in
sequential geostationary satellite infrared cloud imagery. In this paper, we
explore the cloud motion winds algorithm based on data-driven deep learning
approach, and different from conventional hand-craft feature tracking and
correlation matching algorithms, we use deep learning model to automatically
learn the motion feature representations and directly output the field of cloud
motion winds. In addition, we propose a novel large-scale cloud motion winds
dataset (CMWD) for training deep learning models. We also try to use a single
cloud imagery to predict the cloud motion winds field in a fixed region, which
is impossible to achieve using traditional algorithms. The experimental results
demonstrate that our algorithm can predict the cloud motion winds field
efficiently, and even with a single cloud imagery as input.
Related papers
- Towards Fusing Point Cloud and Visual Representations for Imitation Learning [57.886331184389604]
We propose FPV-Net, a novel imitation learning method that effectively combines the strengths of both point cloud and RGB modalities.
Our method conditions the point-cloud encoder on global and local image tokens using adaptive layer norm conditioning.
arXiv Detail & Related papers (2025-02-17T20:46:54Z) - UCloudNet: A Residual U-Net with Deep Supervision for Cloud Image Segmentation [10.797462947568954]
We introduce a residual U-Net with deep supervision for cloud segmentation.
It provides better accuracy than previous approaches, and with less training consumption.
arXiv Detail & Related papers (2025-01-11T05:15:24Z) - Masked Spatio-Temporal Structure Prediction for Self-supervised Learning
on Point Cloud Videos [75.9251839023226]
We propose a Masked-temporal Structure Prediction (MaST-Pre) method to capture the structure of point cloud videos without human annotations.
MaST-Pre consists of two self-supervised learning tasks. First, by reconstructing masked point tubes, our method is able to capture appearance information of point cloud videos.
Second, to learn motion, we propose a temporal cardinality difference prediction task that estimates the change in the number of points within a point tube.
arXiv Detail & Related papers (2023-08-18T02:12:54Z) - Ponder: Point Cloud Pre-training via Neural Rendering [93.34522605321514]
We propose a novel approach to self-supervised learning of point cloud representations by differentiable neural encoders.
The learned point-cloud can be easily integrated into various downstream tasks, including not only high-level rendering tasks like 3D detection and segmentation, but low-level tasks like 3D reconstruction and image rendering.
arXiv Detail & Related papers (2022-12-31T08:58:39Z) - Cloud Classification with Unsupervised Deep Learning [6.285964948191585]
Our framework learns cloud features directly from radiance data produced by NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) satellite instrument.
We present preliminary results showing that our method extracts physically relevant information from radiance data and produces meaningful cloud classes.
arXiv Detail & Related papers (2022-09-30T16:56:58Z) - Unsupervised Point Cloud Representation Learning with Deep Neural
Networks: A Survey [104.71816962689296]
Unsupervised point cloud representation learning has attracted increasing attention due to the constraint in large-scale point cloud labelling.
This paper provides a comprehensive review of unsupervised point cloud representation learning using deep neural networks.
arXiv Detail & Related papers (2022-02-28T07:46:05Z) - TPCN: Temporal Point Cloud Networks for Motion Forecasting [47.829152433166016]
We propose a novel framework with joint spatial and temporal learning for trajectory prediction.
In the spatial dimension, agents can be viewed as an unordered point set, and thus it is straightforward to apply point cloud learning techniques to model agents' locations.
Experiments on the Argoverse motion forecasting benchmark show that our approach achieves the state-of-the-art results.
arXiv Detail & Related papers (2021-03-04T14:44:32Z) - Cloud detection machine learning algorithms for PROBA-V [6.950862982117125]
The objective of the algorithms presented in this paper is to detect clouds accurately providing a cloud flag per pixel.
The effectiveness of the proposed method is successfully illustrated using a large number of real Proba-V images.
arXiv Detail & Related papers (2020-12-09T18:23:59Z) - A deep network approach to multitemporal cloud detection [15.39911641413792]
We present a deep learning model with temporal memory to detect clouds in image time series acquired by the Seviri imager mounted on the Meteosat Second Generation (MSG) satellite.
The model provides pixel-level cloud maps with related confidence and propagates information in time via a recurrent neural network structure.
arXiv Detail & Related papers (2020-12-09T08:58:36Z) - Thick Cloud Removal of Remote Sensing Images Using Temporal Smoothness
and Sparsity-Regularized Tensor Optimization [3.65794756599491]
In remote sensing images, the presence of thick cloud accompanying cloud shadow is a high probability event.
A novel thick cloud removal method for remote sensing images based on temporal smoothness and sparsity-regularized tensor optimization is proposed.
arXiv Detail & Related papers (2020-08-11T05:59:20Z) - Pseudo-LiDAR Point Cloud Interpolation Based on 3D Motion Representation
and Spatial Supervision [68.35777836993212]
We propose a Pseudo-LiDAR point cloud network to generate temporally and spatially high-quality point cloud sequences.
By exploiting the scene flow between point clouds, the proposed network is able to learn a more accurate representation of the 3D spatial motion relationship.
arXiv Detail & Related papers (2020-06-20T03:11:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.