AICCA: AI-driven Cloud Classification Atlas
- URL: http://arxiv.org/abs/2209.15096v1
- Date: Thu, 29 Sep 2022 21:01:31 GMT
- Title: AICCA: AI-driven Cloud Classification Atlas
- Authors: Takuya Kurihana, Elisabeth Moyer, Ian Foster
- Abstract summary: This study reduces the dimensionality of satellite cloud observations by grouping them via a novel automated, unsupervised cloud classification technique.
We use this approach to generate a unique new cloud dataset, the AI-driven cloud classification atlas (AICCA)
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Clouds play an important role in the Earth's energy budget and their behavior
is one of the largest uncertainties in future climate projections. Satellite
observations should help in understanding cloud responses, but decades and
petabytes of multispectral cloud imagery have to date received only limited
use. This study reduces the dimensionality of satellite cloud observations by
grouping them via a novel automated, unsupervised cloud classification
technique by using a convolutional neural network. Our technique combines a
rotation-invariant autoencoder with hierarchical agglomerative clustering to
generate cloud clusters that capture meaningful distinctions among cloud
textures, using only raw multispectral imagery as input. Thus, cloud classes
are defined without reliance on location, time/season, derived physical
properties, or pre-designated class definitions. We use this approach to
generate a unique new cloud dataset, the AI-driven cloud classification atlas
(AICCA), which clusters 22 years of ocean images from the Moderate Resolution
Imaging Spectroradiometer (MODIS) on NASA's Aqua and Terra instruments - 800 TB
of data or 198 million patches roughly 100 km x 100 km (128 x 128 pixels) -
into 42 AI-generated cloud classes. We show that AICCA classes involve
meaningful distinctions that employ spatial information and result in distinct
geographic distributions, capturing, for example, stratocumulus decks along the
West coasts of North and South America. AICCA delivers the information in
multi-spectral images in a compact form, enables data-driven diagnosis of
patterns of cloud organization, provides insight into cloud evolution on
timescales of hours to decades, and helps democratize climate research by
facilitating access to core data.
Related papers
- Point Cloud Compression with Implicit Neural Representations: A Unified Framework [54.119415852585306]
We present a pioneering point cloud compression framework capable of handling both geometry and attribute components.
Our framework utilizes two coordinate-based neural networks to implicitly represent a voxelized point cloud.
Our method exhibits high universality when contrasted with existing learning-based techniques.
arXiv Detail & Related papers (2024-05-19T09:19:40Z) - Masked Spatio-Temporal Structure Prediction for Self-supervised Learning
on Point Cloud Videos [75.9251839023226]
We propose a Masked-temporal Structure Prediction (MaST-Pre) method to capture the structure of point cloud videos without human annotations.
MaST-Pre consists of two self-supervised learning tasks. First, by reconstructing masked point tubes, our method is able to capture appearance information of point cloud videos.
Second, to learn motion, we propose a temporal cardinality difference prediction task that estimates the change in the number of points within a point tube.
arXiv Detail & Related papers (2023-08-18T02:12:54Z) - Patch-Wise Point Cloud Generation: A Divide-and-Conquer Approach [83.05340155068721]
We devise a new 3d point cloud generation framework using a divide-and-conquer approach.
All patch generators are based on learnable priors, which aim to capture the information of geometry primitives.
Experimental results on a variety of object categories from the most popular point cloud dataset, ShapeNet, show the effectiveness of the proposed patch-wise point cloud generation.
arXiv Detail & Related papers (2023-07-22T11:10:39Z) - Insight into cloud processes from unsupervised classification with a
rotationally invariant autoencoder [10.739352302280667]
Current cloud classification schemes are based on single-pixel cloud properties and cannot consider spatial structures and textures.
Recent advances in computer vision enable the grouping of different patterns of images without using human predefined labels.
We describe the use of such methods to generate a new AI-driven Cloud Classification Atlas (AICCA)
arXiv Detail & Related papers (2022-11-02T04:08:32Z) - Boosting Point Clouds Rendering via Radiance Mapping [49.24193509772339]
We focus on boosting the image quality of point clouds rendering with a compact model design.
We simplify the NeRF representation to a spatial mapping function which only requires single evaluation per pixel.
Our method achieves the state-of-the-art rendering on point clouds, outperforming prior works by notable margins.
arXiv Detail & Related papers (2022-10-27T01:25:57Z) - Cloud Classification with Unsupervised Deep Learning [6.285964948191585]
Our framework learns cloud features directly from radiance data produced by NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) satellite instrument.
We present preliminary results showing that our method extracts physically relevant information from radiance data and produces meaningful cloud classes.
arXiv Detail & Related papers (2022-09-30T16:56:58Z) - Unsupervised Point Cloud Representation Learning with Deep Neural
Networks: A Survey [104.71816962689296]
Unsupervised point cloud representation learning has attracted increasing attention due to the constraint in large-scale point cloud labelling.
This paper provides a comprehensive review of unsupervised point cloud representation learning using deep neural networks.
arXiv Detail & Related papers (2022-02-28T07:46:05Z) - NeeDrop: Self-supervised Shape Representation from Sparse Point Clouds
using Needle Dropping [80.2485282512607]
We introduce NeeDrop, a self-supervised method for learning shape representations from sparse point clouds.
No shape knowledge is required and the point cloud can be highly sparse, e.g., as lidar point clouds acquired by vehicles.
We obtain quantitative results on par with existing supervised approaches on shape reconstruction datasets.
arXiv Detail & Related papers (2021-11-30T08:35:20Z) - Classification and understanding of cloud structures via satellite
images with EfficientUNet [0.0]
classification of cloud organization patterns was performed using a new scaled-up version of Convolutional Neural Network (CNN)
Dice coefficient has been used for the final evaluation metric, which gave the score of 66.26% and 66.02% for public and private (test set) leaderboard on Kaggle competition respectively.
arXiv Detail & Related papers (2020-09-27T19:50:05Z) - CloudCast: A Satellite-Based Dataset and Baseline for Forecasting Clouds [0.0]
In this paper, we present a novel satellite-based dataset called CloudCast''.
It consists of 70,080 images with 10 different cloud types for multiple layers of the atmosphere annotated on a pixel level.
The spatial resolution of the dataset is 928 x 1530 pixels (3x3 km per pixel) with 15-min intervals between frames for the period 2017-01-01 to 2018-12-31.
arXiv Detail & Related papers (2020-07-15T20:20:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.