Rainy: Unlocking Satellite Calibration for Deep Learning in Precipitation

• URL: http://arxiv.org/abs/2504.10776v1
• Date: Tue, 15 Apr 2025 00:30:46 GMT
• Title: Rainy: Unlocking Satellite Calibration for Deep Learning in Precipitation
• Authors: Zhenyu Yu, Hanqing Chen, Mohd Yamani Idna Idris, Pei Wang,
• Abstract summary: Precipitation plays a critical role in the Earth's hydrological cycle, directly affecting ecosystems, agriculture, and water resource management.<n>In recent years, artificial intelligence (AI) has gained increasing attention in quantitative remote sensing (QRS)<n>The Rainy dataset supports five main tasks: (1) satellite calibration, (2) precipitation event prediction, (3) precipitation level prediction, (4)temporal prediction, and (5) precipitation downscaling.
• Score: 4.415961468927045
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Precipitation plays a critical role in the Earth's hydrological cycle, directly affecting ecosystems, agriculture, and water resource management. Accurate precipitation estimation and prediction are crucial for understanding climate dynamics, disaster preparedness, and environmental monitoring. In recent years, artificial intelligence (AI) has gained increasing attention in quantitative remote sensing (QRS), enabling more advanced data analysis and improving precipitation estimation accuracy. Although traditional methods have been widely used for precipitation estimation, they face limitations due to the difficulty of data acquisition and the challenge of capturing complex feature relationships. Furthermore, the lack of standardized multi-source satellite datasets, and in most cases, the exclusive reliance on station data, significantly hinders the effective application of advanced AI models. To address these challenges, we propose the Rainy dataset, a multi-source spatio-temporal dataset that integrates pure satellite data with station data, and propose Taper Loss, designed to fill the gap in tasks where only in-situ data is available without area-wide support. The Rainy dataset supports five main tasks: (1) satellite calibration, (2) precipitation event prediction, (3) precipitation level prediction, (4) spatiotemporal prediction, and (5) precipitation downscaling. For each task, we selected benchmark models and evaluation metrics to provide valuable references for researchers. Using precipitation as an example, the Rainy dataset and Taper Loss demonstrate the seamless collaboration between QRS and computer vision, offering data support for AI for Science in the field of QRS and providing valuable insights for interdisciplinary collaboration and integration.

Related papers

• Air Quality Prediction with A Meteorology-Guided Modality-Decoupled Spatio-Temporal Network [47.699409089023696]
  Air quality prediction plays a crucial role in public health and environmental protection. Existing works underestimate the critical role atmospheric conditions in air quality prediction. MDSTNet is an encoder framework explicitly that captures atmosphere-pollution dependencies for prediction. ChinaAirNet is the first dataset combining air quality records with multi-pressure-level meteorological observations.
  arXiv  Detail & Related papers  (2025-04-14T09:18:11Z)
• Deep Learning for Sea Surface Temperature Reconstruction under Cloud Occlusion [33.025831091005784]
  Large-scale Sea Surface Temperature (SST) monitoring relies on satellite infrared radiation detection.<n>Cloud cover presents a major challenge, creating extensive observational gaps.<n>We employ deep neural networks to reconstruct cloud-covered portions of satellite imagery.
  arXiv  Detail & Related papers  (2024-12-04T15:49:49Z)
• Enhancing Maritime Situational Awareness through End-to-End Onboard Raw Data Analysis [4.441792803766689]
  This research presents a framework addressing the strict bandwidth, energy, and latency constraints of small satellites. It investigates the application of deep learning techniques for direct ship detection and classification from raw satellite imagery. By simplifying the onboard processing chain, our approach facilitates direct analyses without requiring computationally intensive steps such as calibration and ortho-rectification.
  arXiv  Detail & Related papers  (2024-11-05T18:38:42Z)
• Compressing high-resolution data through latent representation encoding for downscaling large-scale AI weather forecast model [10.634513279883913]
  We propose a variational autoencoder framework tailored for compressing high-resolution datasets. Our framework successfully reduced the storage size of 3 years of HRCLDAS data from 8.61 TB to just 204 GB, while preserving essential information.
  arXiv  Detail & Related papers  (2024-10-10T05:38:03Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• Towards an end-to-end artificial intelligence driven global weather forecasting system [57.5191940978886]
  We present an AI-based data assimilation model, i.e., Adas, for global weather variables. We demonstrate that Adas can assimilate global observations to produce high-quality analysis, enabling the system operate stably for long term. We are the first to apply the methods to real-world scenarios, which is more challenging and has considerable practical application potential.
  arXiv  Detail & Related papers  (2023-12-18T09:05:28Z)
• JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowds [79.00975648564483]
  Trajectory forecasting models, employed in fields such as robotics, autonomous vehicles, and navigation, face challenges in real-world scenarios. This dataset provides comprehensive data, including the locations of all agents, scene images, and point clouds, all from the robot's perspective. The objective is to predict the future positions of agents relative to the robot using raw sensory input data.
  arXiv  Detail & Related papers  (2023-11-05T18:59:31Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing [70.16043883381677]
  In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres. In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions. We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
  arXiv  Detail & Related papers  (2022-01-10T10:02:40Z)
• RainBench: Towards Global Precipitation Forecasting from Satellite Imagery [6.462260770989231]
  Extreme precipitation events routinely ravage economies and livelihoods around the developing world. Data-driven deep learning approaches could widen the access to accurate multi-day forecasts. There is currently no benchmark dataset dedicated to the study of global precipitation forecasts.
  arXiv  Detail & Related papers  (2020-12-17T15:35:24Z)
• Imputation of missing sub-hourly precipitation data in a large sensor network: a machine learning approach [4.648824029505978]
  We present a two-step analysis utilising current machine learning techniques for imputing precipitation data sampled at 30-minute intervals. Investigating 37 weather stations in the UK, this machine learning process produces more accurate predictions for recovering precipitation data. Capturing complex non-linear relationships from weakly correlated datasets is critical for data recovery at sub-hourly resolutions.
  arXiv  Detail & Related papers  (2020-03-30T10:47:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.