Super-resolution Probabilistic Rain Prediction from Satellite Data Using 3D U-Nets and EarthFormers

• URL: http://arxiv.org/abs/2212.02998v1
• Date: Tue, 6 Dec 2022 14:15:33 GMT
• Title: Super-resolution Probabilistic Rain Prediction from Satellite Data Using 3D U-Nets and EarthFormers
• Authors: Yang Li, Haiyu Dong, Zuliang Fang, Jonathan Weyn, Pete Luferenko
• Abstract summary: This paper presents a solution which won the 2 nd prize in the Weather4cast 2022 NeurIPS competition using 3D U-Nets and EarthFormers. The spatial context effect of the input satellite image has been deeply explored and optimal context range has been found. Results show that satellite bands signifying cloudtop phase (8.7 um) and cloud-top height (10.8 and 13.4 um) are the best predictors for rain prediction.
• Score: 3.672208741935232
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate and timely rain prediction is crucial for decision making and is also a challenging task. This paper presents a solution which won the 2 nd prize in the Weather4cast 2022 NeurIPS competition using 3D U-Nets and EarthFormers for 8-hour probabilistic rain prediction based on multi-band satellite images. The spatial context effect of the input satellite image has been deeply explored and optimal context range has been found. Based on the imbalanced rain distribution, we trained multiple models with different loss functions. To further improve the model performance, multi-model ensemble and threshold optimization were used to produce the final probabilistic rain prediction. Experiment results and leaderboard scores demonstrate that optimal spatial context, combined loss function, multi-model ensemble, and threshold optimization all provide modest model gain. A permutation test was used to analyze the effect of each satellite band on rain prediction, and results show that satellite bands signifying cloudtop phase (8.7 um) and cloud-top height (10.8 and 13.4 um) are the best predictors for rain prediction. The source code is available at https://github.com/bugsuse/weather4cast-2022-stage2.

Related papers

• CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded Modelling [93.65319031345197]
  We propose CasCast, a cascaded framework composed of a deterministic and a probabilistic part to decouple predictions for mesoscale precipitation distributions and small-scale patterns. CasCast significantly surpasses the baseline (up to +91.8%) for regional extreme-precipitation nowcasting.
  arXiv  Detail & Related papers  (2024-02-06T08:30:47Z)
• A Practical Probabilistic Benchmark for AI Weather Models [0.8278356279004184]
  We show that two leading AI weather models, i.e. GraphCast and Pangu, are tied on the probabilistic CRPS metric. We also reveal how multiple time-step loss functions, which many data-driven weather models have employed, are counter-productive.
  arXiv  Detail & Related papers  (2024-01-27T05:53:16Z)
• RainAI -- Precipitation Nowcasting from Satellite Data [5.869633234882028]
  This paper presents a solution to the Weather4 2023 competition. The goal is to forecast high-resolution precipitation with an 8-hour lead time using lower-resolution satellite radiance images. We propose a simple, yet effective method for learning feature using a 2D U-Net model.
  arXiv  Detail & Related papers  (2023-11-30T09:49:16Z)
• Learning Robust Precipitation Forecaster by Temporal Frame Interpolation [65.5045412005064]
  We develop a robust precipitation forecasting model that demonstrates resilience against spatial-temporal discrepancies. Our approach has led to significant improvements in forecasting precision, culminating in our model securing textit1st place in the transfer learning leaderboard of the textitWeather4cast'23 competition.
  arXiv  Detail & Related papers  (2023-11-30T08:22:08Z)
• Residual Diffusion Modeling for Km-scale Atmospheric Downscaling [51.061954281398116]
  A cost-effective downscaling model is trained from a high-resolution 2-km weather model over Taiwan. textitCorrDiff exhibits skillful RMSE and CRPS and faithfully recovers spectra and distributions even for extremes. Downscaling global forecasts successfully retains many of these benefits, foreshadowing the potential of end-to-end, global-to-km-scales machine learning weather predictions.
  arXiv  Detail & Related papers  (2023-09-24T19:57:22Z)
• Deep Learning for Day Forecasts from Sparse Observations [60.041805328514876]
  Deep neural networks offer an alternative paradigm for modeling weather conditions. MetNet-3 learns from both dense and sparse data sensors and makes predictions up to 24 hours ahead for precipitation, wind, temperature and dew point. MetNet-3 has a high temporal and spatial resolution, respectively, up to 2 minutes and 1 km as well as a low operational latency.
  arXiv  Detail & Related papers  (2023-06-06T07:07:54Z)
• RainUNet for Super-Resolution Rain Movie Prediction under Spatio-temporal Shifts [22.972610820962625]
  This paper presents a solution to the Weather4cast 2022 Challenge Stage 2. The goal of the challenge is to forecast future high-resolution rainfall events obtained from ground radar. We suggest a solution that performs data preprocessing appropriate to the challenge and then predicts rainfall movies using a novel RainUNet.
  arXiv  Detail & Related papers  (2022-12-07T23:42:39Z)
• WeatherFusionNet: Predicting Precipitation from Satellite Data [0.0]
  We aim to predict high-resolution precipitation from lower-resolution satellite radiance images. A neural network called WeatherFusionNet is employed to predict severe rain up to eight hours in advance. We achieved 1st place in the NeurIPS 2022 Weather4Cast Core challenge.
  arXiv  Detail & Related papers  (2022-11-30T08:49:13Z)
• Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast [91.9372563527801]
  We present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For the first time, an AI-based method outperforms state-of-the-art numerical weather prediction (NWP) methods in terms of accuracy. Pangu-Weather supports a wide range of downstream forecast scenarios, including extreme weather forecast and large-member ensemble forecast in real-time.
  arXiv  Detail & Related papers  (2022-11-03T17:19:43Z)
• Short-term precipitation prediction using deep learning [5.1589108738893215]
  We show that a 3D convolutional neural network using a single frame of meteorology fields is capable of predicting the precipitation spatial distribution. The network is developed based on 39-years (1980-2018) data of meteorology and daily precipitation over the contiguous United States.
  arXiv  Detail & Related papers  (2021-10-05T06:37:24Z)
• RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Deraining [49.99207211126791]
  We specifically build a novel deep architecture, called rain convolutional dictionary network (RCDNet) RCDNet embeds the intrinsic priors of rain streaks and has clear interpretability. By end-to-end training such an interpretable network, all involved rain kernels and proximal operators can be automatically extracted.
  arXiv  Detail & Related papers  (2021-07-14T16:08:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.