Self-Supervised Pre-Training for Precipitation Post-Processor

• URL: http://arxiv.org/abs/2310.20187v3
• Date: Tue, 20 Feb 2024 01:45:22 GMT
• Title: Self-Supervised Pre-Training for Precipitation Post-Processor
• Authors: Sojung An, Junha Lee, Jiyeon Jang, Inchae Na, Wooyeon Park, Sujeong You
• Abstract summary: We propose a deep learning-based precipitation post-processor for numerical weather prediction (NWP) models. Our experiments on precipitation correction for regional NWP datasets show that the proposed method outperforms other approaches.
• Score: 1.5553847214012175
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Obtaining a sufficient forecast lead time for local precipitation is essential in preventing hazardous weather events. Global warming-induced climate change increases the challenge of accurately predicting severe precipitation events, such as heavy rainfall. In this paper, we propose a deep learning-based precipitation post-processor for numerical weather prediction (NWP) models. The precipitation post-processor consists of (i) employing self-supervised pre-training, where the parameters of the encoder are pre-trained on the reconstruction of the masked variables of the atmospheric physics domain; and (ii) conducting transfer learning on precipitation segmentation tasks (the target domain) from the pre-trained encoder. In addition, we introduced a heuristic labeling approach to effectively train class-imbalanced datasets. Our experiments on precipitation correction for regional NWP show that the proposed method outperforms other approaches.

Related papers

• TCP-Diffusion: A Multi-modal Diffusion Model for Global Tropical Cyclone Precipitation Forecasting with Change Awareness [13.696784449863959]
  Tropical Cyclone Precipitation Diffusion ( TCP-Diffusion) is a multi-modal model for global tropical cyclone precipitation forecasting. It forecasts TC rainfall around the TC center for the next 12 hours at 3 hourly resolution based on past rainfall observations and multi-modal environmental variables. Considering the influence of TC-related meteorological factors and the useful information from NWP model forecasts, we propose a multi-model framework with specialized encoders.
  arXiv  Detail & Related papers  (2024-10-17T02:58:05Z)
• PostCast: Generalizable Postprocessing for Precipitation Nowcasting via Unsupervised Blurriness Modeling [85.56969895866243]
  We propose an unsupervised postprocessing method to eliminate the blurriness without the requirement of training with the pairs of blurry predictions and corresponding ground truth. A zero-shot blur kernel estimation mechanism and an auto-scale denoise guidance strategy are introduced to adapt the unconditional correlations to any blurriness modes.
  arXiv  Detail & Related papers  (2024-10-08T08:38:23Z)
• Efficient Localized Adaptation of Neural Weather Forecasting: A Case Study in the MENA Region [62.09891513612252]
  We focus on limited-area modeling and train our model specifically for localized region-level downstream tasks. We consider the MENA region due to its unique climatic challenges, where accurate localized weather forecasting is crucial for managing water resources, agriculture and mitigating the impacts of extreme weather events. Our study aims to validate the effectiveness of integrating parameter-efficient fine-tuning (PEFT) methodologies, specifically Low-Rank Adaptation (LoRA) and its variants, to enhance forecast accuracy, as well as training speed, computational resource utilization, and memory efficiency in weather and climate modeling for specific regions.
  arXiv  Detail & Related papers  (2024-09-11T19:31:56Z)
• Extreme Precipitation Nowcasting using Transformer-based Generative Models [9.497627628556875]
  This paper presents an innovative approach to extreme precipitation nowcasting by employing Transformer-based generative models, namely NowcastingGPT with Extreme Value Loss (EVL) regularization. We introduce a novel method for computing EVL without assuming fixed extreme representations, addressing the limitations of current models in capturing extreme weather events. We present both qualitative and quantitative analyses, demonstrating the superior performance of the proposed NowcastingGPT-EVL in generating accurate precipitation forecasts.
  arXiv  Detail & Related papers  (2024-03-06T18:39:41Z)
• CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded Modelling [93.65319031345197]
  We propose CasCast, a cascaded framework composed of a deterministic and a probabilistic part to decouple predictions for mesoscale precipitation distributions and small-scale patterns. CasCast significantly surpasses the baseline (up to +91.8%) for regional extreme-precipitation nowcasting.
  arXiv  Detail & Related papers  (2024-02-06T08:30:47Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• PostRainBench: A comprehensive benchmark and a new model for precipitation forecasting [14.855615256498]
  We focus on the Numerical Weather Prediction (NWP) post-processing based precipitation forecasting task. We introduce the textbfPostRainBench, a comprehensive multi-variable NWP post-processing benchmark, and textbfCAMT, a simple yet effective Channel Attention Enhanced Multi-task Learning framework. Our model is the first deep learning-based method to outperform NWP approaches in heavy rain conditions.
  arXiv  Detail & Related papers  (2023-10-04T09:27:39Z)
• Tipping Point Forecasting in Non-Stationary Dynamics on Function Spaces [78.08947381962658]
  Tipping points are abrupt, drastic, and often irreversible changes in the evolution of non-stationary dynamical systems. We learn the evolution of such non-stationary systems using a novel recurrent neural operator (RNO), which learns mappings between function spaces. We propose a conformal prediction framework to forecast tipping points by monitoring deviations from physics constraints.
  arXiv  Detail & Related papers  (2023-08-17T05:42:27Z)
• Generative Modeling of High-resolution Global Precipitation Forecasts [2.1485350418225244]
  We present improvements to the architecture and training process of a current state-of-the art deep learning precipitation model (FourCastNet) using a novel generative adversarial network (GAN) Our improvements achieve superior performance in capturing the extreme percentiles of global precipitation, while comparable to state-of-the-art NWP models in terms of forecast skill at 1--2 day lead times.
  arXiv  Detail & Related papers  (2022-10-22T17:21:16Z)
• Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate data [86.1450118623908]
  We investigate a supervised machine learning approach based on deformable convolutional neural networks (deCNNs) We forecast the North Atlantic-European weather regimes during extended boreal winter for 1 to 15 days into the future. Due to its wider field of view, we also observe deCNN achieving considerably better performance than regular convolutional neural networks at lead times beyond 5-6 days.
  arXiv  Detail & Related papers  (2022-02-10T11:37:00Z)
• TRU-NET: A Deep Learning Approach to High Resolution Prediction of Rainfall [21.399707529966474]
  We present TRU-NET, an encoder-decoder model featuring a novel 2D cross attention mechanism between contiguous convolutional-recurrent layers. We use a conditional-continuous loss function to capture the zero-skewed %extreme event patterns of rainfall. Experiments show that our model consistently attains lower RMSE and MAE scores than a DL model prevalent in short term precipitation prediction.
  arXiv  Detail & Related papers  (2020-08-20T17:27:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.