Conditional diffusion models for downscaling & bias correction of Earth system model precipitation

• URL: http://arxiv.org/abs/2404.14416v1
• Date: Fri, 5 Apr 2024 11:01:50 GMT
• Title: Conditional diffusion models for downscaling & bias correction of Earth system model precipitation
• Authors: Michael Aich, Philipp Hess, Baoxiang Pan, Sebastian Bathiany, Yu Huang, Niklas Boers,
• Abstract summary: We propose a novel machine learning framework for simultaneous bias correction and downscaling. Our approach ensures statistical fidelity, preserves large-scale spatial patterns and outperforms existing methods.
• Score: 1.5193424827619018
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Climate change exacerbates extreme weather events like heavy rainfall and flooding. As these events cause severe losses of property and lives, accurate high-resolution simulation of precipitation is imperative. However, existing Earth System Models (ESMs) struggle with resolving small-scale dynamics and suffer from biases, especially for extreme events. Traditional statistical bias correction and downscaling methods fall short in improving spatial structure, while recent deep learning methods lack controllability over the output and suffer from unstable training. Here, we propose a novel machine learning framework for simultaneous bias correction and downscaling. We train a generative diffusion model in a supervised way purely on observational data. We map observational and ESM data to a shared embedding space, where both are unbiased towards each other and train a conditional diffusion model to reverse the mapping. Our method can be used to correct any ESM field, as the training is independent of the ESM. Our approach ensures statistical fidelity, preserves large-scale spatial patterns and outperforms existing methods especially regarding extreme events and small-scale spatial features that are crucial for impact assessments.

Related papers

• On conditional diffusion models for PDE simulations [53.01911265639582]
  We study score-based diffusion models for forecasting and assimilation of sparse observations. We propose an autoregressive sampling approach that significantly improves performance in forecasting. We also propose a new training strategy for conditional score-based models that achieves stable performance over a range of history lengths.
  arXiv  Detail & Related papers  (2024-10-21T18:31:04Z)
• A Deconfounding Approach to Climate Model Bias Correction [26.68810227550602]
  Global Climate Models (GCMs) are crucial for predicting future climate changes by simulating the Earth systems. GCMs exhibit systematic biases due to model uncertainties, parameterization simplifications, and inadequate representation of complex climate phenomena. This paper proposes a novel bias correction approach to utilize both GCM and observational data to learn a factor model that captures multi-cause latent confounders.
  arXiv  Detail & Related papers  (2024-08-22T01:53:35Z)
• Predicting Cascading Failures with a Hyperparametric Diffusion Model [66.89499978864741]
  We study cascading failures in power grids through the lens of diffusion models. Our model integrates viral diffusion principles with physics-based concepts. We show that this diffusion model can be learned from traces of cascading failures.
  arXiv  Detail & Related papers  (2024-06-12T02:34:24Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
  State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative. The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
  arXiv  Detail & Related papers  (2023-09-24T19:57:22Z)
• Reconstructing Graph Diffusion History from a Single Snapshot [87.20550495678907]
  We propose a novel barycenter formulation for reconstructing Diffusion history from A single SnapsHot (DASH) We prove that estimation error of diffusion parameters is unavoidable due to NP-hardness of diffusion parameter estimation. We also develop an effective solver named DIffusion hiTting Times with Optimal proposal (DITTO)
  arXiv  Detail & Related papers  (2023-06-01T09:39:32Z)
• DiffESM: Conditional Emulation of Earth System Models with Diffusion Models [2.1989764549743476]
  A key application of Earth System Models (ESMs) is studying extreme weather events, such as heat waves or dry spells. We show that diffusion models can effectively emulate the trends of ESMs under previously unseen climate scenarios.
  arXiv  Detail & Related papers  (2023-04-23T17:12:33Z)
• Deep learning for bias-correcting CMIP6-class Earth system models [0.0]
  We show that a post-processing method based on physically constrained generative adversarial networks (cGANs) can correct biases of a state-of-the-art, CMIP6-class ESM. While our method improves local frequency distributions equally well as gold-standard bias-adjustment frameworks, it strongly outperforms any existing methods in the correction of spatial patterns.
  arXiv  Detail & Related papers  (2022-12-16T13:53:57Z)
• Physically Constrained Generative Adversarial Networks for Improving Precipitation Fields from Earth System Models [0.0]
  Existing post-processing methods can improve ESM simulations locally, but cannot correct errors in modelled spatial patterns. We propose a framework based on physically constrained generative adversarial networks (GANs) to improve local distributions and spatial structure simultaneously.
  arXiv  Detail & Related papers  (2022-08-25T15:19:10Z)
• TRU-NET: A Deep Learning Approach to High Resolution Prediction of Rainfall [21.399707529966474]
  We present TRU-NET, an encoder-decoder model featuring a novel 2D cross attention mechanism between contiguous convolutional-recurrent layers. We use a conditional-continuous loss function to capture the zero-skewed %extreme event patterns of rainfall. Experiments show that our model consistently attains lower RMSE and MAE scores than a DL model prevalent in short term precipitation prediction.
  arXiv  Detail & Related papers  (2020-08-20T17:27:59Z)
• Semiparametric Bayesian Forecasting of Spatial Earthquake Occurrences [77.68028443709338]
  We propose a fully Bayesian formulation of the Epidemic Type Aftershock Sequence (ETAS) model. The occurrence of the mainshock earthquakes in a geographical region is assumed to follow an inhomogeneous spatial point process.
  arXiv  Detail & Related papers  (2020-02-05T10:11:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.