Conditional diffusion models for downscaling & bias correction of Earth system model precipitation
- URL: http://arxiv.org/abs/2404.14416v1
- Date: Fri, 5 Apr 2024 11:01:50 GMT
- Title: Conditional diffusion models for downscaling & bias correction of Earth system model precipitation
- Authors: Michael Aich, Philipp Hess, Baoxiang Pan, Sebastian Bathiany, Yu Huang, Niklas Boers,
- Abstract summary: We propose a novel machine learning framework for simultaneous bias correction and downscaling.
Our approach ensures statistical fidelity, preserves large-scale spatial patterns and outperforms existing methods.
- Score: 1.5193424827619018
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Climate change exacerbates extreme weather events like heavy rainfall and flooding. As these events cause severe losses of property and lives, accurate high-resolution simulation of precipitation is imperative. However, existing Earth System Models (ESMs) struggle with resolving small-scale dynamics and suffer from biases, especially for extreme events. Traditional statistical bias correction and downscaling methods fall short in improving spatial structure, while recent deep learning methods lack controllability over the output and suffer from unstable training. Here, we propose a novel machine learning framework for simultaneous bias correction and downscaling. We train a generative diffusion model in a supervised way purely on observational data. We map observational and ESM data to a shared embedding space, where both are unbiased towards each other and train a conditional diffusion model to reverse the mapping. Our method can be used to correct any ESM field, as the training is independent of the ESM. Our approach ensures statistical fidelity, preserves large-scale spatial patterns and outperforms existing methods especially regarding extreme events and small-scale spatial features that are crucial for impact assessments.
Related papers
- Predicting Cascading Failures with a Hyperparametric Diffusion Model [66.89499978864741]
We study cascading failures in power grids through the lens of diffusion models.
Our model integrates viral diffusion principles with physics-based concepts.
We show that this diffusion model can be learned from traces of cascading failures.
arXiv Detail & Related papers (2024-06-12T02:34:24Z) - Observation-Guided Meteorological Field Downscaling at Station Scale: A
Benchmark and a New Method [66.80344502790231]
We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset.
Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors.
Our proposed method outperforms other specially designed baseline models on multiple surface variables.
arXiv Detail & Related papers (2024-01-22T14:02:56Z) - Precipitation Downscaling with Spatiotemporal Video Diffusion [19.004369237435437]
This work extends recent video diffusion models to precipitation super-resolution.
We use a deterministic downscaler followed by a temporally-conditioned diffusion model to capture noise characteristics and high-frequency patterns.
Our analysis, capturing CRPS, MSE, precipitation distributions, and qualitative aspects using California and the Himalayas, establishes our method as a new standard for data-driven precipitation downscaling.
arXiv Detail & Related papers (2023-12-11T02:38:07Z) - One More Step: A Versatile Plug-and-Play Module for Rectifying Diffusion
Schedule Flaws and Enhancing Low-Frequency Controls [77.42510898755037]
One More Step (OMS) is a compact network that incorporates an additional simple yet effective step during inference.
OMS elevates image fidelity and harmonizes the dichotomy between training and inference, while preserving original model parameters.
Once trained, various pre-trained diffusion models with the same latent domain can share the same OMS module.
arXiv Detail & Related papers (2023-11-27T12:02:42Z) - Residual Diffusion Modeling for Km-scale Atmospheric Downscaling [51.061954281398116]
A cost-effective downscaling model is trained from a high-resolution 2-km weather model over Taiwan.
textitCorrDiff exhibits skillful RMSE and CRPS and faithfully recovers spectra and distributions even for extremes.
Downscaling global forecasts successfully retains many of these benefits, foreshadowing the potential of end-to-end, global-to-km-scales machine learning weather predictions.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Reconstructing Graph Diffusion History from a Single Snapshot [87.20550495678907]
We propose a novel barycenter formulation for reconstructing Diffusion history from A single SnapsHot (DASH)
We prove that estimation error of diffusion parameters is unavoidable due to NP-hardness of diffusion parameter estimation.
We also develop an effective solver named DIffusion hiTting Times with Optimal proposal (DITTO)
arXiv Detail & Related papers (2023-06-01T09:39:32Z) - DiffESM: Conditional Emulation of Earth System Models with Diffusion
Models [2.1989764549743476]
A key application of Earth System Models (ESMs) is studying extreme weather events, such as heat waves or dry spells.
We show that diffusion models can effectively emulate the trends of ESMs under previously unseen climate scenarios.
arXiv Detail & Related papers (2023-04-23T17:12:33Z) - Deep learning for bias-correcting CMIP6-class Earth system models [0.0]
We show that a post-processing method based on physically constrained generative adversarial networks (cGANs) can correct biases of a state-of-the-art, CMIP6-class ESM.
While our method improves local frequency distributions equally well as gold-standard bias-adjustment frameworks, it strongly outperforms any existing methods in the correction of spatial patterns.
arXiv Detail & Related papers (2022-12-16T13:53:57Z) - Physically Constrained Generative Adversarial Networks for Improving
Precipitation Fields from Earth System Models [0.0]
Existing post-processing methods can improve ESM simulations locally, but cannot correct errors in modelled spatial patterns.
We propose a framework based on physically constrained generative adversarial networks (GANs) to improve local distributions and spatial structure simultaneously.
arXiv Detail & Related papers (2022-08-25T15:19:10Z) - TRU-NET: A Deep Learning Approach to High Resolution Prediction of
Rainfall [21.399707529966474]
We present TRU-NET, an encoder-decoder model featuring a novel 2D cross attention mechanism between contiguous convolutional-recurrent layers.
We use a conditional-continuous loss function to capture the zero-skewed %extreme event patterns of rainfall.
Experiments show that our model consistently attains lower RMSE and MAE scores than a DL model prevalent in short term precipitation prediction.
arXiv Detail & Related papers (2020-08-20T17:27:59Z) - Semiparametric Bayesian Forecasting of Spatial Earthquake Occurrences [77.68028443709338]
We propose a fully Bayesian formulation of the Epidemic Type Aftershock Sequence (ETAS) model.
The occurrence of the mainshock earthquakes in a geographical region is assumed to follow an inhomogeneous spatial point process.
arXiv Detail & Related papers (2020-02-05T10:11:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.