Precipitation Downscaling Using Foundation Model-Conditioned Diffusion
- URL: http://arxiv.org/abs/2608.25858v1
- Date: Wed, 26 Aug 2026 14:30:39 GMT
- Title: Precipitation Downscaling Using Foundation Model-Conditioned Diffusion
- Abstract summary: High-resolution precipitation fields are essential for hydrological impact assessment, yet global climate model outputs are too coarse and biased for direct use.<n>We investigate three conditioning strategies for a denoising diffusion probabilistic model applied to daily precipitation downscaling.<n>Concatenation conditioning achieves the lowest point-wise CRPS and MSE, but tends to produce over-smoothed fields that suppress high-intensity events.<n>Cross-attention conditioning provides substantially better distributional realism and modest improvements in spectral fidelity.
- Score: 1.1848987098427715
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: High-resolution precipitation fields are essential for hydrological impact assessment, yet global climate model outputs are too coarse and biased for direct use. AI-based statistical downscaling with diffusion models offers a promising approach, but the mechanism by which large-scale atmospheric predictors condition generation remains largely unexplored. We investigate three conditioning strategies for a denoising diffusion probabilistic model applied to daily precipitation downscaling: channel concatenation of upsampled coarse predictors, cross-attention conditioning with a learned convolutional encoder, and cross-attention conditioning with the frozen encoder of the pretrained Prithvi WxC weather foundation model. All strategies are evaluated against an unconditioned baseline under identical conditions using probabilistic, distributional, spectral, and extreme-event metrics for the Colorado River Basin. Concatenation conditioning achieves the lowest point-wise CRPS and MSE, but tends to produce over-smoothed fields that suppress high-intensity events. In contrast, cross-attention conditioning provides substantially better distributional realism and modest improvements in spectral fidelity. Improvements are greatest for extremes: the Prithvi-WxC conditioned model retains over half of >100mm/day events, although estimates are uncertain due to limited samples. When trained on the full dataset, the learned convolutional model performs similarly to the foundation model-conditioned approach while requiring lower computational resources. However, the Prithvi-WxC-conditioned model achieves comparable performance with only five years of training data. These results indicate that cross-attention conditioning offers advantages over simple concatenation for probabilistic precipitation downscaling, and that pre-trained foundation model representations may offer benefits in data-limited settings.
Related papers
- Regional Climate Model Emulation with Diffusion Approaches: What is the Added Value of Generative Machine Learning? [0.0]
We introduce ParamDiffusion, a new two-stage diffusion-based framework.<n>We expand standard validation through a comprehensive framework aligned with climate-science needs.<n>We assess the added value of diffusion approaches relative to deterministic methods.
arXiv Detail & Related papers (2026-06-12T15:46:35Z) - Toward generative machine learning for boosting ensembles of climate simulations [0.0]
We develop a conditional Variational Autoencoder (cVAE) trained on a limited sample of climate simulations to generate arbitrary large ensembles.<n>We show that the cVAE model learns the underlying distribution of the data and generates physically consistent samples that reproduce realistic low and high moment statistics.
arXiv Detail & Related papers (2026-02-06T00:54:19Z) - Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting [63.8116386935854]
We demonstrate that state-of-the-art probabilistic skill requires neither intricate architectural constraints nor specialized trainings.<n>We introduce a scalable framework for learning multi-scale atmospheric dynamics by combining a directly downsampled latent space with a history-conditioned local projector.<n>We find that our framework design is robust to the choice of probabilistic estimators, seamlessly supporting interpolants, diffusion models, and CRPS-based ensemble training.
arXiv Detail & Related papers (2026-01-26T03:52:16Z) - SynCast: Synergizing Contradictions in Precipitation Nowcasting via Diffusion Sequential Preference Optimization [62.958457694151384]
We introduce preference optimization into precipitation nowcasting for the first time, motivated by the success of reinforcement learning from human feedback in large language models.<n>In the first stage, the framework focuses on reducing FAR, training the model to effectively suppress false alarms.
arXiv Detail & Related papers (2025-10-22T16:11:22Z) - CRPS-LAM: Regional ensemble weather forecasting from matching marginals [12.929305404466747]
We introduce CRPS-LAM, a probabilistic LAM forecasting model trained with a CRPS-based objective.<n>By sampling and injecting a single latent noise vector into the model, CRPS-LAM generates ensemble members in a single forward pass.<n>We evaluate the model on the MEPS regional dataset, where CRPS-LAM matches the low errors of diffusion models.
arXiv Detail & Related papers (2025-10-10T15:48:31Z) - Elucidated Rolling Diffusion Models for Probabilistic Weather Forecasting [52.6508222408558]
We introduce Elucidated Rolling Diffusion Models (ERDM)<n>ERDM is the first framework to unify a rolling forecast structure with the principled, performant design of Elucidated Diffusion Models (EDM)<n>On 2D Navier-Stokes simulations and ERA5 global weather forecasting at 1.5circ resolution, ERDM consistently outperforms key diffusion-based baselines.
arXiv Detail & Related papers (2025-06-24T21:44:31Z) - Downscaling Precipitation with Bias-informed Conditional Diffusion Model [10.545983522538085]
Current Global Climate Models operate at spatial resolutions too coarse for localized analyses.<n>Deep learning-based statistical downscaling methods offer promising solutions.<n>We introduce a bias-informed conditional diffusion model for statistical downscaling of precipitation.
arXiv Detail & Related papers (2024-12-19T05:36:52Z) - On conditional diffusion models for PDE simulations [53.01911265639582]
We study score-based diffusion models for forecasting and assimilation of sparse observations.
We propose an autoregressive sampling approach that significantly improves performance in forecasting.
We also propose a new training strategy for conditional score-based models that achieves stable performance over a range of history lengths.
arXiv Detail & Related papers (2024-10-21T18:31:04Z) - PostCast: Generalizable Postprocessing for Precipitation Nowcasting via Unsupervised Blurriness Modeling [85.56969895866243]
We propose an unsupervised postprocessing method to eliminate the blurriness without the requirement of training with the pairs of blurry predictions and corresponding ground truth.
A zero-shot blur kernel estimation mechanism and an auto-scale denoise guidance strategy are introduced to adapt the unconditional correlations to any blurriness modes.
arXiv Detail & Related papers (2024-10-08T08:38:23Z) - ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast.
We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples.
Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
arXiv Detail & Related papers (2024-02-02T10:34:13Z) - Precipitation Downscaling with Spatiotemporal Video Diffusion [19.004369237435437]
This work extends recent video diffusion models to precipitation super-resolution.
We use a deterministic downscaler followed by a temporally-conditioned diffusion model to capture noise characteristics and high-frequency patterns.
Our analysis, capturing CRPS, MSE, precipitation distributions, and qualitative aspects using California and the Himalayas, establishes our method as a new standard for data-driven precipitation downscaling.
arXiv Detail & Related papers (2023-12-11T02:38:07Z) - Autoregressive Score Matching [113.4502004812927]
We propose autoregressive conditional score models (AR-CSM) where we parameterize the joint distribution in terms of the derivatives of univariable log-conditionals (scores)
For AR-CSM models, this divergence between data and model distributions can be computed and optimized efficiently, requiring no expensive sampling or adversarial training.
We show with extensive experimental results that it can be applied to density estimation on synthetic data, image generation, image denoising, and training latent variable models with implicit encoders.
arXiv Detail & Related papers (2020-10-24T07:01:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.