TAUDiff: Highly efficient kilometer-scale downscaling using generative diffusion models
- URL: http://arxiv.org/abs/2412.13627v2
- Date: Thu, 13 Mar 2025 05:04:23 GMT
- Title: TAUDiff: Highly efficient kilometer-scale downscaling using generative diffusion models
- Abstract summary: It is crucial to achieve rapid turnaround, dynamical consistency, and accurate-temporal recovery for extreme weather events.<n>We propose an efficient diffusion model TAUDiff, that combines a deterministic-temporal model for mean field downscaling with a smaller generative diffusion model for recovering the fine-scale features.<n>Our approach can ensure quicker simulation of extreme events necessary for estimating associated risks and economic losses.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deterministic regression-based downscaling models for climate variables often suffer from spectral bias, which can be mitigated by generative models like diffusion models. To enable efficient and reliable simulation of extreme weather events, it is crucial to achieve rapid turnaround, dynamical consistency, and accurate spatio-temporal spectral recovery. We propose an efficient correction diffusion model, TAUDiff, that combines a deterministic spatio-temporal model for mean field downscaling with a smaller generative diffusion model for recovering the fine-scale stochastic features. We demonstrate the efficacy of this approach on downscaling atmospheric wind velocity fields obtained from coarse GCM simulations. We then extend TAUDiff for computationally efficient kilometer-scale downscaling of atmospheric wind velocity fields. Owing to low inference times, our approach can ensure quicker simulation of extreme events necessary for estimating associated risks and economic losses.
Related papers
- Scaling Reinforcement Learning for Diffusion Models via Velocity Matching [66.34541945134916]
RewardBench fine-tuning is an important tool for adapting diffusion models to human preferences and task-specific objectives.<n>Unlike autoregressive models, diffusion models do not provide tractable likelihoods for generated samples.<n>We propose reward-based velocity matching (RVM), a simple trajectory-free update that acts directly on the velocity field.
arXiv Detail & Related papers (2026-08-24T17:13:43Z) - Kastor: An efficient fine-tuning strategy for generative emulation of PDE simulations [14.561544063927228]
We propose a comprehensive methodology to adapt a deterministic physics foundation model into a highly efficient and accurate generative surrogate.<n>First, we introduce a two-stage inference scheme that combines a large-stride causal auto-regressive model with a non-causal temporal super-resolution network.<n>Second, we present Mean prediction regularization (MPR), a novel training objective that constrains the generative model to predict the deterministic distribution mean under null noise conditioning.
arXiv Detail & Related papers (2026-08-06T14:41:11Z) - Regional Climate Model Emulation with Diffusion Approaches: What is the Added Value of Generative Machine Learning? [0.0]
We introduce ParamDiffusion, a new two-stage diffusion-based framework.<n>We expand standard validation through a comprehensive framework aligned with climate-science needs.<n>We assess the added value of diffusion approaches relative to deterministic methods.
arXiv Detail & Related papers (2026-06-12T15:46:35Z) - Generative modeling of granular flow on inclined planes using conditional flow matching [4.880426970438706]
This study presents the first conditional flow matching framework for granular-flow reconstruction from sparse boundary observations.<n>A physics decoder maps the reconstructed velocity fields to stress states and energy fluctuation quantities.<n>Results demonstrate that conditional generative modeling offers a practical route for non-invasive inference of hidden bulk mechanics in granular media.
arXiv Detail & Related papers (2026-04-06T05:59:54Z) - CASCADE: Cross-scale Advective Super-resolution with Climate Assimilation and Downscaling Evolution [51.56484100374058]
CASCADE reconstructs fine structure by iteratively advecting coarse information along learned, flow-conditioned velocity warping fields.<n> evaluated on SEVIR radar data for 4x super-resolution of severe convective storms.<n> produces temporally coherent, physically consistent, and mass-conserving reconstructions well suited to advection-dominated extremes in atmospheric and oceanic applications.
arXiv Detail & Related papers (2026-02-18T14:41:54Z) - Divergence Minimization Preference Optimization for Diffusion Model Alignment [58.651951388346525]
Divergence Minimization Preference Optimization (DMPO) is a principled method for aligning diffusion models by minimizing reverse KL divergence.<n>Our results show that diffusion models fine-tuned with DMPO can consistently outperform or match existing techniques.<n>DMPO unlocks a robust and elegant pathway for preference alignment, bridging principled theory with practical performance in diffusion models.
arXiv Detail & Related papers (2025-07-10T07:57:30Z) - Iterative Distillation for Reward-Guided Fine-Tuning of Diffusion Models in Biomolecular Design [53.93023688824764]
We address the problem of fine-tuning diffusion models for reward-guided generation in biomolecular design.<n>We propose an iterative distillation-based fine-tuning framework that enables diffusion models to optimize for arbitrary reward functions.<n>Our off-policy formulation, combined with KL divergence minimization, enhances training stability and sample efficiency compared to existing RL-based methods.
arXiv Detail & Related papers (2025-07-01T05:55:28Z) - FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generation [51.110607281391154]
FlowMo is a training-free guidance method for enhancing motion coherence in text-to-video models.<n>It estimates motion coherence by measuring the patch-wise variance across the temporal dimension and guides the model to reduce this variance dynamically during sampling.
arXiv Detail & Related papers (2025-06-01T19:55:33Z) - A Generative Framework for Probabilistic, Spatiotemporally Coherent Downscaling of Climate Simulation [23.504915709396204]
We present a novel generative framework that uses a score-based diffusion model trained on high-resolution reanalysis data to capture the statistical properties of local weather dynamics.
We demonstrate that the model generates spatially and temporally coherent weather dynamics that align with global climate output.
arXiv Detail & Related papers (2024-12-19T19:47:35Z) - Energy-Based Diffusion Language Models for Text Generation [126.23425882687195]
Energy-based Diffusion Language Model (EDLM) is an energy-based model operating at the full sequence level for each diffusion step.
Our framework offers a 1.3$times$ sampling speedup over existing diffusion models.
arXiv Detail & Related papers (2024-10-28T17:25:56Z) - On conditional diffusion models for PDE simulations [53.01911265639582]
We study score-based diffusion models for forecasting and assimilation of sparse observations.
We propose an autoregressive sampling approach that significantly improves performance in forecasting.
We also propose a new training strategy for conditional score-based models that achieves stable performance over a range of history lengths.
arXiv Detail & Related papers (2024-10-21T18:31:04Z) - Ensemble-based, large-eddy reconstruction of wind turbine inflow in a near-stationary atmospheric boundary layer through generative artificial intelligence [0.0]
We develop a technique for time-resolved inflow reconstruction rooted in a large-eddy simulation model of the atmosphere.
Our "large-eddy reconstruction" technique blends observations and atmospheric model information through a diffusion model machine learning algorithm.
We verify the second-by-second reconstruction capability of our technique in three synthetic field campaigns.
arXiv Detail & Related papers (2024-10-17T20:53:04Z) - Dynamical-generative downscaling of climate model ensembles [13.376226374728917]
We propose a novel approach combining dynamical downscaling with generative artificial intelligence to reduce the cost and improve the uncertainty estimates of downscaled climate projections.
In our framework, an RCM dynamically downscales ESM output to an intermediate resolution, followed by a generative diffusion model that further refines the resolution to the target scale.
arXiv Detail & Related papers (2024-10-02T17:31:01Z) - MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling [68.69647625472464]
Downscaling, a crucial task in meteorological forecasting, enables the reconstruction of high-resolution meteorological states for target regions.
Previous downscaling methods lacked tailored designs for meteorology and encountered structural limitations.
We propose a novel model called MambaDS, which enhances the utilization of multivariable correlations and topography information.
arXiv Detail & Related papers (2024-08-20T13:45:49Z) - Conditional diffusion models for downscaling & bias correction of Earth system model precipitation [1.5193424827619018]
We propose a novel machine learning framework for simultaneous bias correction and downscaling.
Our approach ensures statistical fidelity, preserves large-scale spatial patterns and outperforms existing methods.
arXiv Detail & Related papers (2024-04-05T11:01:50Z) - Uncertainty-aware Surrogate Models for Airfoil Flow Simulations with Denoising Diffusion Probabilistic Models [26.178192913986344]
We make a first attempt to use denoising diffusion probabilistic models (DDPMs) to train an uncertainty-aware surrogate model for turbulence simulations.
Our results show DDPMs can successfully capture the whole distribution of solutions and, as a consequence, accurately estimate the uncertainty of the simulations.
We also evaluate an emerging generative modeling variant, flow matching, in comparison to regular diffusion models.
arXiv Detail & Related papers (2023-12-08T19:04:17Z) - Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs.
Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative.
The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Low-Light Image Enhancement with Wavelet-based Diffusion Models [50.632343822790006]
Diffusion models have achieved promising results in image restoration tasks, yet suffer from time-consuming, excessive computational resource consumption, and unstable restoration.
We propose a robust and efficient Diffusion-based Low-Light image enhancement approach, dubbed DiffLL.
arXiv Detail & Related papers (2023-06-01T03:08:28Z) - DiffESM: Conditional Emulation of Earth System Models with Diffusion
Models [2.1989764549743476]
A key application of Earth System Models (ESMs) is studying extreme weather events, such as heat waves or dry spells.
We show that diffusion models can effectively emulate the trends of ESMs under previously unseen climate scenarios.
arXiv Detail & Related papers (2023-04-23T17:12:33Z) - Modeling the space-time correlation of pulsed twin beams [68.8204255655161]
Entangled twin-beams generated by parametric down-conversion are among the favorite sources for imaging-oriented applications.
We propose a semi-analytic model which aims to bridge the gap between time-consuming numerical simulations and the unrealistic plane-wave pump theory.
arXiv Detail & Related papers (2023-01-18T11:29:49Z) - Your Autoregressive Generative Model Can be Better If You Treat It as an
Energy-Based One [83.5162421521224]
We propose a unique method termed E-ARM for training autoregressive generative models.
E-ARM takes advantage of a well-designed energy-based learning objective.
We show that E-ARM can be trained efficiently and is capable of alleviating the exposure bias problem.
arXiv Detail & Related papers (2022-06-26T10:58:41Z) - How Much is Enough? A Study on Diffusion Times in Score-based Generative
Models [76.76860707897413]
Current best practice advocates for a large T to ensure that the forward dynamics brings the diffusion sufficiently close to a known and simple noise distribution.
We show how an auxiliary model can be used to bridge the gap between the ideal and the simulated forward dynamics, followed by a standard reverse diffusion process.
arXiv Detail & Related papers (2022-06-10T15:09:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.