VMU-Diff: A Coarse-to-fine Multi-source Data Fusion Framework for Precipitation Nowcasting

• URL: http://arxiv.org/abs/2605.14597v1
• Date: Thu, 14 May 2026 09:05:30 GMT
• Title: VMU-Diff: A Coarse-to-fine Multi-source Data Fusion Framework for Precipitation Nowcasting
• Abstract summary: Existing methods rely on single-source radar data to build either deterministic or probabilistic models.<n>This paper proposes a novel coarse-to-fine Vision Mamba Unet and residual Diffusion (VMU-Diff) based precipitation nowcasting framework.<n> Experiments on SWAN datasets demonstrate the improvements of our method over state-of-the-art methods.
• Score: 9.702321405779513
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Precipitation nowcasting is a vital spatio-temporal prediction task for meteorological applications but faces challenges due to the chaotic property of precipitation systems. Existing methods predominantly rely on single-source radar data to build either deterministic or probabilistic models for extrapolation. However, the single deterministic model suffers from blurring due to MSE convergence. The single probabilistic model, typically represented by diffusion models, can generate fine details but suffers from spurious artifacts that compromise accuracy and computational inefficiency. To address these challenges, this paper proposes a novel coarse-to-fine Vision Mamba Unet and residual Diffusion (VMU-Diff) based precipitation nowcasting framework. It realizes precipitation nowcasting through a two-stage process, i.e., a deterministic model-based coarse stage to predict global motion trends and a probabilistic model-based fine stage to generate fine prediction details. In the coarse prediction stage, rather than single-source radar data, both radar and multi-band satellite data are taken as input. A spatial-temporal attention block and several Vision mamba state-space blocks realize multi-source data fusion, and predict the future echo global dynamics. The fine-grained stage is realized by a spatio-temporal refine generator based on residual conditional diffusion models. It first obtains spatio-temporal residual features based on coarse prediction and ground truth, and further reconstructs the residual via conditional Mamba state-space module. Experiments on Jiangsu SWAN datasets demonstrate the improvements of our method over state-of-the-art methods, particularly in short-term forecasts.

Related papers

• STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting [22.29494904927957]
  Precipitation nowcasting is a critical prediction task for society to prevent severe damage owing to extreme weather events.<n>We present a simple yet effective model architecture termed STLDM, a diffusion-based model that learns the latent representation from end to end alongside both the Varitemporal Autoencoder and the conditioning network.
  arXiv  Detail & Related papers  (2025-12-24T11:34:44Z)
• HydroDiffusion: Diffusion-Based Probabilistic Streamflow Forecasting with a State Space Backbone [24.321954272892338]
  HydroDiffusion is a diffusion-based probabilistic forecasting framework with a decoder-only state space model backbone.<n>It is evaluated across 531 watersheds in the contiguous United States (CONUS) in the CAMELS dataset.<n>Results show that HydroDiffusion achieves strong nowcast accuracy when driven by observed meteorological forcings.
  arXiv  Detail & Related papers  (2025-12-13T05:05:27Z)
• Rectifying Distribution Shift in Cascaded Precipitation Nowcasting [1.1724961392643483]
  Precipitation nowcasting aims to provide high-temporal forecasts by leveraging current radar observations.<n>We introduce Recti, a framework that explicitlycouples the rectification of mean-field shift from the generation of locality.<n> Experiments on two radar datasets demonstrate that Recti achieves significant performance improvements over existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-11-19T02:06:30Z)
• Elucidated Rolling Diffusion Models for Probabilistic Weather Forecasting [52.6508222408558]
  We introduce Elucidated Rolling Diffusion Models (ERDM)<n>ERDM is the first framework to unify a rolling forecast structure with the principled, performant design of Elucidated Diffusion Models (EDM)<n>On 2D Navier-Stokes simulations and ERA5 global weather forecasting at 1.5circ resolution, ERDM consistently outperforms key diffusion-based baselines.
  arXiv  Detail & Related papers  (2025-06-24T21:44:31Z)
• DEF: Diffusion-augmented Ensemble Forecasting [5.433548785820674]
  We present DEF (textbfulEnsemble textbfulForecasting), a novel approach for generating initial condition perturbations.<n>We demonstrate that a simple conditional diffusion model can generate meaningful structured perturbations.<n>We show that the model accumulates less error over long-term forecasts while producing meaningful forecast distributions.
  arXiv  Detail & Related papers  (2025-06-08T23:43:41Z)
• Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
  Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models. Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML) We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
  arXiv  Detail & Related papers  (2024-07-18T15:44:23Z)
• Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
  We introduce a novel method that applies diffusion models (DM) for weather forecasting. Our method can achieve both direct and iterative forecasting with the same modeling framework. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
  arXiv  Detail & Related papers  (2024-02-06T21:28:42Z)
• DiffCast: A Unified Framework via Residual Diffusion for Precipitation Nowcasting [20.657502066923023]
  Precipitation nowcasting is an important task to predict the radar echoes sequences based on current observations, which can serve both meteorological science and smart city applications. Previous studies address the problem either from the perspectives of deterministic modeling or probabilistic modeling. We propose to decompose and model the chaotic evolutionary precipitation systems from the perspective of global deterministic motion and local variations with residual mechanism.
  arXiv  Detail & Related papers  (2023-12-11T11:26:32Z)
• Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
  State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative. The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
  arXiv  Detail & Related papers  (2023-09-24T19:57:22Z)
• Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Prediction [60.60223171143206]
  Trajectory prediction is a crucial undertaking in understanding entity movement or human behavior from observed sequences. Current methods often assume that the observed sequences are complete while ignoring the potential for missing values. This paper presents a unified framework, the Graph-based Conditional Variational Recurrent Neural Network (GC-VRNN), which can perform trajectory imputation and prediction simultaneously.
  arXiv  Detail & Related papers  (2023-03-28T14:27:27Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.