Enhancing Heavy Rain Nowcasting with Multimodal Data: Integrating Radar and Satellite Observations

• URL: http://arxiv.org/abs/2511.00716v1
• Date: Sat, 01 Nov 2025 21:47:07 GMT
• Title: Enhancing Heavy Rain Nowcasting with Multimodal Data: Integrating Radar and Satellite Observations
• Authors: Rama Kassoumeh, David Rügamer, Henning Oppel,
• Abstract summary: In Germany, only 17.3% of hourly heavy rain events between 2001 and 2018 were recorded by rain gauges.<n> radar data are another source that effectively tracks ongoing precipitation.<n>We develop a multimodal nowcasting model that combines both radar and satellite imagery for predicting precipitation at lead times of 5, 15, and 30 minutes.
• Score: 12.519094153257592
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The increasing frequency of heavy rainfall events, which are a major cause of urban flooding, underscores the urgent need for accurate precipitation forecasting - particularly in urban areas where localized events often go undetected by ground-based sensors. In Germany, only 17.3% of hourly heavy rain events between 2001 and 2018 were recorded by rain gauges, highlighting the limitations of traditional monitoring systems. Radar data are another source that effectively tracks ongoing precipitation; however, forecasting the development of heavy rain using radar alone remains challenging due to the brief and unpredictable nature of such events. Our focus is on evaluating the effectiveness of fusing satellite and radar data for nowcasting. We develop a multimodal nowcasting model that combines both radar and satellite imagery for predicting precipitation at lead times of 5, 15, and 30 minutes. We demonstrate that this multimodal strategy significantly outperforms radar-only approaches. Experimental results show that integrating satellite data improves prediction accuracy, particularly for intense precipitation. The proposed model increases the Critical Success Index for heavy rain by 4% and for violent rain by 3% at a 5-minute lead time. Moreover, it maintains higher predictive skill at longer lead times, where radar-only performance declines. A qualitative analysis of the severe flooding event in the state of North Rhine-Westphalia, Germany in 2021 further illustrates the superior performance of the multimodal model. Unlike the radar-only model, which captures general precipitation patterns, the multimodal model yields more detailed and accurate forecasts for regions affected by heavy rain. This improved precision enables timely, reliable, life-saving warnings. Implementation available at https://github.com/RamaKassoumeh/Multimodal_heavy_rain

Related papers

• Extreme Weather Nowcasting via Local Precipitation Pattern Prediction [6.992919908851609]
  ExPreCast is an efficient deterministic framework for generating detailed radar forecasts.<n>Our approach achieves state-of-the-art performance, delivering accurate and reliable nowcasts across both normal and extreme rainfall regimes.
  arXiv  Detail & Related papers  (2026-02-05T01:55:14Z)
• DPSformer: A long-tail-aware model for improving heavy rainfall prediction [48.884870685632755]
  We introduce DPSformer, a long-tail-aware model that enriches representation of heavy rainfall events through a high-resolution branch.<n>For heavy rainfall events, DPSformer lifts the Critical Success Index (CSI) of a baseline Numerical Weather Prediction (NWP) model from 0.012 to 0.067.<n>Our work establishes an effective long-tailed paradigm for heavy rainfall prediction, offering a practical tool to enhance early warning systems and mitigate the societal impacts of extreme weather events.
  arXiv  Detail & Related papers  (2025-09-20T15:09:38Z)
• A Spatiotemporal Radar-Based Precipitation Model for Water Level Prediction and Flood Forecasting [0.9487148673655145]
  In July 2017, the cities of Goslar and G"ottingen experienced severe flood events characterized by short warning time of only 20 minutes.<n>This highlights the critical need for a more reliable and timely flood forecasting system.
  arXiv  Detail & Related papers  (2025-03-25T10:14:54Z)
• TRG-Net: An Interpretable and Controllable Rain Generator [61.2760968459789]
  This study proposes a novel deep learning based rain generator, which fully takes the physical generation mechanism underlying rains into consideration. Its significance lies in that the generator not only elaborately design essential elements of the rain to simulate expected rains, but also finely adapt to complicated and diverse practical rainy images. Our unpaired generation experiments demonstrate that the rain generated by the proposed rain generator is not only of higher quality, but also more effective for deraining and downstream tasks.
  arXiv  Detail & Related papers  (2024-03-15T03:27:39Z)
• CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded Modelling [93.65319031345197]
  We propose CasCast, a cascaded framework composed of a deterministic and a probabilistic part to decouple predictions for mesoscale precipitation distributions and small-scale patterns. CasCast significantly surpasses the baseline (up to +91.8%) for regional extreme-precipitation nowcasting.
  arXiv  Detail & Related papers  (2024-02-06T08:30:47Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• Transformer-based nowcasting of radar composites from satellite images for severe weather [45.0983299269404]
  We present a Transformer-based model for nowcasting ground-based radar image sequences using satellite data up to two hours lead time. Trained on a dataset reflecting severe weather conditions, the model predicts radar fields occurring under different weather phenomena. The model can support precipitation nowcasting across large domains without an explicit need for radar towers.
  arXiv  Detail & Related papers  (2023-10-30T13:17:38Z)
• Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
  State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative. The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
  arXiv  Detail & Related papers  (2023-09-24T19:57:22Z)
• Deep Learning for Rain Fade Prediction in Satellite Communications [6.619650459583444]
  Line of sight satellite systems, unmanned aerial vehicles, high-altitude platforms, and microwave links are extremely susceptible to rain. Rain fade forecasting for these systems is critical because it allows the system to switch between ground gateways proactively before a rain fade event to maintain seamless service. Deep learning architecture is proposed that forecasts future rain fade using satellite and radar imagery data as well as link power measurements.
  arXiv  Detail & Related papers  (2021-10-02T00:43:02Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Accurate and Clear Precipitation Nowcasting with Consecutive Attention and Rain-map Discrimination [11.686939430992966]
  We propose a new deep learning model for precipitation nowcasting that includes both the discrimination and attention techniques. The model is examined on a newly-built benchmark dataset that contains both radar data and actual rain data.
  arXiv  Detail & Related papers  (2021-02-16T14:22:54Z)
• Fusion of rain radar images and wind forecasts in a deep learning model applied to rain nowcasting [0.0]
  We train a deep learning model on a fusion of rainfall radar images and wind velocity produced by a weather forecast model. Our network outperforms by 8% the F1-score calculated for the optical flow on moderate and higher rain events for forecasts at a horizon time of 30 min. Merging rain and wind data has also proven to stabilize the training process and enabled significant improvement especially on the difficult-to-predict high precipitation rainfalls.
  arXiv  Detail & Related papers  (2020-12-09T12:50:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.