MoWE : A Mixture of Weather Experts

• URL: http://arxiv.org/abs/2509.09052v1
• Date: Wed, 10 Sep 2025 23:15:59 GMT
• Title: MoWE : A Mixture of Weather Experts
• Authors: Dibyajyoti Chakraborty, Romit Maulik, Peter Harrington, Dallas Foster, Mohammad Amin Nabian, Sanjay Choudhry,
• Abstract summary: This paper introduces a Mixture of Experts (MoWE) approach to overcome limitations in data-driven weather prediction.<n>The MoWE model is trained with significantly lower computational resources than the individual experts.<n>Our results demonstrate the effectiveness of this method, achieving up to a 10% lower Root Mean Squared Error (RMSE) than the best-performing AI weather model.
• Score: 2.2335780120432824
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Data-driven weather models have recently achieved state-of-the-art performance, yet progress has plateaued in recent years. This paper introduces a Mixture of Experts (MoWE) approach as a novel paradigm to overcome these limitations, not by creating a new forecaster, but by optimally combining the outputs of existing models. The MoWE model is trained with significantly lower computational resources than the individual experts. Our model employs a Vision Transformer-based gating network that dynamically learns to weight the contributions of multiple "expert" models at each grid point, conditioned on forecast lead time. This approach creates a synthesized deterministic forecast that is more accurate than any individual component in terms of Root Mean Squared Error (RMSE). Our results demonstrate the effectiveness of this method, achieving up to a 10% lower RMSE than the best-performing AI weather model on a 2-day forecast horizon, significantly outperforming individual experts as well as a simple average across experts. This work presents a computationally efficient and scalable strategy to push the state of the art in data-driven weather prediction by making the most out of leading high-quality forecast models.

Related papers

• Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction [16.777053443258094]
  This work explores the application of ensemble modeling to the multidimensional regression problem of trajectory prediction for vehicles in urban environments.<n>We show how, perhaps surprisingly, combining state-of-the-art deep learning models out-of-the-box with a simple confidence-weighted average method can enhance the overall prediction.
  arXiv  Detail & Related papers  (2025-09-17T11:18:16Z)
• Lightning-Fast Convective Outlooks: Predicting Severe Convective Environments with Global AI-based Weather Models [0.08271752505511926]
  Severe convective storms are among the most dangerous weather phenomena and accurate forecasts mitigate their impacts. Recently released suite of AI-based weather models produces medium-range forecasts within seconds. We assess the forecast skill of three top-performing AI-models for convective parameters against reanalysis and ECMWF's operational numerical weather prediction model IFS.
  arXiv  Detail & Related papers  (2024-06-13T07:46:03Z)
• Probabilistic Weather Forecasting with Hierarchical Graph Neural Networks [17.64833210797824]
  We propose a probabilistic weather forecasting model called Graph-EFM. The model combines a flexible latent-variable formulation with the successful graph-based forecasting framework. Ensemble forecasts from Graph-EFM achieve equivalent or lower errors than comparable deterministic models.
  arXiv  Detail & Related papers  (2024-06-07T09:01:25Z)
• Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling [55.13352174687475]
  This paper proposes a physics-AI hybrid model (i.e., WeatherGFT) which generalizes weather forecasts to finer-grained temporal scales beyond training dataset.<n>Specifically, we employ a carefully designed PDE kernel to simulate physical evolution on a small time scale.<n>We also introduce a lead time-aware training framework to promote the generalization of the model at different lead times.
  arXiv  Detail & Related papers  (2024-05-22T16:21:02Z)
• EWMoE: An effective model for global weather forecasting with mixture-of-experts [6.695845790670147]
  We propose EWMoE, an effective model for accurate global weather forecasting, which requires significantly less training data and computational resources. Our model incorporates three key components to enhance prediction accuracy: 3D absolute position embedding, a core Mixture-of-Experts layer, and two specific loss functions.
  arXiv  Detail & Related papers  (2024-05-09T16:42:13Z)
• Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
  We introduce a novel method that applies diffusion models (DM) for weather forecasting. Our method can achieve both direct and iterative forecasting with the same modeling framework. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
  arXiv  Detail & Related papers  (2024-02-06T21:28:42Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• Learning Robust Precipitation Forecaster by Temporal Frame Interpolation [65.5045412005064]
  We develop a robust precipitation forecasting model that demonstrates resilience against spatial-temporal discrepancies. Our approach has led to significant improvements in forecasting precision, culminating in our model securing textit1st place in the transfer learning leaderboard of the textitWeather4cast'23 competition.
  arXiv  Detail & Related papers  (2023-11-30T08:22:08Z)
• Beyond S-curves: Recurrent Neural Networks for Technology Forecasting [60.82125150951035]
  We develop an autencoder approach that employs recent advances in machine learning and time series forecasting. S-curves forecasts largely exhibit a mean average percentage error (MAPE) comparable to a simple ARIMA baseline. Our autoencoder approach improves the MAPE by 13.5% on average over the second-best result.
  arXiv  Detail & Related papers  (2022-11-28T14:16:22Z)
• Back2Future: Leveraging Backfill Dynamics for Improving Real-time Predictions in Future [73.03458424369657]
  In real-time forecasting in public health, data collection is a non-trivial and demanding task. 'Backfill' phenomenon and its effect on model performance has been barely studied in the prior literature. We formulate a novel problem and neural framework Back2Future that aims to refine a given model's predictions in real-time.
  arXiv  Detail & Related papers  (2021-06-08T14:48:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.