Improvements to the post-processing of weather forecasts using machine learning and feature selection

• URL: http://arxiv.org/abs/2604.19340v1
• Date: Tue, 21 Apr 2026 11:17:29 GMT
• Title: Improvements to the post-processing of weather forecasts using machine learning and feature selection
• Abstract summary: This study aims to develop and improve machine learning-based post-processing models for precipitation, temperature, and wind speed predictions.<n>By incorporating meteorological variables from grid points surrounding the target locations as input features and applying feature selection based on correlation analysis, we found that the LightGBM-based models achieved lower RMSE.<n>Because precipitation has a highly skewed distribution with many zero cases, we additionally examined Tweedie-based loss functions and event-weighted training strategies for precipitation forecasting.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This study aims to develop and improve machine learning-based post-processing models for precipitation, temperature, and wind speed predictions using the Mesoscale Model (MSM) dataset provided by the Japan Meteorological Agency (JMA) for 18 locations across Japan, including plains, mountainous regions, and islands. By incorporating meteorological variables from grid points surrounding the target locations as input features and applying feature selection based on correlation analysis, we found that, in our experimental setting, the LightGBM-based models achieved lower RMSE than the specific neural-network baselines tested in this study, including a reproduced CNN baseline, and also generally achieved lower RMSE than both the raw MSM forecasts and the JMA post-processing product, MSM Guidance (MSMG), across many locations and forecast lead times. Because precipitation has a highly skewed distribution with many zero cases, we additionally examined Tweedie-based loss functions and event-weighted training strategies for precipitation forecasting. These improved event-oriented performance relative to the original LightGBM model, especially at higher rainfall thresholds, although the gains were site dependent and overall performance remained slightly below MSMG.

Related papers

• Statistical versus machine learning-based spatial interpolation of post-processed ensemble weather forecasts [0.0]
  This study compares statistical and machine-learning-based methods for post-processing ECMWF 2-m temperature and 10-m wind speed forecasts.<n>We consider EMOS-based approaches, distributional regression networks, Transformers, and graph neural networks under both limited and extended predictor settings.
  arXiv  Detail & Related papers  (2026-09-07T14:00:29Z)
• PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learning [51.75061005702151]
  No-reference point cloud quality assessment (PCQA) has been an active topic in recent years and is used to measure and optimize the visual experience of point clouds.<n>We present PCQA-R1, the first reinforcement learning LMM for 3D point cloud quality assessment to simultaneously model quality understanding and scoring.
  arXiv  Detail & Related papers  (2026-08-19T07:21:58Z)
• A Comparative Study of Machine Learning Models for Hourly Forecasting of Air Temperature and Relative Humidity [0.0]
  This study compares seven machine learning models for predicting air temperature and relative humidity in Chongqing, China.<n>XGBoost achieves the best overall performance, with a test mean absolute error (MAE) of 0.302 C for air temperature and 1.271% for relative humidity.
  arXiv  Detail & Related papers  (2026-03-24T14:47:52Z)
• FuXiWeather2: Learning accurate atmospheric state estimation for operational global weather forecasting [15.10103712842682]
  We present FuXiWeather2, a unified end-to-end neural framework for assimilation and forecasting.<n>FuXiWeather2 generates high-resolution ($0.25circ$) global analysis fields and 10-day forecasts within minutes.<n>These high-quality analysis fields drive deterministic forecasts that exceed the skill of the HRES system in 91% of evaluated metrics.
  arXiv  Detail & Related papers  (2026-03-16T14:36:47Z)
• Accurate Prediction of Temperature Indicators in Eastern China Using a Multi-Scale CNN-LSTM-Attention model [0.0]
  We propose a weather prediction model based on a multi-scale convolutional CNN-LSTM-Attention architecture.<n>The model integrates Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) networks, and attention mechanisms.<n> Experimental results show that the model performs excellently in predicting temperature trends with high accuracy.
  arXiv  Detail & Related papers  (2024-12-11T00:42:31Z)
• Efficient Localized Adaptation of Neural Weather Forecasting: A Case Study in the MENA Region [62.09891513612252]
  We focus on limited-area modeling and train our model specifically for localized region-level downstream tasks. We consider the MENA region due to its unique climatic challenges, where accurate localized weather forecasting is crucial for managing water resources, agriculture and mitigating the impacts of extreme weather events. Our study aims to validate the effectiveness of integrating parameter-efficient fine-tuning (PEFT) methodologies, specifically Low-Rank Adaptation (LoRA) and its variants, to enhance forecast accuracy, as well as training speed, computational resource utilization, and memory efficiency in weather and climate modeling for specific regions.
  arXiv  Detail & Related papers  (2024-09-11T19:31:56Z)
• MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling [68.69647625472464]
  Downscaling, a crucial task in meteorological forecasting, enables the reconstruction of high-resolution meteorological states for target regions. Previous downscaling methods lacked tailored designs for meteorology and encountered structural limitations. We propose a novel model called MambaDS, which enhances the utilization of multivariable correlations and topography information.
  arXiv  Detail & Related papers  (2024-08-20T13:45:49Z)
• Site-specific Deterministic Temperature and Humidity Forecasts with Explainable and Reliable Machine Learning [0.0]
  Recent developments in machine learning have prompted increasing interest in applying ML as a novel approach towards this problem. We develop a working ML framework, named 'Multi-SiteBoost' and initial testing results show a significant improvement compared with gridded values from bias-corrected NWP models.
  arXiv  Detail & Related papers  (2024-04-04T09:12:13Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Machine learning for total cloud cover prediction [0.0]
  We investigate the performance of post-processing using multilayer perceptron (MLP) neural networks, gradient boosting machines (GBM) and random forest (RF) methods. Compared to the raw ensemble, all calibration methods result in a significant improvement in forecast skill. RF models provide the smallest increase in predictive performance, while POLR and GBM approaches perform best.
  arXiv  Detail & Related papers  (2020-01-16T17:13:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.