AirQualityBench: A Realistic Evaluation Benchmark for Global Air Quality Forecasting

• URL: http://arxiv.org/abs/2605.05854v1
• Date: Thu, 07 May 2026 08:25:43 GMT
• Title: AirQualityBench: A Realistic Evaluation Benchmark for Global Air Quality Forecasting
• Abstract summary: We introduce StarbfAirQualityBench, a global multi-pollutant benchmark to evaluate forecasting models under realistic conditions.<n>The benchmark contains hourly observations from 3,720 monitoring stations over 2021--2025, covers six major pollutants, and preserves provider-native observation masks.<n>AirQualityBench shows that strong performance on sanitized datasets does not reliably transfer to global, fragmented monitoring streams.
• Score: 25.500339307707225
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Air-quality forecasting models are commonly evaluated on regional, preprocessed, and normalized datasets, where missing observations are removed or artificially completed. Such protocols simplify comparison but hide the conditions that dominate real monitoring networks: uneven global coverage, structured missingness, heterogeneous pollutant scales, and deployment cost. We introduce \textbf{AirQualityBench}, a global multi-pollutant benchmark designed to evaluate forecasting models under these realistic conditions. The benchmark contains hourly observations from 3,720 monitoring stations over 2021--2025, covers six major pollutants, and preserves provider-native observation masks. Rather than imputing a dense data tensor, AirQualityBench exposes missingness as part of the forecasting problem and reports errors on valid future observations after inverse transformation to physical concentration scales. Evaluating representative spatio-temporal models under this unified protocol shows that strong performance on sanitized datasets does not reliably transfer to global, fragmented monitoring streams. AirQualityBench therefore serves as a realistic testbed for scalable, mask-aware, and physically interpretable air-quality forecasting. All benchmark data, code, evaluation scripts, and baseline implementations are available at \href{https://github.com/Star-Learning/AirQualityBench}{GitHub}.

Related papers

• Air Quality Station Simulation via LSTM and Attention-Based Modelling [41.99844472131922]
  We present a deep-learning model, called SATADL, which can infer complex relations and output multiple-hour-ahead air-quality forecasts.<n>We demonstrate the performance of SATADL on four sets of air quality stations from around the world.
  arXiv  Detail & Related papers  (2026-08-12T09:26:56Z)
• EO-WM: A Physically Informed World Model for Probabilistic Earth Observation Forecasting [50.31500063307306]
  We introduce EO-WM, a video diffusion transformer for multispectral Earth Observation forecasting.<n> EO-WM incorporates a physically informed conditioning framework that represents meteorological forcing through a climatological baseline, weather anomalies, and cumulative physical stress signals.<n>Experiments show that EO-WM reduces the error in predicted Normalized Difference Vegetation Index (NDVI) decline amplitude by a relative 5.63% and improves directional hit rate by a relative 7.80%.
  arXiv  Detail & Related papers  (2026-06-25T16:53:30Z)
• RealBench: Benchmarking Data-Driven Numerical Weather Forecasting Under Operational Conditions and Extreme Event Challenges [31.389267895745252]
  We introduce RealBench, a next-generation benchmark for AI weather forecasting that emphasizes realistic evaluation under operational conditions.<n>RealBench features a strictly out-of-distribution test set spanning 2025 to eliminate data leakage and capture recent atmospheric regimes.<n>It integrates multiple data sources, including low-latency operational analysis and a large-scale global in-situ observation dataset comprising over 10,000 stations.
  arXiv  Detail & Related papers  (2026-05-24T08:46:17Z)
• Graph Convolutional Support Vector Regression for Robust Spatiotemporal Forecasting of Urban Air Pollution [0.0]
  This study proposes a Conal Support Regression Vector (GCSVR) framework for robust forecasting of urban air pollution.<n>The proposed framework is evaluated using air quality records from 37 monitoring stations in Mumbai and 18 stations in India.
  arXiv  Detail & Related papers  (2026-05-05T14:24:49Z)
• Synergistic Neural Forecasting of Air Pollution with Stochastic Sampling [50.3911487821783]
  Air pollution remains a leading global health and environmental risk, particularly in regions vulnerable to episodic air pollution spikes due to wildfires, urban haze and dust storms.<n>Here, we present SynCast, a high-resolution neural forecasting model that integrates meteorological and air composition data to improve predictions of both average and extreme pollution levels.
  arXiv  Detail & Related papers  (2025-10-28T01:18:00Z)
• Revisiting Multivariate Time Series Forecasting with Missing Values [65.30332997607141]
  Missing values are common in real-world time series.<n>Current approaches have developed an imputation-then-prediction framework that uses imputation modules to fill in missing values, followed by forecasting on the imputed data.<n>This framework overlooks a critical issue: there is no ground truth for the missing values, making the imputation process susceptible to errors that can degrade prediction accuracy.<n>We introduce Consistency-Regularized Information Bottleneck (CRIB), a novel framework built on the Information Bottleneck principle.
  arXiv  Detail & Related papers  (2025-09-27T20:57:48Z)
• Air Quality Prediction with A Meteorology-Guided Modality-Decoupled Spatio-Temporal Network [47.699409089023696]
  Air quality prediction plays a crucial role in public health and environmental protection.<n>Existing works underestimate the critical role atmospheric conditions in air quality prediction.<n> MDSTNet is an encoder framework explicitly that captures atmosphere-pollution dependencies for prediction.<n>ChinaAirNet is the first dataset combining air quality records with multi-pressure-level meteorological observations.
  arXiv  Detail & Related papers  (2025-04-14T09:18:11Z)
• Generating Fine-Grained Causality in Climate Time Series Data for Forecasting and Anomaly Detection [67.40407388422514]
  We design a conceptual fine-grained causal model named TBN Granger Causality. Second, we propose an end-to-end deep generative model called TacSas, which discovers TBN Granger Causality in a generative manner. We test TacSas on climate benchmark ERA5 for climate forecasting and the extreme weather benchmark of NOAA for extreme weather alerts.
  arXiv  Detail & Related papers  (2024-08-08T06:47:21Z)
• Air Quality Forecasting Using Machine Learning: A Global perspective with Relevance to Low-Resource Settings [0.0]
  Air pollution stands as the fourth leading cause of death globally. This study proposes a novel machine learning approach for accurate air quality prediction using two months of air quality data.
  arXiv  Detail & Related papers  (2024-01-09T05:52:02Z)
• Forecast-Aware Model Driven LSTM [0.0]
  Poor air quality can have a significant impact on human health. Traditional methods used to correct model bias make assumptions about linearity and the underlying distribution. Deep learning holds promise for air quality forecasting in the presence of extreme air quality events.
  arXiv  Detail & Related papers  (2023-03-23T00:03:07Z)
• DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting [11.334341754942917]
  We develop a methodology to correct, remap, and fine-tune gridded uniform forecasts of FourCastNet (FCN) This is akin to bias correction and post-processing of numerical weather prediction (NWP) We call this network the Deep-Learning-Corrector-Remapper (DLCR)
  arXiv  Detail & Related papers  (2022-10-21T23:04:44Z)
• Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework with UAV Swarms [53.38353133198842]
  Air quality significantly affects human health, it is increasingly important to accurately and timely predict the Air Quality Index (AQI) This paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting. For ground sensing systems, we propose a Graph Convolutional neural network-based Long Short-Term Memory (GC-LSTM) model to achieve accurate, real-time and future AQI inference.
  arXiv  Detail & Related papers  (2020-07-23T13:32:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.