AirFormer: Predicting Nationwide Air Quality in China with Transformers

• URL: http://arxiv.org/abs/2211.15979v1
• Date: Tue, 29 Nov 2022 07:22:49 GMT
• Title: AirFormer: Predicting Nationwide Air Quality in China with Transformers
• Authors: Yuxuan Liang, Yutong Xia, Songyu Ke, Yiwei Wang, Qingsong Wen, Junbo Zhang, Yu Zheng, Roger Zimmermann
• Abstract summary: AirFormer is a novel Transformer architecture to collectively predict nationwide air quality in China. AirFormer reduces prediction errors by 5%8% on 72-hour future predictions.
• Score: 43.48965814702661
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Air pollution is a crucial issue affecting human health and livelihoods, as well as one of the barriers to economic and social growth. Forecasting air quality has become an increasingly important endeavor with significant social impacts, especially in emerging countries like China. In this paper, we present a novel Transformer architecture termed AirFormer to collectively predict nationwide air quality in China, with an unprecedented fine spatial granularity covering thousands of locations. AirFormer decouples the learning process into two stages -- 1) a bottom-up deterministic stage that contains two new types of self-attention mechanisms to efficiently learn spatio-temporal representations; 2) a top-down stochastic stage with latent variables to capture the intrinsic uncertainty of air quality data. We evaluate AirFormer with 4-year data from 1,085 stations in the Chinese Mainland. Compared to the state-of-the-art model, AirFormer reduces prediction errors by 5%~8% on 72-hour future predictions. Our source code is available at https://github.com/yoshall/airformer.

Related papers

• Efficient Localized Adaptation of Neural Weather Forecasting: A Case Study in the MENA Region [62.09891513612252]
  We focus on limited-area modeling and train our model specifically for localized region-level downstream tasks. We consider the MENA region due to its unique climatic challenges, where accurate localized weather forecasting is crucial for managing water resources, agriculture and mitigating the impacts of extreme weather events. Our study aims to validate the effectiveness of integrating parameter-efficient fine-tuning (PEFT) methodologies, specifically Low-Rank Adaptation (LoRA) and its variants, to enhance forecast accuracy, as well as training speed, computational resource utilization, and memory efficiency in weather and climate modeling for specific regions.
  arXiv  Detail & Related papers  (2024-09-11T19:31:56Z)
• Back to the Future: GNN-based NO$_2$ Forecasting via Future Covariates [49.93577170464313]
  We deal with air quality observations in a city-wide network of ground monitoring stations. We propose a conditioning block that embeds past and future covariates into the current observations. We find that conditioning on future weather information has a greater impact than considering past traffic conditions.
  arXiv  Detail & Related papers  (2024-04-08T09:13:16Z)
• Difference Learning for Air Quality Forecasting Transport Emulation [3.019717250933788]
  The National Oceanic and Atmospheric Administration provides air quality forecasting guidance for the Continental United States. Their air quality forecasting model is based on a 15 km spatial resolution; however, the goal is to reach a three km spatial resolution. This is currently not feasible due in part to prohibitive computational requirements for modeling the transport of chemical species. We show how this method maintains skill in the presence of extreme air quality events, making it a potential candidate for operational use.
  arXiv  Detail & Related papers  (2024-02-22T18:58:05Z)
• FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather Forecasting [56.73502043159699]
  This work presents FengWu-GHR, the first data-driven global weather forecasting model running at the 0.09$circ$ horizontal resolution. It introduces a novel approach that opens the door for operating ML-based high-resolution forecasts by inheriting prior knowledge from a low-resolution model. The hindcast of weather prediction in 2022 indicates that FengWu-GHR is superior to the IFS-HRES.
  arXiv  Detail & Related papers  (2024-01-28T13:23:25Z)
• Air Quality Forecasting Using Machine Learning: A Global perspective with Relevance to Low-Resource Settings [0.0]
  Air pollution stands as the fourth leading cause of death globally. This study proposes a novel machine learning approach for accurate air quality prediction using two months of air quality data.
  arXiv  Detail & Related papers  (2024-01-09T05:52:02Z)
• Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
  State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative. The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
  arXiv  Detail & Related papers  (2023-09-24T19:57:22Z)
• Multi-scale Digital Twin: Developing a fast and physics-informed surrogate model for groundwater contamination with uncertain climate models [53.44486283038738]
  Climate change exacerbates the long-term soil management problem of groundwater contamination. We develop a physics-informed machine learning surrogate model using U-Net enhanced Fourier Neural Contaminated (PDENO) In parallel, we develop a convolutional autoencoder combined with climate data to reduce the dimensionality of climatic region similarities across the United States.
  arXiv  Detail & Related papers  (2022-11-20T06:46:35Z)
• Deep-AIR: A Hybrid CNN-LSTM Framework for Air Quality Modeling in Metropolitan Cities [28.233460564726034]
  Deep-AIR is a novel hybrid deep learning framework that combines a convolutional neural network with a long short-term memory network. Our proposed framework creates 1x1 convolution layers to strengthen the learning of cross-feature spatial interaction between air pollution and urban dynamic features. Our model attains an accuracy of 67.6%, 77.2%, and 66.1% in fine-grained hourly estimation, 1-hr, and 24-hr air pollution forecast for Hong Kong, and an accuracy of 65.0%, 75.3%, and 63.5% for Beijing.
  arXiv  Detail & Related papers  (2021-03-25T13:47:56Z)
• HighAir: A Hierarchical Graph Neural Network-Based Air Quality Forecasting Method [8.86417830514213]
  HighAir is a hierarchical graph neural network-based air quality forecasting method. We construct a city-level graph and station-level graphs from a hierarchical perspective. We compare HighAir with the state-of-the-art air quality forecasting methods on the dataset of Yangtze River Delta city group.
  arXiv  Detail & Related papers  (2021-01-12T02:31:14Z)
• Interpretable and Transferable Models to Understand the Impact of Lockdown Measures on Local Air Quality [5.273501657421094]
  COVID-19 related lockdown measures offer a unique opportunity to understand how changes in economic activity and traffic affect ambient air quality. We estimate pollution reduction over the lockdown period by using the measurements from ground air pollution monitoring stations. We show that our models achieve state-of-the-art performance on the data from air pollution measurement stations in Switzerland and in China.
  arXiv  Detail & Related papers  (2020-11-19T23:09:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.