Forecast-Aware Model Driven LSTM
- URL: http://arxiv.org/abs/2303.12963v1
- Date: Thu, 23 Mar 2023 00:03:07 GMT
- Title: Forecast-Aware Model Driven LSTM
- Authors: Sophia Hamer, Jennifer Sleeman, Ivanka Stajner
- Abstract summary: Poor air quality can have a significant impact on human health.
Traditional methods used to correct model bias make assumptions about linearity and the underlying distribution.
Deep learning holds promise for air quality forecasting in the presence of extreme air quality events.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Poor air quality can have a significant impact on human health. The National
Oceanic and Atmospheric Administration (NOAA) air quality forecasting guidance
is challenged by the increasing presence of extreme air quality events due to
extreme weather events such as wild fires and heatwaves. These extreme air
quality events further affect human health. Traditional methods used to correct
model bias make assumptions about linearity and the underlying distribution.
Extreme air quality events tend to occur without a strong signal leading up to
the event and this behavior tends to cause existing methods to either under or
over compensate for the bias. Deep learning holds promise for air quality
forecasting in the presence of extreme air quality events due to its ability to
generalize and learn nonlinear problems. However, in the presence of these
anomalous air quality events, standard deep network approaches that use a
single network for generalizing to future forecasts, may not always provide the
best performance even with a full feature-set including geography and
meteorology. In this work we describe a method that combines unsupervised
learning and a forecast-aware bi-directional LSTM network to perform bias
correction for operational air quality forecasting using AirNow station data
for ozone and PM2.5 in the continental US. Using an unsupervised clustering
method trained on station geographical features such as latitude and longitude,
urbanization, and elevation, the learned clusters direct training by
partitioning the training data for the LSTM networks. LSTMs are forecast-aware
and implemented using a unique way to perform learning forward and backwards in
time across forecasting days. When comparing the RMSE of the forecast model to
the RMSE of the bias corrected model, the bias corrected model shows
significant improvement (27\% lower RMSE for ozone) over the base forecast.
Related papers
- Efficient Localized Adaptation of Neural Weather Forecasting: A Case Study in the MENA Region [62.09891513612252]
We focus on limited-area modeling and train our model specifically for localized region-level downstream tasks.
We consider the MENA region due to its unique climatic challenges, where accurate localized weather forecasting is crucial for managing water resources, agriculture and mitigating the impacts of extreme weather events.
Our study aims to validate the effectiveness of integrating parameter-efficient fine-tuning (PEFT) methodologies, specifically Low-Rank Adaptation (LoRA) and its variants, to enhance forecast accuracy, as well as training speed, computational resource utilization, and memory efficiency in weather and climate modeling for specific regions.
arXiv Detail & Related papers (2024-09-11T19:31:56Z) - WaveCatBoost for Probabilistic Forecasting of Regional Air Quality Data [0.0]
This letter presents a novel WaveCatBoost architecture designed to forecast the real-time concentrations of air pollutants.
This hybrid approach efficiently transforms time series into high-frequency and low-frequency components, thereby extracting signal from noise.
arXiv Detail & Related papers (2024-04-08T13:01:25Z) - ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast.
We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples.
Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
arXiv Detail & Related papers (2024-02-02T10:34:13Z) - FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather
Forecasting [56.73502043159699]
This work presents FengWu-GHR, the first data-driven global weather forecasting model running at the 0.09$circ$ horizontal resolution.
It introduces a novel approach that opens the door for operating ML-based high-resolution forecasts by inheriting prior knowledge from a low-resolution model.
The hindcast of weather prediction in 2022 indicates that FengWu-GHR is superior to the IFS-HRES.
arXiv Detail & Related papers (2024-01-28T13:23:25Z) - Air Quality Forecasting Using Machine Learning: A Global perspective
with Relevance to Low-Resource Settings [0.0]
Air pollution stands as the fourth leading cause of death globally.
This study proposes a novel machine learning approach for accurate air quality prediction using two months of air quality data.
arXiv Detail & Related papers (2024-01-09T05:52:02Z) - Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs.
Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative.
The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Intelligent model for offshore China sea fog forecasting [0.7503129292751938]
This study aims to develop an advanced sea fog forecasting method embedded in a numerical weather prediction model.
We employ a time-lagged correlation analysis technique to identify key predictors and decipher the underlying mechanisms driving sea fog occurrence.
To verify the accuracy of our method, we evaluate its performance using a comprehensive dataset spanning one year.
arXiv Detail & Related papers (2023-07-20T04:46:34Z) - Statistical post-processing of visibility ensemble forecasts [0.0]
We investigate the predictive performance of locally, semi-locally and regionally trained proportional odds logistic regression (POLR) and multilayer perceptron (MLP) neural network classifiers.
We show that while climatological forecasts outperform the raw ensemble by a wide margin, post-processing results in further substantial improvement in forecast skill.
arXiv Detail & Related papers (2023-05-24T16:41:36Z) - Forecasting large-scale circulation regimes using deformable
convolutional neural networks and global spatiotemporal climate data [86.1450118623908]
We investigate a supervised machine learning approach based on deformable convolutional neural networks (deCNNs)
We forecast the North Atlantic-European weather regimes during extended boreal winter for 1 to 15 days into the future.
Due to its wider field of view, we also observe deCNN achieving considerably better performance than regular convolutional neural networks at lead times beyond 5-6 days.
arXiv Detail & Related papers (2022-02-10T11:37:00Z) - Federated Learning in the Sky: Aerial-Ground Air Quality Sensing
Framework with UAV Swarms [53.38353133198842]
Air quality significantly affects human health, it is increasingly important to accurately and timely predict the Air Quality Index (AQI)
This paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting.
For ground sensing systems, we propose a Graph Convolutional neural network-based Long Short-Term Memory (GC-LSTM) model to achieve accurate, real-time and future AQI inference.
arXiv Detail & Related papers (2020-07-23T13:32:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.