Forecast-Aware Model Driven LSTM
- URL: http://arxiv.org/abs/2303.12963v1
- Date: Thu, 23 Mar 2023 00:03:07 GMT
- Title: Forecast-Aware Model Driven LSTM
- Authors: Sophia Hamer, Jennifer Sleeman, Ivanka Stajner
- Abstract summary: Poor air quality can have a significant impact on human health.
Traditional methods used to correct model bias make assumptions about linearity and the underlying distribution.
Deep learning holds promise for air quality forecasting in the presence of extreme air quality events.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Poor air quality can have a significant impact on human health. The National
Oceanic and Atmospheric Administration (NOAA) air quality forecasting guidance
is challenged by the increasing presence of extreme air quality events due to
extreme weather events such as wild fires and heatwaves. These extreme air
quality events further affect human health. Traditional methods used to correct
model bias make assumptions about linearity and the underlying distribution.
Extreme air quality events tend to occur without a strong signal leading up to
the event and this behavior tends to cause existing methods to either under or
over compensate for the bias. Deep learning holds promise for air quality
forecasting in the presence of extreme air quality events due to its ability to
generalize and learn nonlinear problems. However, in the presence of these
anomalous air quality events, standard deep network approaches that use a
single network for generalizing to future forecasts, may not always provide the
best performance even with a full feature-set including geography and
meteorology. In this work we describe a method that combines unsupervised
learning and a forecast-aware bi-directional LSTM network to perform bias
correction for operational air quality forecasting using AirNow station data
for ozone and PM2.5 in the continental US. Using an unsupervised clustering
method trained on station geographical features such as latitude and longitude,
urbanization, and elevation, the learned clusters direct training by
partitioning the training data for the LSTM networks. LSTMs are forecast-aware
and implemented using a unique way to perform learning forward and backwards in
time across forecasting days. When comparing the RMSE of the forecast model to
the RMSE of the bias corrected model, the bias corrected model shows
significant improvement (27\% lower RMSE for ozone) over the base forecast.
Related papers
- Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models.
Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML)
We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
arXiv Detail & Related papers (2024-07-18T15:44:23Z) - WaveCatBoost for Probabilistic Forecasting of Regional Air Quality Data [0.0]
This letter presents a novel WaveCatBoost architecture designed to forecast the real-time concentrations of air pollutants.
This hybrid approach efficiently transforms time series into high-frequency and low-frequency components, thereby extracting signal from noise.
arXiv Detail & Related papers (2024-04-08T13:01:25Z) - ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast.
We also introduce a training-free extreme value enhancement strategy named ExEnsemble, which increases the variance of pixel values and improves the forecast robustness.
Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
arXiv Detail & Related papers (2024-02-02T10:34:13Z) - FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather
Forecasting [56.73502043159699]
This work presents FengWu-GHR, the first data-driven global weather forecasting model running at the 0.09$circ$ horizontal resolution.
It introduces a novel approach that opens the door for operating ML-based high-resolution forecasts by inheriting prior knowledge from a low-resolution model.
The hindcast of weather prediction in 2022 indicates that FengWu-GHR is superior to the IFS-HRES.
arXiv Detail & Related papers (2024-01-28T13:23:25Z) - Air Quality Forecasting Using Machine Learning: A Global perspective
with Relevance to Low-Resource Settings [0.0]
Air pollution stands as the fourth leading cause of death globally.
This study proposes a novel machine learning approach for accurate air quality prediction using two months of air quality data.
arXiv Detail & Related papers (2024-01-09T05:52:02Z) - Residual Diffusion Modeling for Km-scale Atmospheric Downscaling [51.061954281398116]
A cost-effective downscaling model is trained from a high-resolution 2-km weather model over Taiwan.
textitCorrDiff exhibits skillful RMSE and CRPS and faithfully recovers spectra and distributions even for extremes.
Downscaling global forecasts successfully retains many of these benefits, foreshadowing the potential of end-to-end, global-to-km-scales machine learning weather predictions.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Intelligent model for offshore China sea fog forecasting [0.7503129292751938]
This study aims to develop an advanced sea fog forecasting method embedded in a numerical weather prediction model.
We employ a time-lagged correlation analysis technique to identify key predictors and decipher the underlying mechanisms driving sea fog occurrence.
To verify the accuracy of our method, we evaluate its performance using a comprehensive dataset spanning one year.
arXiv Detail & Related papers (2023-07-20T04:46:34Z) - Statistical post-processing of visibility ensemble forecasts [0.0]
We investigate the predictive performance of locally, semi-locally and regionally trained proportional odds logistic regression (POLR) and multilayer perceptron (MLP) neural network classifiers.
We show that while climatological forecasts outperform the raw ensemble by a wide margin, post-processing results in further substantial improvement in forecast skill.
arXiv Detail & Related papers (2023-05-24T16:41:36Z) - A Machine Learning Outlook: Post-processing of Global Medium-range
Forecasts [0.0]
Post-processing typically takes the outputs of a Numerical Weather Prediction (NWP) model and applies linear statistical techniques.
We show that we can achieve accuracy improvements of up to 12% (RMSE) in a field such as temperature at 850hPa for a 7 day forecast.
We discuss the challenges of using standard metrics such as root mean squared error (RMSE) or anomaly correlation coefficient (ACC)
arXiv Detail & Related papers (2023-03-28T20:48:01Z) - Forecasting large-scale circulation regimes using deformable
convolutional neural networks and global spatiotemporal climate data [86.1450118623908]
We investigate a supervised machine learning approach based on deformable convolutional neural networks (deCNNs)
We forecast the North Atlantic-European weather regimes during extended boreal winter for 1 to 15 days into the future.
Due to its wider field of view, we also observe deCNN achieving considerably better performance than regular convolutional neural networks at lead times beyond 5-6 days.
arXiv Detail & Related papers (2022-02-10T11:37:00Z) - Federated Learning in the Sky: Aerial-Ground Air Quality Sensing
Framework with UAV Swarms [53.38353133198842]
Air quality significantly affects human health, it is increasingly important to accurately and timely predict the Air Quality Index (AQI)
This paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting.
For ground sensing systems, we propose a Graph Convolutional neural network-based Long Short-Term Memory (GC-LSTM) model to achieve accurate, real-time and future AQI inference.
arXiv Detail & Related papers (2020-07-23T13:32:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.