Deep multi-stations weather forecasting: explainable recurrent convolutional neural networks

• URL: http://arxiv.org/abs/2009.11239v6
• Date: Wed, 10 Feb 2021 00:05:10 GMT
• Title: Deep multi-stations weather forecasting: explainable recurrent convolutional neural networks
• Authors: Ismail Alaoui Abdellaoui and Siamak Mehrkanoon
• Abstract summary: We show that adding a self-attention within the models increases the overall forecasting performance. The present paper compares two different deep learning architectures to perform weather prediction on daily gathered data from 18 cities across Europe.
• Score: 4.213427823201119
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Deep learning applied to weather forecasting has started gaining popularity because of the progress achieved by data-driven models. The present paper compares two different deep learning architectures to perform weather prediction on daily data gathered from 18 cities across Europe and spanned over a period of 15 years. We propose the Deep Attention Unistream Multistream (DAUM) networks that investigate different types of input representations (i.e. tensorial unistream vs. multistream ) as well as the incorporation of the attention mechanism. In particular, we show that adding a self-attention block within the models increases the overall forecasting performance. Furthermore, visualization techniques such as occlusion analysis and score maximization are used to give an additional insight on the most important features and cities for predicting a particular target feature of target cities.

Related papers

• Tackling Data Heterogeneity in Federated Time Series Forecasting [61.021413959988216]
  Time series forecasting plays a critical role in various real-world applications, including energy consumption prediction, disease transmission monitoring, and weather forecasting. Most existing methods rely on a centralized training paradigm, where large amounts of data are collected from distributed devices to a central cloud server. We propose a novel framework, Fed-TREND, to address data heterogeneity by generating informative synthetic data as auxiliary knowledge carriers.
  arXiv  Detail & Related papers  (2024-11-24T04:56:45Z)
• Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach [71.67506068703314]
  Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Traditionally, urban mobility data has been structured as videos, treating longitude and latitude as fundamental pixels. In our research, we introduce a fresh perspective on urban mobility prediction. Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex time series.
  arXiv  Detail & Related papers  (2023-12-04T07:39:05Z)
• FLODCAST: Flow and Depth Forecasting via Multimodal Recurrent Architectures [31.879514593973195]
  We propose a flow and depth forecasting model, trained to jointly forecast both modalities at once. We train the proposed model to also perform predictions for several timesteps in the future. We report benefits on the downstream task of segmentation forecasting, injecting our predictions in a flow-based mask-warping framework.
  arXiv  Detail & Related papers  (2023-10-31T16:30:16Z)
• Physically Explainable Deep Learning for Convective Initiation Nowcasting Using GOES-16 Satellite Observations [0.1874930567916036]
  Convection initiation (CI) nowcasting remains a challenging problem for both numerical weather prediction models and existing nowcasting algorithms. In this study, object-based probabilistic deep learning models are developed to predict CI based on multichannel infrared GOES-R satellite observations.
  arXiv  Detail & Related papers  (2023-10-24T17:18:44Z)
• TempSAL -- Uncovering Temporal Information for Deep Saliency Prediction [64.63645677568384]
  We introduce a novel saliency prediction model that learns to output saliency maps in sequential time intervals. Our approach locally modulates the saliency predictions by combining the learned temporal maps. Our code will be publicly available on GitHub.
  arXiv  Detail & Related papers  (2023-01-05T22:10:16Z)
• Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate data [86.1450118623908]
  We investigate a supervised machine learning approach based on deformable convolutional neural networks (deCNNs) We forecast the North Atlantic-European weather regimes during extended boreal winter for 1 to 15 days into the future. Due to its wider field of view, we also observe deCNN achieving considerably better performance than regular convolutional neural networks at lead times beyond 5-6 days.
  arXiv  Detail & Related papers  (2022-02-10T11:37:00Z)
• Multistream Graph Attention Networks for Wind Speed Forecasting [4.644923443649426]
  This paper presents a new model for wind speed prediction based on Graph Attention Networks (GAT) In particular, the proposed model extends GAT architecture by equipping it with a learnable adjacency matrix. We show that in comparison to previous architectures used for wind speed prediction, the proposed model is able to better learn the complex input-output relationships of the weather data.
  arXiv  Detail & Related papers  (2021-08-16T12:58:26Z)
• Deep Autoregressive Models with Spectral Attention [74.08846528440024]
  We propose a forecasting architecture that combines deep autoregressive models with a Spectral Attention (SA) module. By characterizing in the spectral domain the embedding of the time series as occurrences of a random process, our method can identify global trends and seasonality patterns. Two spectral attention models, global and local to the time series, integrate this information within the forecast and perform spectral filtering to remove time series's noise.
  arXiv  Detail & Related papers  (2021-07-13T11:08:47Z)
• Variational Structured Attention Networks for Deep Visual Representation Learning [49.80498066480928]
  We propose a unified deep framework to jointly learn both spatial attention maps and channel attention in a principled manner. Specifically, we integrate the estimation and the interaction of the attentions within a probabilistic representation learning framework. We implement the inference rules within the neural network, thus allowing for end-to-end learning of the probabilistic and the CNN front-end parameters.
  arXiv  Detail & Related papers  (2021-03-05T07:37:24Z)
• Joint Air Quality and Weather Prediction Based on Multi-Adversarial Spatiotemporal Networks [44.34236994440102]
  We propose the Multi-versaadrial recurrent Graph Neural Networks (MasterGNN) for joint air quality and weather predictions. Specifically, we first propose a recurrent graph neural network to model heterogeneous autotemporalcorrelation among air quality and weather monitoring stations.
  arXiv  Detail & Related papers  (2020-12-30T04:42:03Z)
• A clustering approach to time series forecasting using neural networks: A comparative study on distance-based vs. feature-based clustering methods [1.256413718364189]
  We propose various neural network architectures to forecast the time series data using the dynamic measurements. We also investigate the importance of performing techniques such as anomaly detection and clustering on forecasting accuracy. Our results indicate that clustering can improve the overall prediction time as well as improve the forecasting performance of the neural network.
  arXiv  Detail & Related papers  (2020-01-27T00:31:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.