ResoNet: Robust and Explainable ENSO Forecasts with Hybrid Convolution and Transformer Networks

• URL: http://arxiv.org/abs/2312.10429v1
• Date: Sat, 16 Dec 2023 12:12:31 GMT
• Title: ResoNet: Robust and Explainable ENSO Forecasts with Hybrid Convolution and Transformer Networks
• Authors: Pumeng Lyu, Tao Tang, Fenghua Ling, Jing-Jia Luo, Niklas Boers, Wanli Ouyang, and Lei Bai
• Abstract summary: Deep learning models can skillfully predict the El Nino-Southern Oscillation (ENSO) forecasts over 1.5 years ahead. We propose ResoNet, a DL model that combines convolutional neural network (CNN) and Transformer architectures. We show that ResoNet can robustly predict ESNO at lead times between 19 and 26 months, thus outperforming existing approaches in terms of the forecast horizon.
• Score: 47.60320586459432
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent studies have shown that deep learning (DL) models can skillfully predict the El Ni\~no-Southern Oscillation (ENSO) forecasts over 1.5 years ahead. However, concerns regarding the reliability of predictions made by DL methods persist, including potential overfitting issues and lack of interpretability. Here, we propose ResoNet, a DL model that combines convolutional neural network (CNN) and Transformer architectures. This hybrid architecture design enables our model to adequately capture local SSTA as well as long-range inter-basin interactions across oceans. We show that ResoNet can robustly predict ESNO at lead times between 19 and 26 months, thus outperforming existing approaches in terms of the forecast horizon. According to an explainability method applied to ResoNet predictions of El Ni\~no and La Ni\~na events from 1- to 18-month lead, we find that it predicts the Ni\~no3.4 index based on multiple physically reasonable mechanisms, such as the Recharge Oscillator concept, Seasonal Footprint Mechanism, and Indian Ocean capacitor effect. Moreover, we demonstrate that for the first time, the asymmetry between El Ni\~no and La Ni\~na development can be captured by ResoNet. Our results could help alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.

Related papers

• Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
  We introduce a novel method that applies diffusion models (DM) for weather forecasting. Our method can achieve both direct and iterative forecasting with the same modeling framework. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
  arXiv  Detail & Related papers  (2024-02-06T21:28:42Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• PreDiff: Precipitation Nowcasting with Latent Diffusion Models [28.52267957954304]
  We develop a conditional latent diffusion model capable of probabilistic forecasts. We incorporate an explicit knowledge alignment mechanism to align forecasts with domain-specific physical constraints.
  arXiv  Detail & Related papers  (2023-07-19T19:19:13Z)
• Human Trajectory Forecasting with Explainable Behavioral Uncertainty [63.62824628085961]
  Human trajectory forecasting helps to understand and predict human behaviors, enabling applications from social robots to self-driving cars. Model-free methods offer superior prediction accuracy but lack explainability, while model-based methods provide explainability but cannot predict well. We show that BNSP-SFM achieves up to a 50% improvement in prediction accuracy, compared with 11 state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-07-04T16:45:21Z)
• Convolutional GRU Network for Seasonal Prediction of the El Ni\~no-Southern Oscillation [24.35408676030181]
  We present a modified Convolutional Gated Recurrent Unit (ConvGRU) network for the El Nino-Southern Oscillation (ENSO) region-temporal sequence prediction problem. The proposed ConvGRU network, with an encoder-decoder sequence-to-sequence structure, takes historical SST maps of the Pacific region as input and generates future SST maps for subsequent months within the ENSO region. The results demonstrate that the ConvGRU network significantly improves the predictability of the Nino 3.4 index compared to LIM, AF, and RNN.
  arXiv  Detail & Related papers  (2023-06-18T00:15:45Z)
• Deep Learning for Day Forecasts from Sparse Observations [60.041805328514876]
  Deep neural networks offer an alternative paradigm for modeling weather conditions. MetNet-3 learns from both dense and sparse data sensors and makes predictions up to 24 hours ahead for precipitation, wind, temperature and dew point. MetNet-3 has a high temporal and spatial resolution, respectively, up to 2 minutes and 1 km as well as a low operational latency.
  arXiv  Detail & Related papers  (2023-06-06T07:07:54Z)
• Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate data [86.1450118623908]
  We investigate a supervised machine learning approach based on deformable convolutional neural networks (deCNNs) We forecast the North Atlantic-European weather regimes during extended boreal winter for 1 to 15 days into the future. Due to its wider field of view, we also observe deCNN achieving considerably better performance than regular convolutional neural networks at lead times beyond 5-6 days.
  arXiv  Detail & Related papers  (2022-02-10T11:37:00Z)
• Nowcasting-Nets: Deep Neural Network Structures for Precipitation Nowcasting Using IMERG [1.9860735109145415]
  We use Recurrent and Convolutional deep neural network structures to address the challenge of precipitation nowcasting. A total of five models are trained using Global Precipitation Measurement (GPM) Integrated Multi-satellitE Retrievals for GPM (IMERG) precipitation data over the Eastern Contiguous United States (CONUS) The models were designed to provide forecasts with a lead time of up to 1.5 hours and, by using a feedback loop approach, the ability of the models to extend the forecast time to 4.5 hours was also investigated.
  arXiv  Detail & Related papers  (2021-08-16T02:55:32Z)
• Graph Neural Networks for Improved El Ni\~no Forecasting [0.009620910657090186]
  We propose an application of Graph Neural Networks (GNN) to forecast El Nino-Southern Oscillation (ENSO) at long lead times. Preliminary results are promising and outperform state-of-the-art systems for projections 1 and 3 months ahead.
  arXiv  Detail & Related papers  (2020-12-02T23:40:53Z)
• Spatiotemporal Adaptive Neural Network for Long-term Forecasting of Financial Time Series [0.2793095554369281]
  We investigate whether deep neural networks (DNNs) can be used to forecast time series (TS) forecasts conjointly. We make use of the dynamic factor graph (DFG) to build a multivariate autoregressive model. With ACTM, it is possible to vary the autoregressive order of a TS model over time and model a larger set of probability distributions.
  arXiv  Detail & Related papers  (2020-03-27T00:53:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.