Interpretable Water Level Forecaster with Spatiotemporal Causal Attention Mechanisms

• URL: http://arxiv.org/abs/2303.00515v6
• Date: Thu, 29 Jun 2023 06:00:27 GMT
• Title: Interpretable Water Level Forecaster with Spatiotemporal Causal Attention Mechanisms
• Authors: Sunghcul Hong, Yunjin Choi and Jong-June Jeon
• Abstract summary: This work proposes a neuraltemporal model with a transformer exploiting a causal relationship based on prior knowledge. We use the Han River dataset from 2016 to compare 2021, and confirm that our model provides an interpretable and consistent model with prior knowledge.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Forecasting the water level of the Han River is essential to control traffic and avoid natural disasters. The stream flow of the Han River is affected by various and intricately connected factors. Thus, a simple forecasting machine frequently fails to capture its serial pattern. On the other hand, a complex predictive model loses the interpretability of the model output. This work proposes a neural network model with a novel transformer exploiting a causal relationship based on prior knowledge. The transformer consists of spatiotemporal attention weight that describes the spatial and temporal causation with multilayer networks with masking. Our model has two distinguished advantages against the existing spatiotemporal forecasting models. First, the model allows the heterogeneous predictors for each site such that a flexible regression is applicable to the causal network. Next, the model is adapted to partially identified causal structures. As a result, we have relaxed the constraints of the applicable causal network through our model. In real data analysis, we use the Han River dataset from 2016 to 2021, compare the proposed model with deep learning models, and confirm that our model provides an interpretable and consistent model with prior knowledge, such as a seasonality arising from the tidal force. Furthermore, in prediction performance, our model is better than or competitive with the state-of-the-art models.

Related papers

• AI-Driven Reinvention of Hydrological Modeling for Accurate Predictions and Interpretation to Transform Earth System Modeling [19.028024402759467]
  HydroTrace is an algorithm-driven, data-agnostic model for predicting streamflow. It achieves a Nash-Sutcliffe Efficiency of 98% and demonstrates strong generalization on unseen data.
  arXiv  Detail & Related papers  (2025-01-07T18:59:53Z)
• Spatio-temporal Causal Learning for Streamflow Forecasting [11.820781497467898]
  Causal Streamflow Forecasting (CSF) is tested in a real-world study in the Brazos River basin in Texas. Our results demonstrate that our method outperforms regular computational-temporal graph neural networks. This research offers a novel approach to streamflow prediction, showcasing the potential of combining advanced neural network techniques with domain-specific knowledge.
  arXiv  Detail & Related papers  (2024-11-26T23:19:56Z)
• Precipitation Nowcasting Using Diffusion Transformer with Causal Attention [3.9468501770612576]
  Current deep learning methods fall short in establishing effective dependencies between conditions and forecast results. We propose a Precipitationcasting Using Diffusion Transformer with Causal Attention model.
  arXiv  Detail & Related papers  (2024-10-17T08:10:41Z)
• Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
  Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models. Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML) We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
  arXiv  Detail & Related papers  (2024-07-18T15:44:23Z)
• Deep Vision-Based Framework for Coastal Flood Prediction Under Climate Change Impacts and Shoreline Adaptations [0.3413711585591077]
  We present a systematic framework for training high-fidelity Deep Vision-based coastal flood prediction models in low-data settings. We also introduce a deep CNN architecture tailored specifically to the coastal flood prediction problem at hand. The performance of the developed DL models is validated against commonly adopted geostatistical regression methods.
  arXiv  Detail & Related papers  (2024-06-06T19:54:34Z)
• SFANet: Spatial-Frequency Attention Network for Weather Forecasting [54.470205739015434]
  Weather forecasting plays a critical role in various sectors, driving decision-making and risk management. Traditional methods often struggle to capture the complex dynamics of meteorological systems. We propose a novel framework designed to address these challenges and enhance the accuracy of weather prediction.
  arXiv  Detail & Related papers  (2024-05-29T08:00:15Z)
• Improving robustness of jet tagging algorithms with adversarial training [56.79800815519762]
  We investigate the vulnerability of flavor tagging algorithms via application of adversarial attacks. We present an adversarial training strategy that mitigates the impact of such simulated attacks.
  arXiv  Detail & Related papers  (2022-03-25T19:57:19Z)
• Extreme precipitation forecasting using attention augmented convolutions [0.913755431537592]
  We propose a self-attention augmented convolution mechanism for extreme precipitation forecasting. Our experimental results show that the framework outperforms classical convolutional models by 12%. The proposed method increases machine learning as a tool for gaining insights into the physical causes of changing extremes.
  arXiv  Detail & Related papers  (2022-01-31T18:16:03Z)
• Interpretable Social Anchors for Human Trajectory Forecasting in Crowds [84.20437268671733]
  We propose a neural network-based system to predict human trajectory in crowds. We learn interpretable rule-based intents, and then utilise the expressibility of neural networks to model scene-specific residual. Our architecture is tested on the interaction-centric benchmark TrajNet++.
  arXiv  Detail & Related papers  (2021-05-07T09:22:34Z)
• Accurate and Robust Feature Importance Estimation under Distribution Shifts [49.58991359544005]
  PRoFILE is a novel feature importance estimation method. We show significant improvements over state-of-the-art approaches, both in terms of fidelity and robustness.
  arXiv  Detail & Related papers  (2020-09-30T05:29:01Z)
• Predictive Analytics for Water Asset Management: Machine Learning and Survival Analysis [55.41644538483948]
  We study a statistical and machine learning framework for the prediction of water pipe failures. We use a dataset containing the failure records of all pipes within the water distribution network in Barcelona, Spain. The results shed light on the effect of important risk factors, such as pipe geometry, age, material, and soil cover, among others.
  arXiv  Detail & Related papers  (2020-07-02T19:08:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.