Transfer Learning Approaches for Knowledge Discovery in Grid-based Geo-Spatiotemporal Data

• URL: http://arxiv.org/abs/2110.00841v1
• Date: Sat, 2 Oct 2021 16:55:34 GMT
• Title: Transfer Learning Approaches for Knowledge Discovery in Grid-based Geo-Spatiotemporal Data
• Authors: Aishwarya Sarkar, Jien Zhang, Chaoqun Lu, Ali Jannesari
• Abstract summary: Extracting and analyzing geo-spatiotemporal features is crucial to recognize underlying causes of natural, events such as floods. We propose HydroDeep, an effectively reusable pretrained model to address this problem of transferring knowledge from one region to another.
• Score: 1.2693545159861856
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Extracting and meticulously analyzing geo-spatiotemporal features is crucial to recognize intricate underlying causes of natural events, such as floods. Limited evidence about hidden factors leading to climate change makes it challenging to predict regional water discharge accurately. In addition, the explosive growth in complex geo-spatiotemporal environment data that requires repeated learning by the state-of-the-art neural networks for every new region emphasizes the need for new computationally efficient methods, advanced computational resources, and extensive training on a massive amount of available monitored data. We, therefore, propose HydroDeep, an effectively reusable pretrained model to address this problem of transferring knowledge from one region to another by effectively capturing their intrinsic geo-spatiotemporal variance. Further, we present four transfer learning approaches on HydroDeep for spatiotemporal interpretability that improve Nash-Sutcliffe efficiency by 9% to 108% in new regions with a 95% reduction in time.

Related papers

• Efficient Localized Adaptation of Neural Weather Forecasting: A Case Study in the MENA Region [62.09891513612252]
  We focus on limited-area modeling and train our model specifically for localized region-level downstream tasks. We consider the MENA region due to its unique climatic challenges, where accurate localized weather forecasting is crucial for managing water resources, agriculture and mitigating the impacts of extreme weather events. Our study aims to validate the effectiveness of integrating parameter-efficient fine-tuning (PEFT) methodologies, specifically Low-Rank Adaptation (LoRA) and its variants, to enhance forecast accuracy, as well as training speed, computational resource utilization, and memory efficiency in weather and climate modeling for specific regions.
  arXiv  Detail & Related papers  (2024-09-11T19:31:56Z)
• Geode: A Zero-shot Geospatial Question-Answering Agent with Explicit Reasoning and Precise Spatio-Temporal Retrieval [0.0]
  We introduce a pioneering system designed to tackle zero-shot geospatial question-answering tasks with high precision. Our approach represents a significant improvement in addressing the limitations of current large language models.
  arXiv  Detail & Related papers  (2024-06-26T21:59:54Z)
• Beyond Tides and Time: Machine Learning Triumph in Water Quality [0.0]
  This study aims to establish a robust predictive pipeline to both data science experts and those without domain specific knowledge. Our research aims to establish a robust predictive pipeline to both data science experts and those without domain specific knowledge.
  arXiv  Detail & Related papers  (2023-09-29T03:33:53Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• Exploring Geometric Deep Learning For Precipitation Nowcasting [28.44612565923532]
  We propose a geometric deep learning-based temporal Graph Convolutional Network (GCN) for precipitation nowcasting. The adjacency matrix that simulates the interactions among grid cells is learned automatically by minimizing the L1 loss between prediction and ground truth pixel value. We test the model on sequences of radar reflectivity maps over the Trento/Italy area.
  arXiv  Detail & Related papers  (2023-09-11T21:14:55Z)
• An evaluation of deep learning models for predicting water depth evolution in urban floods [59.31940764426359]
  We compare different deep learning models for prediction of water depth at high spatial resolution. Deep learning models are trained to reproduce the data simulated by the CADDIES cellular-automata flood model. Our results show that the deep learning models present in general lower errors compared to the other methods.
  arXiv  Detail & Related papers  (2023-02-20T16:08:54Z)
• Accelerating Domain-aware Deep Learning Models with Distributed Training [0.8164433158925593]
  We present a novel distributed domain-aware network that utilizes domain-specific knowledge with improved model performance. From our analysis, the network effectively predicts high peaks in discharge measurements at watershed outlets with up to 4.1x speedup. Our approach achieved a 12.6x overall speedup and the mean prediction performance by 16%.
  arXiv  Detail & Related papers  (2023-01-25T22:59:47Z)
• Convolutional generative adversarial imputation networks for spatio-temporal missing data in storm surge simulations [86.5302150777089]
  Generative Adversarial Imputation Nets (GANs) and GAN-based techniques have attracted attention as unsupervised machine learning methods. We name our proposed method as Con Conval Generative Adversarial Imputation Nets (Conv-GAIN)
  arXiv  Detail & Related papers  (2021-11-03T03:50:48Z)
• Applications of physics-informed scientific machine learning in subsurface science: A survey [64.0476282000118]
  Geosystems are geological formations altered by humans activities such as fossil energy exploration, waste disposal, geologic carbon sequestration, and renewable energy generation. The responsible use and exploration of geosystems are thus critical to the geosystem governance, which in turn depends on the efficient monitoring, risk assessment, and decision support tools for practical implementation. Fast advances in machine learning algorithms and novel sensing technologies in recent years have presented new opportunities for the subsurface research community to improve the efficacy and transparency of geosystem governance.
  arXiv  Detail & Related papers  (2021-04-10T13:40:22Z)
• HydroDeep -- A Knowledge Guided Deep Neural Network for Geo-Spatiotemporal Data Analysis [0.726437825413781]
  This paper demonstrates a hybrid neural network architecture - HydroDeep. It couples a process-based hydro-ecological model with a combination of Deep Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) Network. It outperforms the independent CNN's and LSTM's performance by 1.6% and 10.5% respectively in Nash-Sutcliffe efficiency.
  arXiv  Detail & Related papers  (2020-10-09T02:20:59Z)
• A Data Scientist's Guide to Streamflow Prediction [55.22219308265945]
  We focus on the element of hydrologic rainfall--runoff models and their application to forecast floods and predict streamflow. This guide aims to help interested data scientists gain an understanding of the problem, the hydrologic concepts involved, and the details that come up along the way.
  arXiv  Detail & Related papers  (2020-06-05T08:04:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.