The Effect of Different Optimization Strategies to Physics-Constrained Deep Learning for Soil Moisture Estimation

• URL: http://arxiv.org/abs/2403.08154v1
• Date: Wed, 13 Mar 2024 00:32:30 GMT
• Title: The Effect of Different Optimization Strategies to Physics-Constrained Deep Learning for Soil Moisture Estimation
• Authors: Jianxin Xie, Bing Yao, Zheyu Jiang
• Abstract summary: We propose a physics-constrained deep learning (P-DL) framework to integrate physics-based principles on water transport and water sensing signals. We demonstrate the empirical convergence function Adams outperforms the other optimization methods in both mini-batch and full-batch training.
• Score: 5.804881282638357
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Soil moisture is a key hydrological parameter that has significant importance to human society and the environment. Accurate modeling and monitoring of soil moisture in crop fields, especially in the root zone (top 100 cm of soil), is essential for improving agricultural production and crop yield with the help of precision irrigation and farming tools. Realizing the full sensor data potential depends greatly on advanced analytical and predictive domain-aware models. In this work, we propose a physics-constrained deep learning (P-DL) framework to integrate physics-based principles on water transport and water sensing signals for effective reconstruction of the soil moisture dynamics. We adopt three different optimizers, namely Adam, RMSprop, and GD, to minimize the loss function of P-DL during the training process. In the illustrative case study, we demonstrate the empirical convergence of Adam optimizers outperforms the other optimization methods in both mini-batch and full-batch training.

Related papers

• Precision Soil Quality Analysis Using Transformer-based Data Fusion Strategies: A Systematic Review [6.184871136700834]
  This review explores the most recent advancements in transformer-based data fusion techniques in agricultural remote sensing (RS) We demonstrate that transformers have significantly outperformed conventional deep learning and machine learning methods since 2022. The review is specifically focused on soil analysis, due to the importance of soil condition in optimizing crop productivity and ensuring sustainable farming practices.
  arXiv  Detail & Related papers  (2024-10-24T01:26:21Z)
• AutoScale: Automatic Prediction of Compute-optimal Data Composition for Training LLMs [61.13296177652599]
  This paper demonstrates that the optimal composition of training data from different domains is scale-dependent. We introduce *AutoScale*, a novel, practical approach for optimizing data compositions at potentially large training data scales. Our evaluation on GPT-2 Large and BERT pre-training demonstrates *AutoScale*'s effectiveness in improving training convergence and downstream performance.
  arXiv  Detail & Related papers  (2024-07-29T17:06:30Z)
• See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition [56.87609859444084]
  parameter-efficient fine-tuning (PEFT) focuses on optimizing a select subset of parameters while keeping the rest fixed, significantly lowering computational and storage overheads. We take the first step to unify all approaches by dissecting them from a decomposition perspective. We introduce two novel PEFT methods alongside a simple yet effective framework designed to enhance the performance of PEFT techniques across various applications.
  arXiv  Detail & Related papers  (2024-07-07T15:44:42Z)
• A Comparative Study of Machine Learning Algorithms for Anomaly Detection in Industrial Environments: Performance and Environmental Impact [62.997667081978825]
  This study seeks to address the demands of high-performance machine learning models with environmental sustainability. Traditional machine learning algorithms, such as Decision Trees and Random Forests, demonstrate robust efficiency and performance. However, superior outcomes were obtained with optimised configurations, albeit with a commensurate increase in resource consumption.
  arXiv  Detail & Related papers  (2023-07-01T15:18:00Z)
• PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning [54.409634256153154]
  In Reinforcement Learning (RL), enhancing sample efficiency is crucial. In principle, off-policy RL algorithms can improve sample efficiency by allowing multiple updates per environment interaction. Our study investigates the underlying causes of this phenomenon by dividing plasticity into two aspects.
  arXiv  Detail & Related papers  (2023-06-19T06:14:51Z)
• Impact of sensor placement in soil water estimation: A real-case study [0.0]
  This work investigates the impact of sensor placement in soil moisture estimation for an actual agricultural field in Lethbridge, Alberta, Canada. A three-dimensional agro-hydrological model with heterogeneous soil parameters of the studied field is developed. The modal degree of observability is applied to the three-dimensional system to determine the optimal sensor locations.
  arXiv  Detail & Related papers  (2022-03-13T02:46:27Z)
• Artificial Intelligence Hybrid Deep Learning Model for Groundwater Level Prediction Using MLP-ADAM [0.0]
  In this paper, a multi-layer perceptron is applied to simulate groundwater level. The adaptive moment estimation algorithm is also used to this matter. Results indicate that deep learning algorithms can demonstrate a high accuracy prediction.
  arXiv  Detail & Related papers  (2021-07-29T10:11:45Z)
• Estimating Crop Primary Productivity with Sentinel-2 and Landsat 8 using Machine Learning Methods Trained with Radiative Transfer Simulations [58.17039841385472]
  We take advantage of all parallel developments in mechanistic modeling and satellite data availability for advanced monitoring of crop productivity. Our model successfully estimates gross primary productivity across a variety of C3 crop types and environmental conditions even though it does not use any local information from the corresponding sites. This highlights its potential to map crop productivity from new satellite sensors at a global scale with the help of current Earth observation cloud computing platforms.
  arXiv  Detail & Related papers  (2020-12-07T16:23:13Z)
• Performance Analysis of Optimizers for Plant Disease Classification with Convolutional Neural Networks [0.0]
  Crop failure owing to pests & diseases are inherent within Indian agriculture, leading to annual losses of 15 to 25% of productivity. This research uses Convolutional Networks for classification of farm or plant leaf samples of 3 crops into 15 classes.
  arXiv  Detail & Related papers  (2020-11-08T19:03:02Z)
• From Rain Generation to Rain Removal [67.71728610434698]
  We build a full Bayesian generative model for rainy image where the rain layer is parameterized as a generator. We employ the variational inference framework to approximate the expected statistical distribution of rainy image. Comprehensive experiments substantiate that the proposed model can faithfully extract the complex rain distribution.
  arXiv  Detail & Related papers  (2020-08-08T18:56:51Z)
• From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling [2.9897531698031403]
  We propose a differentiable parameter learning framework that efficiently learns a global mapping between inputs and parameters. As training data increases, dPL achieves better performance, more physical coherence, and better generalizability. We demonstrate examples that learned from soil moisture and streamflow, where dPL drastically outperformed existing evolutionary and regionalization methods.
  arXiv  Detail & Related papers  (2020-07-30T21:38:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.