Data Pre-Processing and Evaluating the Performance of Several Data Mining Methods for Predicting Irrigation Water Requirement

• URL: http://arxiv.org/abs/2003.00411v1
• Date: Sun, 1 Mar 2020 05:42:04 GMT
• Title: Data Pre-Processing and Evaluating the Performance of Several Data Mining Methods for Predicting Irrigation Water Requirement
• Authors: Mahmood A. Khan, Md Zahidul Islam, Mohsin Hafeez
• Abstract summary: Recent drought and population growth are planting unprecedented demand for the use of available limited water resources. To improve water management in irrigated areas, models for estimation of future water requirements are needed. Data mining can be used effectively to build such models.
• Score: 2.2108425580353774
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent drought and population growth are planting unprecedented demand for the use of available limited water resources. Irrigated agriculture is one of the major consumers of freshwater. A large amount of water in irrigated agriculture is wasted due to poor water management practices. To improve water management in irrigated areas, models for estimation of future water requirements are needed. Developing a model for forecasting irrigation water demand can improve water management practices and maximise water productivity. Data mining can be used effectively to build such models. In this study, we prepare a dataset containing information on suitable attributes for forecasting irrigation water demand. The data is obtained from three different sources namely meteorological data, remote sensing images and water delivery statements. In order to make the prepared dataset useful for demand forecasting and pattern extraction, we pre-process the dataset using a novel approach based on a combination of irrigation and data mining knowledge. We then apply and compare the effectiveness of different data mining methods namely decision tree (DT), artificial neural networks (ANNs), systematically developed forest (SysFor) for multiple trees, support vector machine (SVM), logistic regression, and the traditional Evapotranspiration (ETc) methods and evaluate the performance of these models to predict irrigation water demand. Our experimental results indicate the usefulness of data pre-processing and the effectiveness of different classifiers. Among the six methods we used, SysFor produces the best prediction with 97.5% accuracy followed by a decision tree with 96% and ANN with 95% respectively by closely matching the predictions with actual water usage. Therefore, we recommend using SysFor and DT models for irrigation water demand forecasting.

Related papers

• Towards a Theoretical Understanding of Memorization in Diffusion Models [76.85077961718875]
  Diffusion probabilistic models (DPMs) are being employed as mainstream models for Generative Artificial Intelligence (GenAI) We provide a theoretical understanding of memorization in both conditional and unconditional DPMs under the assumption of model convergence. We propose a novel data extraction method named textbfSurrogate condItional Data Extraction (SIDE) that leverages a time-dependent classifier trained on the generated data as a surrogate condition to extract training data from unconditional DPMs.
  arXiv  Detail & Related papers  (2024-10-03T13:17:06Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• Rapid Flood Inundation Forecast Using Fourier Neural Operator [77.30160833875513]
  Flood inundation forecast provides critical information for emergency planning before and during flood events. High-resolution hydrodynamic modeling has become more accessible in recent years, however, predicting flood extents at the street and building levels in real-time is still computationally demanding. We present a hybrid process-based and data-driven machine learning (ML) approach for flood extent and inundation depth prediction.
  arXiv  Detail & Related papers  (2023-07-29T22:49:50Z)
• Integrating machine learning paradigms and mixed-integer model predictive control for irrigation scheduling [0.20999222360659603]
  Agricultural sector faces significant challenges in water resource conservation and crop yield optimization. Traditional irrigation scheduling methods often prove inadequate in meeting the needs of large-scale irrigation systems. This paper proposes a predictive irrigation scheduler that leverages the three paradigms of machine learning to optimize irrigation schedules.
  arXiv  Detail & Related papers  (2023-06-14T19:38:44Z)
• Optimizing Irrigation Efficiency using Deep Reinforcement Learning in the Field [4.091593765662773]
  Agricultural irrigation is a significant contributor to freshwater consumption. Current irrigation systems do not account for future soil moisture loss. This paper proposes a solution to improve irrigation efficiency, which is called DRLIC.
  arXiv  Detail & Related papers  (2023-04-04T01:04:53Z)
• An evaluation of deep learning models for predicting water depth evolution in urban floods [59.31940764426359]
  We compare different deep learning models for prediction of water depth at high spatial resolution. Deep learning models are trained to reproduce the data simulated by the CADDIES cellular-automata flood model. Our results show that the deep learning models present in general lower errors compared to the other methods.
  arXiv  Detail & Related papers  (2023-02-20T16:08:54Z)
• Artificial Intelligence Hybrid Deep Learning Model for Groundwater Level Prediction Using MLP-ADAM [0.0]
  In this paper, a multi-layer perceptron is applied to simulate groundwater level. The adaptive moment estimation algorithm is also used to this matter. Results indicate that deep learning algorithms can demonstrate a high accuracy prediction.
  arXiv  Detail & Related papers  (2021-07-29T10:11:45Z)
• Towards a Multimodal System for Precision Agriculture using IoT and Machine Learning [0.5249805590164902]
  Technology like Internet of Things (IoT) for data collection, machine Learning for crop damage prediction, and deep learning for crop disease detection is used. Various algorithms like Random Forest (RF), Light gradient boosting machine (LGBM), XGBoost (XGB), Decision Tree (DT) and K Nearest Neighbor (KNN) are used for crop damage prediction. Pre-Trained Convolutional Neural Network (CNN) models such as VGG16, Resnet50, and DenseNet121 are also trained to check if the crop was tainted with some illness or not.
  arXiv  Detail & Related papers  (2021-07-10T19:19:45Z)
• High-resolution global irrigation prediction with Sentinel-2 30m data [0.8137198664755597]
  An accurate and precise understanding of global irrigation usage is crucial for a variety of climate science efforts. We have developed a novel irrigation model and Python package ("Irrigation30") to generate 30m resolution irrigation predictions of cropland worldwide. Our model was able to achieve consistency scores in excess of 97% and an accuracy of 92% in a small geo-diverse randomly sampled test set.
  arXiv  Detail & Related papers  (2020-12-09T17:26:43Z)
• Learning from Data to Optimize Control in Precision Farming [77.34726150561087]
  Special issue presents the latest development in statistical inference, machine learning and optimum control for precision farming. Satellite positioning and navigation followed by Internet-of-Things generate vast information that can be used to optimize farming processes in real-time.
  arXiv  Detail & Related papers  (2020-07-07T12:44:17Z)
• Predictive Analytics for Water Asset Management: Machine Learning and Survival Analysis [55.41644538483948]
  We study a statistical and machine learning framework for the prediction of water pipe failures. We use a dataset containing the failure records of all pipes within the water distribution network in Barcelona, Spain. The results shed light on the effect of important risk factors, such as pipe geometry, age, material, and soil cover, among others.
  arXiv  Detail & Related papers  (2020-07-02T19:08:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.