Water and Sediment Analyse Using Predictive Models
- URL: http://arxiv.org/abs/2203.03422v1
- Date: Fri, 4 Mar 2022 02:28:01 GMT
- Title: Water and Sediment Analyse Using Predictive Models
- Authors: Xiaoting Xu, Tin Lai, Sayka Jahan, Farnaz Farid
- Abstract summary: Water quality assessment requires continuous monitoring of water and sediments at remote locations.
We propose an automated framework where we formalise a predictive model using Machine Learning.
We show that our model archives an accuracy of 75% after accounting for 57% of missing data.
- Score: 2.3226893628361682
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The increasing prevalence of marine pollution during the past few decades
motivated recent research to help ease the situation. Typical water quality
assessment requires continuous monitoring of water and sediments at remote
locations with labour intensive laboratory tests to determine the degree of
pollution. We propose an automated framework where we formalise a predictive
model using Machine Learning to infer the water quality and level of pollution
using collected water and sediments samples. One commonly encountered
difficulty performing statistical analysis with water and sediment is the
limited amount of data samples and incomplete dataset due to the sparsity of
sample collection location. To this end, we performed extensive investigation
on various data imputation methods' performance in water and sediment datasets
with various data missing rates. Empirically, we show that our best model
archives an accuracy of 75% after accounting for 57% of missing data.
Experimentally, we show that our model would assist in assessing water quality
screening based on possibly incomplete real-world data.
Related papers
- Smoke and Mirrors in Causal Downstream Tasks [59.90654397037007]
This paper looks at the causal inference task of treatment effect estimation.
We assume binary effects that are recorded as high-dimensional images in a Randomized Controlled Trial.
We compare 6 480 models fine-tuned from state-of-the-art visual backbones.
We find that the sampling and modeling choices significantly affect the accuracy of the causal estimate.
arXiv Detail & Related papers (2024-05-27T13:26:34Z) - Modeling groundwater levels in California's Central Valley by hierarchical Gaussian process and neural network regression [9.816891579613628]
A novel machine learning method is formulated for modeling groundwater levels by learning from a 3D lithological texture model of the Central Valley aquifer.
We show how the model predictions may be used to supplement hydrological understanding of aquifer responses in basins with irregular well data.
Our results indicate that on average the 2017 and 2019 wet years in California were largely ineffective in replenishing the groundwater loss caused during previous drought years.
arXiv Detail & Related papers (2023-10-23T04:21:26Z) - Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance.
We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach.
Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
arXiv Detail & Related papers (2023-09-12T13:28:06Z) - Exploring the Effectiveness of Dataset Synthesis: An application of
Apple Detection in Orchards [68.95806641664713]
We explore the usability of Stable Diffusion 2.1-base for generating synthetic datasets of apple trees for object detection.
We train a YOLOv5m object detection model to predict apples in a real-world apple detection dataset.
Results demonstrate that the model trained on generated data is slightly underperforming compared to a baseline model trained on real-world images.
arXiv Detail & Related papers (2023-06-20T09:46:01Z) - An evaluation of deep learning models for predicting water depth
evolution in urban floods [59.31940764426359]
We compare different deep learning models for prediction of water depth at high spatial resolution.
Deep learning models are trained to reproduce the data simulated by the CADDIES cellular-automata flood model.
Our results show that the deep learning models present in general lower errors compared to the other methods.
arXiv Detail & Related papers (2023-02-20T16:08:54Z) - Recognition of Defective Mineral Wool Using Pruned ResNet Models [88.24021148516319]
We developed a visual quality control system for mineral wool.
X-ray images of wool specimens were collected to create a training set of defective and non-defective samples.
We obtained a model with more than 98% accuracy, which in comparison to the current procedure used at the company, it can recognize 20% more defective products.
arXiv Detail & Related papers (2022-11-01T13:58:02Z) - Experimental study of time series forecasting methods for groundwater
level prediction [0.0]
We created a dataset of 1026 groundwater level time series.
Each time series is made of daily measurements of groundwater levels and two variables, rainfall and evapotranspiration.
We compared different predictors including local and global time series forecasting methods.
Our result analysis shows that the best predictions are obtained by training a global method on past groundwater levels and rainfall data.
arXiv Detail & Related papers (2022-09-28T08:58:55Z) - Predictive modeling of microbiological seawater quality classification
in karst region using cascade model [0.0]
In this paper, an in-depth analysis of Escherichia coli seawater measurements during the bathing season in Rijeka, Croatia was conducted.
Submerged sources of groundwater were observed at several measurement locations which could be the cause for increased E. coli values.
A cascade machine learning model is used to predict coastal water quality based on meteorological data.
arXiv Detail & Related papers (2022-02-11T15:03:31Z) - Unassisted Noise Reduction of Chemical Reaction Data Sets [59.127921057012564]
We propose a machine learning-based, unassisted approach to remove chemically wrong entries from data sets.
Our results show an improved prediction quality for models trained on the cleaned and balanced data sets.
arXiv Detail & Related papers (2021-02-02T09:34:34Z) - Detection of Anomalies in a Time Series Data using InfluxDB and Python [0.0]
This paper demonstrates data cleaning and preparation for time-series data.
It further proposes cost-sensitive machine learning algorithms as a solution to detect anomalous data points in time-series data.
arXiv Detail & Related papers (2020-12-15T17:27:39Z) - Data Pre-Processing and Evaluating the Performance of Several Data
Mining Methods for Predicting Irrigation Water Requirement [2.2108425580353774]
Recent drought and population growth are planting unprecedented demand for the use of available limited water resources.
To improve water management in irrigated areas, models for estimation of future water requirements are needed.
Data mining can be used effectively to build such models.
arXiv Detail & Related papers (2020-03-01T05:42:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.