Mining Explainable Predictive Features for Water Quality Management

• URL: http://arxiv.org/abs/2212.04419v2
• Date: Fri, 9 Dec 2022 15:47:59 GMT
• Title: Mining Explainable Predictive Features for Water Quality Management
• Abstract summary: This paper develops a process for collecting data for features that represent a variety of variables over a spatial region. An analysis of the performance of the features is undertaken using the models and Shapley values. Evaluations are performed using several machine learning algorithms and water quality data from the Dublin Grand Canal basin.
• Score: 2.1629199031479396
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: With water quality management processes, identifying and interpreting relationships between features, such as location and weather variable tuples, and water quality variables, such as levels of bacteria, is key to gaining insights and identifying areas where interventions should be made. There is a need for a search process to identify the locations and types of phenomena that are influencing water quality and a need to explain how the quality is being affected and which factors are most relevant. This paper addresses both of these issues. A process is developed for collecting data for features that represent a variety of variables over a spatial region and which are used for training models and inference. An analysis of the performance of the features is undertaken using the models and Shapley values. Shapley values originated in cooperative game theory and can be used to aid in the interpretation of machine learning results. Evaluations are performed using several machine learning algorithms and water quality data from the Dublin Grand Canal basin.

Related papers

• AquaAugmentor: A Novel Feature Augmentation Algorithm for Water Potability Prediction [0.5731102471423569]
  This paper addresses the challenge of predicting water potability through machine learning and deep learning algorithms.<n>It introduces a novel feature augmentation algorithm, AquaAugmentor, to enhance the predictive performance of these models.<n>This study contributes to the broader efforts of ensuring safe water access and serves as a framework for employing machine learning in environmental quality assessments.
  arXiv  Detail & Related papers  (2026-07-17T09:11:24Z)
• Lake Detection and Water Quality Estimation in Sentinel-2 Data [42.17343824099138]
  We investigate and compare three distinct machine learning architectures for water body identification and monitoring.<n>Their performance is evaluated through quantitative metrics and real-world examples.<n>A major challenge for meaningful water quality assessment lies in the consistent and interpretable visualization of spectral water indices.
  arXiv  Detail & Related papers  (2026-05-23T10:56:51Z)
• Utilizing Earth Foundation Models to Enhance the Simulation Performance of Hydrological Models with AlphaEarth Embeddings [48.54230513143053]
  This study examines whether AlphaEarth Foundation embeddings offer a more informative way to describe basin characteristics.<n>We find that models using them achieve higher accuracy when predicting flows in basins not used for training.
  arXiv  Detail & Related papers  (2026-01-04T15:14:16Z)
• Estimating properties of a homogeneous bounded soil using machine learning models [0.0]
  This work focuses on estimating soil properties from water moisture measurements.<n>We consider simulated data generated by solving the initial-boundary value problem governing vertical infiltration in a homogeneous, bounded soil profile.<n>To address the parameter identification problem, which is formulated as a two-output regression task, we explore various machine learning models.
  arXiv  Detail & Related papers  (2025-06-02T07:25:03Z)
• Identifying Trustworthiness Challenges in Deep Learning Models for Continental-Scale Water Quality Prediction [69.38041171537573]
  Water quality is foundational to environmental sustainability, ecosystem resilience, and public health.<n>Deep learning offers transformative potential for large-scale water quality prediction and scientific insights generation.<n>Their widespread adoption in high-stakes operational decision-making, such as pollution mitigation and equitable resource allocation, is prevented by unresolved trustworthiness challenges.
  arXiv  Detail & Related papers  (2025-03-13T01:50:50Z)
• Machine learning in wastewater treatment: insights from modelling a pilot denitrification reactor [0.0]
  We use data from a pilot reactor at the Veas treatment facility in Norway to explore how machine learning can be used to optimize biological nitrate. Rather than focusing solely on predictive accuracy, our approach prioritizes understanding the foundational requirements for effective data-driven modelling.
  arXiv  Detail & Related papers  (2024-12-18T16:49:23Z)
• Normalization in Proportional Feature Spaces [49.48516314472825]
  normalization plays an important central role in data representation, characterization, visualization, analysis, comparison, classification, and modeling. The selection of an appropriate normalization method needs to take into account the type and characteristics of the involved features.
  arXiv  Detail & Related papers  (2024-09-17T17:46:27Z)
• Time Series Predictions in Unmonitored Sites: A Survey of Machine Learning Techniques in Water Resources [10.307058787085094]
  Prediction of dynamic environmental variables in unmonitored sites remains a long-standing challenge for water resources science. Modern machine learning methods increasingly outperform their process-based and empirical model counterparts for hydrologic time series prediction. We review relevant state-of-the art applications of machine learning for streamflow, water quality, and other water resources prediction.
  arXiv  Detail & Related papers  (2023-08-18T18:30:33Z)
• On the choice of training data for machine learning of geostrophic mesoscale turbulence [0.34376560669160383]
  'Data' plays a central role in data-driven methods, but is not often the subject of focus in investigations of machine learning algorithms. We consider the case of eddy-mean interaction in rotating stratified turbulence in the presence of lateral boundaries.
  arXiv  Detail & Related papers  (2023-07-03T03:43:21Z)
• Data Quality in Imitation Learning [15.939363481618738]
  In offline learning for robotics, we simply lack internet scale data, and so high quality datasets are a necessity. This is especially true in imitation learning (IL), a sample efficient paradigm for robot learning using expert demonstrations. In this work, we take the first step toward formalizing data quality for imitation learning through the lens of distribution shift.
  arXiv  Detail & Related papers  (2023-06-04T18:48:32Z)
• A Graph-Based Modeling Framework for Tracing Hydrological Pollutant Transport in Surface Waters [0.0]
  We present a graph modeling framework for understanding pollutant transport and fate across waterbodies, rivers, and watersheds. The graph representation provides an intuitive approach for capturing connectivity and for identifying upstream pollutant sources. Our tool ultimately seeks to help stakeholders design effective pollution prevention/mitigation practices.
  arXiv  Detail & Related papers  (2023-02-10T00:30:38Z)
• An Empirical Investigation of Commonsense Self-Supervision with Knowledge Graphs [67.23285413610243]
  Self-supervision based on the information extracted from large knowledge graphs has been shown to improve the generalization of language models. We study the effect of knowledge sampling strategies and sizes that can be used to generate synthetic data for adapting language models.
  arXiv  Detail & Related papers  (2022-05-21T19:49:04Z)
• Architectural Optimization and Feature Learning for High-Dimensional Time Series Datasets [0.7388859384645262]
  We study the problem of predicting the presence of transient noise artifacts in a gravitational wave detector. We introduce models that reduce the error rate by over 60% compared to the previous state of the art.
  arXiv  Detail & Related papers  (2022-02-27T23:41:23Z)
• Learning Conditional Invariance through Cycle Consistency [60.85059977904014]
  We propose a novel approach to identify meaningful and independent factors of variation in a dataset. Our method involves two separate latent subspaces for the target property and the remaining input information. We demonstrate on synthetic and molecular data that our approach identifies more meaningful factors which lead to sparser and more interpretable models.
  arXiv  Detail & Related papers  (2021-11-25T17:33:12Z)
• Hybrid and Automated Machine Learning Approaches for Oil Fields Development: the Case Study of Volve Field, North Sea [58.720142291102135]
  The paper describes the usage of intelligent approaches for field development tasks that may assist a decision-making process. We focus on the problem of wells location optimization and two tasks within it: improving the quality of oil production estimation and estimation of reservoir characteristics. The implemented approaches can be used to analyze different oil fields or adapted to similar physics-related problems.
  arXiv  Detail & Related papers  (2021-03-03T18:51:46Z)
• The role of feature space in atomistic learning [62.997667081978825]
  Physically-inspired descriptors play a key role in the application of machine-learning techniques to atomistic simulations. We introduce a framework to compare different sets of descriptors, and different ways of transforming them by means of metrics and kernels. We compare representations built in terms of n-body correlations of the atom density, quantitatively assessing the information loss associated with the use of low-order features.
  arXiv  Detail & Related papers  (2020-09-06T14:12:09Z)
• What is being transferred in transfer learning? [51.6991244438545]
  We show that when training from pre-trained weights, the model stays in the same basin in the loss landscape. We present that when training from pre-trained weights, the model stays in the same basin in the loss landscape and different instances of such model are similar in feature space and close in parameter space.
  arXiv  Detail & Related papers  (2020-08-26T17:23:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.