A Nonlinear Low-rank Representation Model with Convolutional Neural Network for Imputing Water Quality Data

• URL: http://arxiv.org/abs/2506.23629v1
• Date: Mon, 30 Jun 2025 08:48:19 GMT
• Title: A Nonlinear Low-rank Representation Model with Convolutional Neural Network for Imputing Water Quality Data
• Authors: Xin Liao, Bing Yang, Cai Yu,
• Abstract summary: Integrity of Water Quality Data (WQD) is critical in environmental monitoring for scientific decision-making and ecological protection.<n>Traditional data imputation methods are difficult to depict the potential dynamics and fail to capture the deep data features.<n>This paper proposes a Low-rank Representation model (NLR) with Convolutional Neural Networks (CNN) for imputing missing WQD.
• Score: 12.655766751647985
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The integrity of Water Quality Data (WQD) is critical in environmental monitoring for scientific decision-making and ecological protection. However, water quality monitoring systems are often challenged by large amounts of missing data due to unavoidable problems such as sensor failures and communication delays, which further lead to water quality data becoming High-Dimensional and Sparse (HDS). Traditional data imputation methods are difficult to depict the potential dynamics and fail to capture the deep data features, resulting in unsatisfactory imputation performance. To effectively address the above issues, this paper proposes a Nonlinear Low-rank Representation model (NLR) with Convolutional Neural Networks (CNN) for imputing missing WQD, which utilizes CNNs to implement two ideas: a) fusing temporal features to model the temporal dependence of data between time slots, and b) Extracting nonlinear interactions and local patterns to mine higher-order relationships features and achieve deep fusion of multidimensional information. Experimental studies on three real water quality datasets demonstrate that the proposed model significantly outperforms existing state-of-the-art data imputation models in terms of estimation accuracy. It provides an effective approach for handling water quality monitoring data in complex dynamic environments.

Related papers

• Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models [66.57755931421285]
  Large-scale artificial intelligence (LAI) models pose significant challenges for real-time communication scenarios.<n>This paper proposes utilizing knowledge distillation (KD) techniques to extract and condense knowledge from LAI models.<n>We propose a fast distillation method featuring a pre-stored compression mechanism that eliminates the need for repetitive inference.
  arXiv  Detail & Related papers  (2025-06-16T08:42:16Z)
• A Causal Convolutional Low-rank Representation Model for Imputation of Water Quality Data [11.584987653534531]
  This paper proposes a Causal convolutional Low-rank Representation (CLR) model for imputing missing WQD to improve the completeness of the WQD.<n> Experimental studies on three real-world water quality datasets demonstrate that the proposed CLR model is superior to some of the existing state-of-the-art imputation models.
  arXiv  Detail & Related papers  (2025-04-21T16:27:16Z)
• Water Quality Data Imputation via A Fast Latent Factorization of Tensors with PID-based Optimizer [21.261626027956737]
  There are numerous missing values in water quality data due to sensor failure.<n>A Latent Factorization of PIDs (LFT) with Gradient Descent (SGD) proves to be an efficient imputation method.<n>This paper proposes a Fast Latent Factorization of PIDs (FLFT) model to tackle this issue.
  arXiv  Detail & Related papers  (2025-03-10T07:22:54Z)
• Graph Neural Networks for Pressure Estimation in Water Distribution Systems [44.99833362998488]
  Pressure and flow estimation in Water Distribution Networks (WDN) allows water management companies to optimize their control operations. We combine physics-based modeling and Graph Neural Networks (GNN), a data-driven approach, to address the pressure estimation problem. Our GNN-based model estimates the pressure of a large-scale WDN in The Netherlands with a MAE of 1.94mH$$O and a MAPE of 7%.
  arXiv  Detail & Related papers  (2023-11-17T15:30:12Z)
• Graph Neural Network-Based Anomaly Detection for River Network Systems [0.8399688944263843]
  Real-time monitoring of water quality is increasingly reliant on in-situ sensor technology. Anomaly detection is crucial for identifying erroneous patterns in sensor data. This paper presents a solution to the challenging task of anomaly detection for river network sensor data.
  arXiv  Detail & Related papers  (2023-04-19T01:32:32Z)
• A Neural PDE Solver with Temporal Stencil Modeling [44.97241931708181]
  Recent Machine Learning (ML) models have shown new promises in capturing important dynamics in high-resolution signals. This study shows that significant information is often lost in the low-resolution down-sampled features. We propose a new approach, which combines the strengths of advanced time-series sequence modeling and state-of-the-art neural PDE solvers.
  arXiv  Detail & Related papers  (2023-02-16T06:13:01Z)
• Convolutional generative adversarial imputation networks for spatio-temporal missing data in storm surge simulations [86.5302150777089]
  Generative Adversarial Imputation Nets (GANs) and GAN-based techniques have attracted attention as unsupervised machine learning methods. We name our proposed method as Con Conval Generative Adversarial Imputation Nets (Conv-GAIN)
  arXiv  Detail & Related papers  (2021-11-03T03:50:48Z)
• Autonomous Deep Quality Monitoring in Streaming Environments [18.354025162625557]
  This paper proposes the online quality monitoring methodology developed from recently developed deep learning algorithms for data streams, namely NADINE++. It features the integration of 1-D and 2-D convolutional layers to extract natural features of time-series and visual data streams captured from sensors and cameras of the injection molding machines from our own project. Real-time experiments have been conducted where the online quality monitoring task is simulated on the fly under the prequential test-then-train fashion.
  arXiv  Detail & Related papers  (2021-06-26T06:47:41Z)
• On the benefits of robust models in modulation recognition [53.391095789289736]
  Deep Neural Networks (DNNs) using convolutional layers are state-of-the-art in many tasks in communications. In other domains, like image classification, DNNs have been shown to be vulnerable to adversarial perturbations. We propose a novel framework to test the robustness of current state-of-the-art models.
  arXiv  Detail & Related papers  (2021-03-27T19:58:06Z)
• Neural ODE Processes [64.10282200111983]
  We introduce Neural ODE Processes (NDPs), a new class of processes determined by a distribution over Neural ODEs. We show that our model can successfully capture the dynamics of low-dimensional systems from just a few data-points.
  arXiv  Detail & Related papers  (2021-03-23T09:32:06Z)
• Deep convolutional generative adversarial networks for traffic data imputation encoding time series as images [7.053891669775769]
  We have developed a generative adversarial network (GAN) based traffic sensor data imputation framework (TGAN) In this study, we have developed a novel time-dependent encoding method called the Gramian Angular Summation Field (GASF) This study shows that the proposed model can significantly improve the traffic data imputation accuracy in terms of Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) compared to state-of-the-art models on the benchmark dataset.
  arXiv  Detail & Related papers  (2020-05-05T19:14:02Z)
• Adaptive Anomaly Detection for IoT Data in Hierarchical Edge Computing [71.86955275376604]
  We propose an adaptive anomaly detection approach for hierarchical edge computing (HEC) systems to solve this problem. We design an adaptive scheme to select one of the models based on the contextual information extracted from input data, to perform anomaly detection. We evaluate our proposed approach using a real IoT dataset, and demonstrate that it reduces detection delay by 84% while maintaining almost the same accuracy as compared to offloading detection tasks to the cloud.
  arXiv  Detail & Related papers  (2020-01-10T05:29:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.