Investigating the Suitability of Concept Drift Detection for Detecting Leakages in Water Distribution Networks

• URL: http://arxiv.org/abs/2401.01733v1
• Date: Wed, 3 Jan 2024 13:12:04 GMT
• Title: Investigating the Suitability of Concept Drift Detection for Detecting Leakages in Water Distribution Networks
• Authors: Valerie Vaquet, Fabian Hinder, Barbara Hammer
• Abstract summary: Leakages are a major risk in water distribution networks as they cause water loss and increase contamination risks. Leakage detection is a difficult task due to the complex dynamics of water distribution networks. From a machine-learning perspective, leakages can be modeled as concept drift.
• Score: 7.0072935721154614
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Leakages are a major risk in water distribution networks as they cause water loss and increase contamination risks. Leakage detection is a difficult task due to the complex dynamics of water distribution networks. In particular, small leakages are hard to detect. From a machine-learning perspective, leakages can be modeled as concept drift. Thus, a wide variety of drift detection schemes seems to be a suitable choice for detecting leakages. In this work, we explore the potential of model-loss-based and distribution-based drift detection methods to tackle leakage detection. We additionally discuss the issue of temporal dependencies in the data and propose a way to cope with it when applying distribution-based detection. We evaluate different methods systematically for leakages of different sizes and detection times. Additionally, we propose a first drift-detection-based technique for localizing leakages.

Related papers

• Out-of-Distribution Detection with a Single Unconditional Diffusion Model [54.15132801131365]
  Out-of-distribution (OOD) detection is a critical task in machine learning that seeks to identify abnormal samples. Traditionally, unsupervised methods utilize a deep generative model for OOD detection. This paper explores whether a single model can perform OOD detection across diverse tasks.
  arXiv  Detail & Related papers  (2024-05-20T08:54:03Z)
• Lazy Layers to Make Fine-Tuned Diffusion Models More Traceable [70.77600345240867]
  A novel arbitrary-in-arbitrary-out (AIAO) strategy makes watermarks resilient to fine-tuning-based removal. Unlike the existing methods of designing a backdoor for the input/output space of diffusion models, in our method, we propose to embed the backdoor into the feature space of sampled subpaths. Our empirical studies on the MS-COCO, AFHQ, LSUN, CUB-200, and DreamBooth datasets confirm the robustness of AIAO.
  arXiv  Detail & Related papers  (2024-05-01T12:03:39Z)
• Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Models [72.07462371883501]
  We propose emphProjection Regret (PR), an efficient novelty detection method that mitigates the bias of non-semantic information. PR computes the perceptual distance between the test image and its diffusion-based projection to detect abnormality. Extensive experiments demonstrate that PR outperforms the prior art of generative-model-based novelty detection methods by a significant margin.
  arXiv  Detail & Related papers  (2023-12-05T09:44:47Z)
• Localizing Anomalies in Critical Infrastructure using Model-Based Drift Explanations [5.319765271848658]
  We analyze the effects of anomalies on the dynamics of critical infrastructure systems by modeling the networks employing Bayesian networks. In particular, we argue that model-based explanations of concept drift are a promising tool for localizing anomalies. To showcase that our methodology applies to critical infrastructure more generally, we showcase the suitability of the derived technique to localize sensor faults in power systems.
  arXiv  Detail & Related papers  (2023-10-24T13:33:19Z)
• Adversarial Attacks on Leakage Detectors in Water Distribution Networks [6.125017875330933]
  We propose a taxonomy for adversarial attacks against machine learning based leakage detectors in water distribution networks. Based on a mathematical formalization of the least sensitive point problem, we use three different algorithmic approaches to find a solution.
  arXiv  Detail & Related papers  (2023-05-25T12:05:18Z)
• Detecting Concept Drift in the Presence of Sparsity -- A Case Study of Automated Change Risk Assessment System [0.8021979227281782]
  Missing values, widely called as textitsparsity in literature, is a common characteristic of many real-world datasets. We study different patterns of missing values, various statistical and ML based data imputation methods for different kinds of sparsity. We then select the best concept drift detector given a dataset with missing values based on the different metrics.
  arXiv  Detail & Related papers  (2022-07-27T04:27:49Z)
• Bandit Quickest Changepoint Detection [55.855465482260165]
  Continuous monitoring of every sensor can be expensive due to resource constraints. We derive an information-theoretic lower bound on the detection delay for a general class of finitely parameterized probability distributions. We propose a computationally efficient online sensing scheme, which seamlessly balances the need for exploration of different sensing options with exploitation of querying informative actions.
  arXiv  Detail & Related papers  (2021-07-22T07:25:35Z)
• Acoustic Leak Detection in Water Networks [6.35903710791033]
  We present a general procedure for acoustic leak detection in water networks. Based on recordings from seven contact microphones attached to the water supply network of a municipal suburb, we trained several shallow and deep anomaly detection models.
  arXiv  Detail & Related papers  (2020-12-11T12:24:15Z)
• Why Normalizing Flows Fail to Detect Out-of-Distribution Data [51.552870594221865]
  Normalizing flows fail to distinguish between in- and out-of-distribution data. We demonstrate that flows learn local pixel correlations and generic image-to-latent-space transformations. We show that by modifying the architecture of flow coupling layers we can bias the flow towards learning the semantic structure of the target data.
  arXiv  Detail & Related papers  (2020-06-15T17:00:01Z)
• Network Anomaly Detection based on Tensor Decomposition [10.285394886473217]
  Many anomaly detection methods are based on packet inspection collected at the network core routers. We propose an alternative method in which packet header inspection is not needed.
  arXiv  Detail & Related papers  (2020-04-20T21:45:05Z)
• Uncertainty Estimation Using a Single Deep Deterministic Neural Network [66.26231423824089]
  We propose a method for training a deterministic deep model that can find and reject out of distribution data points at test time with a single forward pass. We scale training in these with a novel loss function and centroid updating scheme and match the accuracy of softmax models.
  arXiv  Detail & Related papers  (2020-03-04T12:27:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.