Learner-based Concept Drift Detection: Analysis and Evaluation

• URL: http://arxiv.org/abs/2606.20216v1
• Date: Thu, 18 Jun 2026 13:31:58 GMT
• Title: Learner-based Concept Drift Detection: Analysis and Evaluation
• Abstract summary: The presence of concept drift poses a major challenge for many real-world applications.<n>This study examines theoretically the concept drift characteristics and numerous drift detection algorithms across several categories.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning algorithms deployed for evolving streaming environments must handle the non-stationary data distributions, commonly referred to as concept drift. The presence of concept drift poses a major challenge for many real-world applications because it can severely degrade their predictive performance, hindering their ability to support robust decision-making. Consequently, the timely and efficient detection of drift events is critical for sustaining high accuracy over time. This study examines theoretically the concept drift characteristics and numerous drift detection algorithms across several categories. Furthermore, we evaluate their performance on both synthetic and real-world datasets exhibiting diverse streaming scenarios and drift characteristics, such as abrupt and gradual changes. This study aims to enhance understanding of the complex notion of concept drift characteristics and behavior of drift detectors, along with their applicability to diverse contexts.

Related papers

• DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptation [50.584834483403675]
  Adapting pre-trained text-to-image diffusion models, whether to learn new visual concepts or erase unwanted ones, is routinely evaluated on its intended effects alone.<n>We demonstrate that adaptation systematically damages semantically unrelated concepts in ways that aggregate metrics structurally cannot surface.<n>We introduce DriftScope, a prompt-level diagnostic tool that takes any two model checkpoints and returns a ranked list of tokens whose visual concepts have shifted most between them.
  arXiv  Detail & Related papers  (2026-06-30T20:57:51Z)
• How well does Classification Accuracy capture Concept Drift Detection Quality? An overview of Concept Drift Detection evaluation [0.2538209532048867]
  We present an in-depth overview of the relationship between metrics for quantifying drift detection quality and classification performance.<n>Study aims to identify the most informative set of drift detection quality metrics and provide a deep understanding of the method's evaluation.
  arXiv  Detail & Related papers  (2026-05-29T11:55:23Z)
• Uncertainty Estimation for Deep Reconstruction in Actuatic Disaster Scenarios with Autonomous Vehicles [68.82821445619759]
  principled uncertainty quantification is critical for active sensing strategies.<n>Evidential Deep Learning achieves the best reconstruction accuracy and uncertainty calibration across all sensor configurations.<n>These findings support Evidential Deep Learning as the preferred method for uncertainty-aware field reconstruction in real-time autonomous vehicle deployments.
  arXiv  Detail & Related papers  (2026-04-07T19:17:44Z)
• Drift-Aware Variational Autoencoder-based Anomaly Detection with Two-level Ensembling [9.077595042522288]
  This paper presents VAE++ESDD, which employs incremental learning and two-level ensembling for anomaly prediction.<n>We conduct a comprehensive experimental study using real-world and synthetic datasets.<n>Our study reveals that the proposed method significantly outperforms both strong baselines and state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-02-13T14:53:56Z)
• Continuous Evolution Pool: Taming Recurring Concept Drift in Online Time Series Forecasting [58.448663215248565]
  Continuous Evolution Pool (CEP) is a pooling mechanism that stores different instances of forecasters for different concepts.<n>CEP effectively retains the knowledge of different concepts.<n>In the scenario of online forecasting with recurring concepts, CEP significantly enhances the prediction results.
  arXiv  Detail & Related papers  (2025-05-28T03:27:49Z)
• AutoML for Multi-Class Anomaly Compensation of Sensor Drift [44.63945828405864]
  Sensor drift degrades the performance of machine learning models over time.<n>Standard cross-validation method overestimates performance by inadequately accounting for drift.<n>This paper presents two solutions: (1) a novel sensor drift compensation learning paradigm for validating models, and (2) automated machine learning (AutoML) techniques to enhance classification performance and compensate sensor drift.
  arXiv  Detail & Related papers  (2025-02-26T14:34:53Z)
• Online Drift Detection with Maximum Concept Discrepancy [13.48123472458282]
  We propose MCD-DD, a novel concept drift detection method based on maximum concept discrepancy. Our method can adaptively identify varying forms of concept drift by contrastive learning of concept embeddings.
  arXiv  Detail & Related papers  (2024-07-07T13:57:50Z)
• Methods for Generating Drift in Text Streams [49.3179290313959]
  Concept drift is a frequent phenomenon in real-world datasets and corresponds to changes in data distribution over time. This paper provides four textual drift generation methods to ease the production of datasets with labeled drifts. Results show that all methods have their performance degraded right after the drifts, and the incremental SVM is the fastest to run and recover the previous performance levels.
  arXiv  Detail & Related papers  (2024-03-18T23:48:33Z)
• A comprehensive analysis of concept drift locality in data streams [3.5897534810405403]
  Concept drift must be detected for effective model adaptation to evolving data properties. We present a novel categorization of concept drift based on its locality and scale. We conduct a comparative assessment of 9 state-of-the-art drift detectors across diverse difficulties.
  arXiv  Detail & Related papers  (2023-11-10T20:57:43Z)
• Are Concept Drift Detectors Reliable Alarming Systems? -- A Comparative Study [6.7961908135481615]
  Concept drift, also known as concept drift, impacts the performance of machine learning models. In this study, we assess the reliability of concept drift detectors to identify drift in time. Our findings aim to help practitioners understand which drift detector should be employed in different situations.
  arXiv  Detail & Related papers  (2022-11-23T16:31:15Z)
• SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptation [152.60469768559878]
  SHIFT is the largest multi-task synthetic dataset for autonomous driving. It presents discrete and continuous shifts in cloudiness, rain and fog intensity, time of day, and vehicle and pedestrian density. Our dataset and benchmark toolkit are publicly available at www.vis.xyz/shift.
  arXiv  Detail & Related papers  (2022-06-16T17:59:52Z)
• Automatic Learning to Detect Concept Drift [40.69280758487987]
  We propose Meta-ADD, a novel framework that learns to classify concept drift by tracking the changed pattern of error rates. Specifically, in the training phase, we extract meta-features based on the error rates of various concept drift, after which a meta-detector is developed via prototypical neural network. In the detection phase, the learned meta-detector is fine-tuned to adapt to the corresponding data stream via stream-based active learning.
  arXiv  Detail & Related papers  (2021-05-04T11:10:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.