Analysis of Drifting Features

• URL: http://arxiv.org/abs/2012.00499v1
• Date: Tue, 1 Dec 2020 14:09:19 GMT
• Title: Analysis of Drifting Features
• Authors: Fabian Hinder, Jonathan Jakob, Barbara Hammer
• Abstract summary: concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We distinguish between drift inducing features, for which the observed feature drift cannot be explained by any other feature, and faithfully drifting features, which correlate with the present drift of other features.
• Score: 11.305591390070123
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We are interested in an identification of those features, that are most relevant for the observed drift. We distinguish between drift inducing features, for which the observed feature drift cannot be explained by any other feature, and faithfully drifting features, which correlate with the present drift of other features. This notion gives rise to minimal subsets of the feature space, which are able to characterize the observed drift as a whole. We relate this problem to the problems of feature selection and feature relevance learning, which allows us to derive a detection algorithm. We demonstrate its usefulness on different benchmarks.

Related papers

• Localized Gaussians as Self-Attention Weights for Point Clouds Correspondence [92.07601770031236]
  We investigate semantically meaningful patterns in the attention heads of an encoder-only Transformer architecture. We find that fixing the attention weights not only accelerates the training process but also enhances the stability of the optimization.
  arXiv  Detail & Related papers  (2024-09-20T07:41:47Z)
• Geo-Localization Based on Dynamically Weighted Factor-Graph [74.75763142610717]
  Feature-based geo-localization relies on associating features extracted from aerial imagery with those detected by the vehicle's sensors. This requires that the type of landmarks must be observable from both sources. We present a dynamically weighted factor graph model for the vehicle's trajectory estimation.
  arXiv  Detail & Related papers  (2023-11-13T12:44:14Z)
• Causal Feature Selection via Transfer Entropy [59.999594949050596]
  Causal discovery aims to identify causal relationships between features with observational data. We introduce a new causal feature selection approach that relies on the forward and backward feature selection procedures. We provide theoretical guarantees on the regression and classification errors for both the exact and the finite-sample cases.
  arXiv  Detail & Related papers  (2023-10-17T08:04:45Z)
• Going Beyond Neural Network Feature Similarity: The Network Feature Complexity and Its Interpretation Using Category Theory [64.06519549649495]
  We provide the definition of what we call functionally equivalent features. These features produce equivalent output under certain transformations. We propose an efficient algorithm named Iterative Feature Merging.
  arXiv  Detail & Related papers  (2023-10-10T16:27:12Z)
• On the Joint Interaction of Models, Data, and Features [82.60073661644435]
  We introduce a new tool, the interaction tensor, for empirically analyzing the interaction between data and model through features. Based on these observations, we propose a conceptual framework for feature learning. Under this framework, the expected accuracy for a single hypothesis and agreement for a pair of hypotheses can both be derived in closed-form.
  arXiv  Detail & Related papers  (2023-06-07T21:35:26Z)
• Model Based Explanations of Concept Drift [8.686667049158476]
  Concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models can become inaccurate and need adjustment. We present a novel technology characterizing concept drift in terms of the characteristic change of spatial features.
  arXiv  Detail & Related papers  (2023-03-16T14:03:56Z)
• Feature Relevance Analysis to Explain Concept Drift -- A Case Study in Human Activity Recognition [3.5569545396848437]
  This article studies how to detect and explain concept drift. Drift detection is based on identifying a set of features having the largest relevance difference between the drifting model and a model known to be accurate. It is shown that feature relevance analysis cannot only be used to detect the concept drift but also to explain the reason for the drift.
  arXiv  Detail & Related papers  (2023-01-20T07:34:27Z)
• Invariant Causal Mechanisms through Distribution Matching [86.07327840293894]
  In this work we provide a causal perspective and a new algorithm for learning invariant representations. Empirically we show that this algorithm works well on a diverse set of tasks and in particular we observe state-of-the-art performance on domain generalization.
  arXiv  Detail & Related papers  (2022-06-23T12:06:54Z)
• Precise Change Point Detection using Spectral Drift Detection [8.686667049158476]
  Concept drift refers to the phenomenon that the data generating distribution changes over time; as a consequence machine learning models may become inaccurate and need adjustment. In this paper we consider the problem of detecting those change points in unsupervised learning. We derive a new unsupervised drift detection algorithm, investigate its mathematical properties, and demonstrate its usefulness in several experiments.
  arXiv  Detail & Related papers  (2022-05-13T08:31:47Z)
• Suitability of Different Metric Choices for Concept Drift Detection [9.76294323004155]
  Many unsupervised approaches for drift detection rely on measuring the discrepancy between the sample of two time windows. Most drift detection methods can be distinguished in what metric they use, how this metric is estimated, and how the decision threshold is found. We compare different types of estimators and metrics theoretically and empirically and investigate the relevance of the single metric components.
  arXiv  Detail & Related papers  (2022-02-19T01:11:32Z)
• Counterfactual Explanations of Concept Drift [11.53362411363005]
  concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We present a novel technology, which characterizes concept drift in terms of the characteristic change of spatial features represented by typical examples.
  arXiv  Detail & Related papers  (2020-06-23T08:27:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.