On the influence of dependent features in classification problems: a game-theoretic perspective

• URL: http://arxiv.org/abs/2408.02481v1
• Date: Mon, 5 Aug 2024 14:02:26 GMT
• Title: On the influence of dependent features in classification problems: a game-theoretic perspective
• Authors: Laura Davila-Pena, Alejandro Saavedra-Nieves, Balbina Casas-Méndez,
• Abstract summary: This paper deals with a new measure of the influence of each feature on the response variable in classification problems. We consider a sample of individuals characterized by specific features, each feature encompassing a finite range of values, and classified based on a binary response variable.
• Score: 46.1232919707345
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper deals with a new measure of the influence of each feature on the response variable in classification problems, accounting for potential dependencies among certain feature subsets. Within this framework, we consider a sample of individuals characterized by specific features, each feature encompassing a finite range of values, and classified based on a binary response variable. This measure turns out to be an influence measure explored in existing literature and related to cooperative game theory. We provide an axiomatic characterization of our proposed influence measure by tailoring properties from the cooperative game theory to our specific context. Furthermore, we demonstrate that our influence measure becomes a general characterization of the well-known Banzhaf-Owen value for games with a priori unions, from the perspective of classification problems. The definitions and results presented herein are illustrated through numerical examples and various applications, offering practical insights into our methodologies.

Related papers

• Normalization in Proportional Feature Spaces [49.48516314472825]
  normalization plays an important central role in data representation, characterization, visualization, analysis, comparison, classification, and modeling. The selection of an appropriate normalization method needs to take into account the type and characteristics of the involved features.
  arXiv  Detail & Related papers  (2024-09-17T17:46:27Z)
• Estimating the Causal Effects of Natural Logic Features in Transformer-Based NLI Models [16.328341121232484]
  We apply causal effect estimation strategies to measure the effect of context interventions. We investigate robustness to irrelevant changes and sensitivity to impactful changes of Transformers.
  arXiv  Detail & Related papers  (2024-04-03T10:22:35Z)
• Nonparametric Partial Disentanglement via Mechanism Sparsity: Sparse Actions, Interventions and Sparse Temporal Dependencies [58.179981892921056]
  This work introduces a novel principle for disentanglement we call mechanism sparsity regularization. We propose a representation learning method that induces disentanglement by simultaneously learning the latent factors. We show that the latent factors can be recovered by regularizing the learned causal graph to be sparse.
  arXiv  Detail & Related papers  (2024-01-10T02:38:21Z)
• On the Joint Interaction of Models, Data, and Features [82.60073661644435]
  We introduce a new tool, the interaction tensor, for empirically analyzing the interaction between data and model through features. Based on these observations, we propose a conceptual framework for feature learning. Under this framework, the expected accuracy for a single hypothesis and agreement for a pair of hypotheses can both be derived in closed-form.
  arXiv  Detail & Related papers  (2023-06-07T21:35:26Z)
• The Weighted M\"obius Score: A Unified Framework for Feature Attribution [17.358276581599643]
  Feature attribution aims to explain the reasoning behind a black-box model's prediction by identifying the impact of each feature on the prediction. The lack of a unified framework has led to a proliferation of methods that are often not directly comparable. This paper introduces a parameterized attribution framework -- the Weighted M"obius Score -- and shows that many different attribution methods for both individual features and feature interactions are special cases.
  arXiv  Detail & Related papers  (2023-05-16T06:27:27Z)
• A Notion of Feature Importance by Decorrelation and Detection of Trends by Random Forest Regression [1.675857332621569]
  We introduce a novel notion of feature importance based on the well-studied Gram-Schmidt decorrelation method. We propose two estimators for identifying trends in the data using random forest regression.
  arXiv  Detail & Related papers  (2023-03-02T11:01:49Z)
• Discriminative Attribution from Counterfactuals [64.94009515033984]
  We present a method for neural network interpretability by combining feature attribution with counterfactual explanations. We show that this method can be used to quantitatively evaluate the performance of feature attribution methods in an objective manner.
  arXiv  Detail & Related papers  (2021-09-28T00:53:34Z)
• Assessment of the influence of features on a classification problem: an application to COVID-19 patients [0.0]
  This paper deals with the evaluation of the influence of each of the features on the classification of individuals. A measure of that influence is introduced using the Shapley value of cooperative games. Some experiments have been designed in order to validate the appropriate performance of such measure.
  arXiv  Detail & Related papers  (2021-04-09T20:02:05Z)
• Weakly-Supervised Aspect-Based Sentiment Analysis via Joint Aspect-Sentiment Topic Embedding [71.2260967797055]
  We propose a weakly-supervised approach for aspect-based sentiment analysis. We learn sentiment, aspect> joint topic embeddings in the word embedding space. We then use neural models to generalize the word-level discriminative information.
  arXiv  Detail & Related papers  (2020-10-13T21:33:24Z)
• On Irrelevance of Attributes in Flexible Prediction [0.0]
  This paper analyses properties of conceptual hierarchy obtained via incremental concept formation method called "flexible prediction" The impact of selection of simple and combined attributes, of scaling and of distribution of individual attributes and of correlation strengths among them is investigated.
  arXiv  Detail & Related papers  (2020-05-25T08:41:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.