Adaptation Speed Analysis for Fairness-aware Causal Models

• URL: http://arxiv.org/abs/2308.16879v1
• Date: Thu, 31 Aug 2023 17:36:57 GMT
• Title: Adaptation Speed Analysis for Fairness-aware Causal Models
• Authors: Yujie Lin, Chen Zhao, Minglai Shao, Xujiang Zhao, Haifeng Chen
• Abstract summary: In machine translation tasks, to achieve bidirectional translation between two languages, the source corpus is often used as the target corpus. The question of which one can adapt most quickly to a domain shift is of significant importance in many fields.
• Score: 34.116613732724815
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: For example, in machine translation tasks, to achieve bidirectional translation between two languages, the source corpus is often used as the target corpus, which involves the training of two models with opposite directions. The question of which one can adapt most quickly to a domain shift is of significant importance in many fields. Specifically, consider an original distribution p that changes due to an unknown intervention, resulting in a modified distribution p*. In aligning p with p*, several factors can affect the adaptation rate, including the causal dependencies between variables in p. In real-life scenarios, however, we have to consider the fairness of the training process, and it is particularly crucial to involve a sensitive variable (bias) present between a cause and an effect variable. To explore this scenario, we examine a simple structural causal model (SCM) with a cause-bias-effect structure, where variable A acts as a sensitive variable between cause (X) and effect (Y). The two models, respectively, exhibit consistent and contrary cause-effect directions in the cause-bias-effect SCM. After conducting unknown interventions on variables within the SCM, we can simulate some kinds of domain shifts for analysis. We then compare the adaptation speeds of two models across four shift scenarios. Additionally, we prove the connection between the adaptation speeds of the two models across all interventions.

Related papers

• Proxy Methods for Domain Adaptation [78.03254010884783]
  proxy variables allow for adaptation to distribution shift without explicitly recovering or modeling latent variables. We develop a two-stage kernel estimation approach to adapt to complex distribution shifts in both settings.
  arXiv  Detail & Related papers  (2024-03-12T09:32:41Z)
• Deep Learning-based Group Causal Inference in Multivariate Time-series [8.073449277052495]
  Causal inference in a nonlinear system of multivariate timeseries is instrumental in disentangling the intricate web of relationships among variables. In this work, we test model invariance by group-level interventions on the trained deep networks to infer causal direction in groups of variables.
  arXiv  Detail & Related papers  (2024-01-16T14:19:28Z)
• Variational Counterfactual Prediction under Runtime Domain Corruption [50.89405221574912]
  Co-occurrence of domain shift and inaccessible variables runtime domain corruption seriously impairs generalizability of trained counterfactual predictor. We build an adversarially unified variational causal effect model, named VEGAN, with a novel two-stage adversarial domain adaptation scheme. We demonstrate that VEGAN outperforms other state-of-the-art baselines on individual-level treatment effect estimation in the presence of runtime domain corruption.
  arXiv  Detail & Related papers  (2023-06-23T02:54:34Z)
• A Causal Framework for Decomposing Spurious Variations [68.12191782657437]
  We develop tools for decomposing spurious variations in Markovian and Semi-Markovian models. We prove the first results that allow a non-parametric decomposition of spurious effects. The described approach has several applications, ranging from explainable and fair AI to questions in epidemiology and medicine.
  arXiv  Detail & Related papers  (2023-06-08T09:40:28Z)
• Causal Discovery in Heterogeneous Environments Under the Sparse Mechanism Shift Hypothesis [7.895866278697778]
  Machine learning approaches commonly rely on the assumption of independent and identically distributed (i.i.d.) data. In reality, this assumption is almost always violated due to distribution shifts between environments. We propose the Mechanism Shift Score (MSS), a score-based approach amenable to various empirical estimators.
  arXiv  Detail & Related papers  (2022-06-04T15:39:30Z)
• Learning Latent Causal Dynamics [14.762231867144065]
  We propose a principled framework, called LiLY, to first recover time-delayed latent causal variables. We then identify their relations from measured temporal data under different distribution shifts. The correction step is then formulated as learning the low-dimensional change factors with a few samples.
  arXiv  Detail & Related papers  (2022-02-10T04:23:32Z)
• Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress Tests [87.60900567941428]
  A spurious correlation' is the dependence of a model on some aspect of the input data that an analyst thinks shouldn't matter. In machine learning, these have a know-it-when-you-see-it character. We study stress testing using the tools of causal inference.
  arXiv  Detail & Related papers  (2021-05-31T14:39:38Z)
• An Analysis of the Adaptation Speed of Causal Models [80.77896315374747]
  Recently, Bengio et al. conjectured that among all candidate models, $G$ is the fastest to adapt from one dataset to another. We investigate the adaptation speed of cause-effect SCMs using convergence rates from optimization. Surprisingly, we find situations where the anticausal model is advantaged, falsifying the initial hypothesis.
  arXiv  Detail & Related papers  (2020-05-18T23:48:56Z)
• A Critical View of the Structural Causal Model [89.43277111586258]
  We show that one can identify the cause and the effect without considering their interaction at all. We propose a new adversarial training method that mimics the disentangled structure of the causal model. Our multidimensional method outperforms the literature methods on both synthetic and real world datasets.
  arXiv  Detail & Related papers  (2020-02-23T22:52:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.