Causal Intervention for Subject-Deconfounded Facial Action Unit Recognition

• URL: http://arxiv.org/abs/2204.07935v2
• Date: Wed, 3 Apr 2024 02:27:59 GMT
• Title: Causal Intervention for Subject-Deconfounded Facial Action Unit Recognition
• Authors: Yingjie Chen, Diqi Chen, Tao Wang, Yizhou Wang, Yun Liang,
• Abstract summary: We propose a causal inference framework for subject-invariant facial action unit recognition. We formulate the causalities among facial images, subjects, latent AU semantic relations, and estimated AU occurrence probabilities. Experiments conducted on two commonly used AU benchmark datasets, BP4D and DISFA, show the effectiveness of our CIS.
• Score: 17.261599235264118
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Subject-invariant facial action unit (AU) recognition remains challenging for the reason that the data distribution varies among subjects. In this paper, we propose a causal inference framework for subject-invariant facial action unit recognition. To illustrate the causal effect existing in AU recognition task, we formulate the causalities among facial images, subjects, latent AU semantic relations, and estimated AU occurrence probabilities via a structural causal model. By constructing such a causal diagram, we clarify the causal effect among variables and propose a plug-in causal intervention module, CIS, to deconfound the confounder \emph{Subject} in the causal diagram. Extensive experiments conducted on two commonly used AU benchmark datasets, BP4D and DISFA, show the effectiveness of our CIS, and the model with CIS inserted, CISNet, has achieved state-of-the-art performance.

Related papers

• CausalAffect: Causal Discovery for Facial Affective Understanding [26.904783570786773]
  CausalAffect is the first framework for causal graph discovery in facial affect analysis.<n>Our approach requires neither jointly annotated datasets nor handcrafted causal priors.<n>All trained models and source code will be released upon acceptance.
  arXiv  Detail & Related papers  (2025-11-29T12:07:33Z)
• Learning Robust Intervention Representations with Delta Embeddings [5.124256074746721]
  Causal representation learning has attracted significant research interest during the past few years.<n>We show that an effective strategy for improving out of distribution robustness is to focus on the representation of interventions in the latent space.<n>We propose a framework that is capable of learning causal representations from image pairs, without any additional supervision.
  arXiv  Detail & Related papers  (2025-08-06T14:39:34Z)
• A Practical Approach to Causal Inference over Time [17.660953125689105]
  We define causal interventions and their effects over time on discrete-time processes (DSPs) We show under which conditions the equilibrium states of a DSP, both before and after a causal intervention, can be captured by a structural causal model (SCM) The resulting causal VAR framework allows us to perform causal inference over time from observational time series data.
  arXiv  Detail & Related papers  (2024-10-14T13:45:20Z)
• On the Identification of Temporally Causal Representation with Instantaneous Dependence [50.14432597910128]
  Temporally causal representation learning aims to identify the latent causal process from time series observations. Most methods require the assumption that the latent causal processes do not have instantaneous relations. We propose an textbfIDentification framework for instantanetextbfOus textbfLatent dynamics.
  arXiv  Detail & Related papers  (2024-05-24T08:08:05Z)
• Identifiable Latent Polynomial Causal Models Through the Lens of Change [82.14087963690561]
  Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as identifiability.
  arXiv  Detail & Related papers  (2023-10-24T07:46:10Z)
• Context De-confounded Emotion Recognition [12.037240778629346]
  Context-Aware Emotion Recognition (CAER) aims to perceive the emotional states of the target person with contextual information. A long-overlooked issue is that a context bias in existing datasets leads to a significantly unbalanced distribution of emotional states. This paper provides a causality-based perspective to disentangle the models from the impact of such bias, and formulate the causalities among variables in the CAER task.
  arXiv  Detail & Related papers  (2023-03-21T15:12:20Z)
• Identifying Weight-Variant Latent Causal Models [82.14087963690561]
  We find that transitivity acts as a key role in impeding the identifiability of latent causal representations. Under some mild assumptions, we can show that the latent causal representations can be identified up to trivial permutation and scaling. We propose a novel method, termed Structural caUsAl Variational autoEncoder, which directly learns latent causal representations and causal relationships among them.
  arXiv  Detail & Related papers  (2022-08-30T11:12:59Z)
• Effect Identification in Cluster Causal Diagrams [51.42809552422494]
  We introduce a new type of graphical model called cluster causal diagrams (for short, C-DAGs) C-DAGs allow for the partial specification of relationships among variables based on limited prior knowledge. We develop the foundations and machinery for valid causal inferences over C-DAGs.
  arXiv  Detail & Related papers  (2022-02-22T21:27:31Z)
• Fair SA: Sensitivity Analysis for Fairness in Face Recognition [1.7149364927872013]
  We propose a new fairness evaluation based on robustness in the form of a generic framework. We analyze the performance of common face recognition models and empirically show that certain subgroups are at a disadvantage when images are perturbed.
  arXiv  Detail & Related papers  (2022-02-08T01:16:09Z)
• Towards Principled Causal Effect Estimation by Deep Identifiable Models [21.33872753593482]
  We discuss the estimation of treatment effects (TEs) under unobserved confounding. We propose Intact-VAE, a new variant of variational autoencoder (VAE), motivated by the prognostic score that is sufficient for identifying TEs.
  arXiv  Detail & Related papers  (2021-09-30T12:19:45Z)
• CausalVAE: Structured Causal Disentanglement in Variational Autoencoder [52.139696854386976]
  The framework of variational autoencoder (VAE) is commonly used to disentangle independent factors from observations. We propose a new VAE based framework named CausalVAE, which includes a Causal Layer to transform independent factors into causal endogenous ones. Results show that the causal representations learned by CausalVAE are semantically interpretable, and their causal relationship as a Directed Acyclic Graph (DAG) is identified with good accuracy.
  arXiv  Detail & Related papers  (2020-04-18T20:09:34Z)
• A Critical View of the Structural Causal Model [89.43277111586258]
  We show that one can identify the cause and the effect without considering their interaction at all. We propose a new adversarial training method that mimics the disentangled structure of the causal model. Our multidimensional method outperforms the literature methods on both synthetic and real world datasets.
  arXiv  Detail & Related papers  (2020-02-23T22:52:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.