Towards Causal Representation Learning

• URL: http://arxiv.org/abs/2102.11107v1
• Date: Mon, 22 Feb 2021 15:26:57 GMT
• Title: Towards Causal Representation Learning
• Authors: Bernhard Sch\"olkopf, Francesco Locatello, Stefan Bauer, Nan Rosemary Ke, Nal Kalchbrenner, Anirudh Goyal, Yoshua Bengio
• Abstract summary: The two fields of machine learning and graphical causality arose and developed separately. There is now cross-pollination and increasing interest in both fields to benefit from the advances of the other.
• Score: 96.110881654479
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The two fields of machine learning and graphical causality arose and developed separately. However, there is now cross-pollination and increasing interest in both fields to benefit from the advances of the other. In the present paper, we review fundamental concepts of causal inference and relate them to crucial open problems of machine learning, including transfer and generalization, thereby assaying how causality can contribute to modern machine learning research. This also applies in the opposite direction: we note that most work in causality starts from the premise that the causal variables are given. A central problem for AI and causality is, thus, causal representation learning, the discovery of high-level causal variables from low-level observations. Finally, we delineate some implications of causality for machine learning and propose key research areas at the intersection of both communities.

Related papers

• Disentangled Representations for Causal Cognition [0.0]
  Causal cognition studies describe the main characteristics of causal learning and reasoning in human and non-human animals. Machine and reinforcement learning research on causality represent on the one hand a concrete attempt at designing causal artificial agents. In this work, we connect these two areas of research to build a unifying framework for causal cognition.
  arXiv  Detail & Related papers  (2024-06-30T16:10:17Z)
• The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning [70.16523526957162]
  Understanding commonsense causality helps people understand the principles of the real world better. Despite its significance, a systematic exploration of this topic is notably lacking. Our work aims to provide a systematic overview, update scholars on recent advancements, and provide a pragmatic guide for beginners.
  arXiv  Detail & Related papers  (2024-06-27T16:30:50Z)
• Fundamental Properties of Causal Entropy and Information Gain [0.22252684361733285]
  Recent developments enable the quantification of causal control given a structural causal model (SCM) Measures, named causal entropy and causal information gain, aim to address limitations in existing information theoretical approaches for machine learning tasks where causality plays a crucial role.
  arXiv  Detail & Related papers  (2024-02-02T11:55:57Z)
• Emergence and Causality in Complex Systems: A Survey on Causal Emergence and Related Quantitative Studies [12.78006421209864]
  Causal emergence theory employs measures of causality to quantify emergence. Two key problems are addressed: quantifying causal emergence and identifying it in data. We highlighted that the architectures used for identifying causal emergence are shared by causal representation learning, causal model abstraction, and world model-based reinforcement learning.
  arXiv  Detail & Related papers  (2023-12-28T04:20:46Z)
• Causal reasoning in typical computer vision tasks [11.95181390654463]
  Causal theory models the intrinsic causal structure unaffected by data bias and is effective in avoiding spurious correlations. This paper aims to comprehensively review the existing causal methods in typical vision and vision-language tasks such as semantic segmentation, object detection, and image captioning. Future roadmaps are also proposed, including facilitating the development of causal theory and its application in other complex scenes and systems.
  arXiv  Detail & Related papers  (2023-07-26T07:01:57Z)
• A Causal Framework for Decomposing Spurious Variations [68.12191782657437]
  We develop tools for decomposing spurious variations in Markovian and Semi-Markovian models. We prove the first results that allow a non-parametric decomposition of spurious effects. The described approach has several applications, ranging from explainable and fair AI to questions in epidemiology and medicine.
  arXiv  Detail & Related papers  (2023-06-08T09:40:28Z)
• Causal Deep Learning [77.49632479298745]
  Causality has the potential to transform the way we solve real-world problems. But causality often requires crucial assumptions which cannot be tested in practice. We propose a new way of thinking about causality -- we call this causal deep learning.
  arXiv  Detail & Related papers  (2023-03-03T19:19:18Z)
• Active Bayesian Causal Inference [72.70593653185078]
  We propose Active Bayesian Causal Inference (ABCI), a fully-Bayesian active learning framework for integrated causal discovery and reasoning. ABCI jointly infers a posterior over causal models and queries of interest. We show that our approach is more data-efficient than several baselines that only focus on learning the full causal graph.
  arXiv  Detail & Related papers  (2022-06-04T22:38:57Z)
• Causality, Causal Discovery, and Causal Inference in Structural Engineering [1.827510863075184]
  This paper builds a case for causal discovery and causal inference from a civil and structural engineering perspective. More specifically, this paper outlines the key principles of causality and the most commonly used algorithms and packages for causal discovery and causal inference.
  arXiv  Detail & Related papers  (2022-04-04T14:49:47Z)
• Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning [76.00395335702572]
  A central goal for AI and causality is the joint discovery of abstract representations and causal structure. Existing environments for studying causal induction are poorly suited for this objective because they have complicated task-specific causal graphs. In this work, our goal is to facilitate research in learning representations of high-level variables as well as causal structures among them.
  arXiv  Detail & Related papers  (2021-07-02T05:44:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.