From Unstructured Text to Causal Knowledge Graphs: A Transformer-Based Approach

• URL: http://arxiv.org/abs/2202.11768v1
• Date: Wed, 23 Feb 2022 20:29:55 GMT
• Title: From Unstructured Text to Causal Knowledge Graphs: A Transformer-Based Approach
• Authors: Scott Friedman, Ian Magnusson, Vasanth Sarathy, Sonja Schmer-Galunder
• Abstract summary: This paper presents a transformer-based NLP architecture that jointly extracts knowledge graphs including variables or factors described in language. We provide evidence of its accurate knowledge graph extraction in real-world domains and the practicality of its resulting knowledge graphs for cognitive systems that perform graph-based reasoning.
• Score: 4.133048890906828
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Qualitative causal relationships compactly express the direction, dependency, temporal constraints, and monotonicity constraints of discrete or continuous interactions in the world. In everyday or academic language, we may express interactions between quantities (e.g., sleep decreases stress), between discrete events or entities (e.g., a protein inhibits another protein's transcription), or between intentional or functional factors (e.g., hospital patients pray to relieve their pain). Extracting and representing these diverse causal relations are critical for cognitive systems that operate in domains spanning from scientific discovery to social science. This paper presents a transformer-based NLP architecture that jointly extracts knowledge graphs including (1) variables or factors described in language, (2) qualitative causal relationships over these variables, (3) qualifiers and magnitudes that constrain these causal relationships, and (4) word senses to localize each extracted node within a large ontology. We do not claim that our transformer-based architecture is itself a cognitive system; however, we provide evidence of its accurate knowledge graph extraction in real-world domains and the practicality of its resulting knowledge graphs for cognitive systems that perform graph-based reasoning. We demonstrate this approach and include promising results in two use cases, processing textual inputs from academic publications, news articles, and social media.

Related papers

• Interpretable Imitation Learning with Dynamic Causal Relations [65.18456572421702]
  We propose to expose captured knowledge in the form of a directed acyclic causal graph. We also design this causal discovery process to be state-dependent, enabling it to model the dynamics in latent causal graphs. The proposed framework is composed of three parts: a dynamic causal discovery module, a causality encoding module, and a prediction module, and is trained in an end-to-end manner.
  arXiv  Detail & Related papers  (2023-09-30T20:59:42Z)
• ReOnto: A Neuro-Symbolic Approach for Biomedical Relation Extraction [3.263873198567265]
  ReOnto Relation Extraction (RE) is the task of extracting semantic relationships between entities in a sentence and aligning them to relations defined in a vocabulary. We present a novel technique that makes use of neuro symbolic knowledge for the RE task. Experimental results on two public biomedical datasets, BioRel and ADE, show that our method outperforms all the baselines.
  arXiv  Detail & Related papers  (2023-09-04T05:36:58Z)
• Causal reasoning in typical computer vision tasks [11.95181390654463]
  Causal theory models the intrinsic causal structure unaffected by data bias and is effective in avoiding spurious correlations. This paper aims to comprehensively review the existing causal methods in typical vision and vision-language tasks such as semantic segmentation, object detection, and image captioning. Future roadmaps are also proposed, including facilitating the development of causal theory and its application in other complex scenes and systems.
  arXiv  Detail & Related papers  (2023-07-26T07:01:57Z)
• A Causal Framework for Decomposing Spurious Variations [68.12191782657437]
  We develop tools for decomposing spurious variations in Markovian and Semi-Markovian models. We prove the first results that allow a non-parametric decomposition of spurious effects. The described approach has several applications, ranging from explainable and fair AI to questions in epidemiology and medicine.
  arXiv  Detail & Related papers  (2023-06-08T09:40:28Z)
• Implications of Topological Imbalance for Representation Learning on Biomedical Knowledge Graphs [16.566710222582618]
  We show how knowledge graph embedding models can be affected by structural imbalance. We show how the graph topology can be perturbed to artificially alter the rank of a gene via random, biologically meaningless information.
  arXiv  Detail & Related papers  (2021-12-13T11:20:36Z)
• Transformer-based Dual Relation Graph for Multi-label Image Recognition [56.12543717723385]
  We propose a novel Transformer-based Dual Relation learning framework. We explore two aspects of correlation, i.e., structural relation graph and semantic relation graph. Our approach achieves new state-of-the-art on two popular multi-label recognition benchmarks.
  arXiv  Detail & Related papers  (2021-10-10T07:14:52Z)
• Extracting Qualitative Causal Structure with Transformer-Based NLP [0.48342038441006785]
  This paper presents a transformer-based NLP architecture that jointly identifies and extracts variables or factors described in language. We demonstrate this approach and include promising results from in two use cases, processing textual inputs from academic publications, news articles, and social media.
  arXiv  Detail & Related papers  (2021-08-20T20:15:13Z)
• Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning [76.00395335702572]
  A central goal for AI and causality is the joint discovery of abstract representations and causal structure. Existing environments for studying causal induction are poorly suited for this objective because they have complicated task-specific causal graphs. In this work, our goal is to facilitate research in learning representations of high-level variables as well as causal structures among them.
  arXiv  Detail & Related papers  (2021-07-02T05:44:56Z)
• The Causal Neural Connection: Expressiveness, Learnability, and Inference [125.57815987218756]
  An object called structural causal model (SCM) represents a collection of mechanisms and sources of random variation of the system under investigation. In this paper, we show that the causal hierarchy theorem (Thm. 1, Bareinboim et al., 2020) still holds for neural models. We introduce a special type of SCM called a neural causal model (NCM), and formalize a new type of inductive bias to encode structural constraints necessary for performing causal inferences.
  arXiv  Detail & Related papers  (2021-07-02T01:55:18Z)
• To do or not to do: finding causal relations in smart homes [2.064612766965483]
  This paper introduces a new way to learn causal models from a mixture of experiments on the environment and observational data. The core of our method is the use of selected interventions, especially our learning takes into account the variables where it is impossible to intervene. We use our method on a smart home simulation, a use case where knowing causal relations pave the way towards explainable systems.
  arXiv  Detail & Related papers  (2021-05-20T22:36:04Z)
• A Heterogeneous Graph with Factual, Temporal and Logical Knowledge for Question Answering Over Dynamic Contexts [81.4757750425247]
  We study question answering over a dynamic textual environment. We develop a graph neural network over the constructed graph, and train the model in an end-to-end manner.
  arXiv  Detail & Related papers  (2020-04-25T04:53:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.