Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference

• URL: http://arxiv.org/abs/2105.13456v1
• Date: Thu, 27 May 2021 21:33:34 GMT
• Title: Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference
• Authors: Tuan Lai, Heng Ji, ChengXiang Zhai, and Quan Hung Tran
• Abstract summary: We present a novel framework that utilizes external knowledge for joint entity and relation extraction named KECI. KeCI takes a collective approach to link mention spans to entities by integrating global relational information into local representations. Our experimental results show that the framework is highly effective, achieving new state-of-the-art results in two different benchmark datasets.
• Score: 42.255596963210564
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Compared to the general news domain, information extraction (IE) from biomedical text requires much broader domain knowledge. However, many previous IE methods do not utilize any external knowledge during inference. Due to the exponential growth of biomedical publications, models that do not go beyond their fixed set of parameters will likely fall behind. Inspired by how humans look up relevant information to comprehend a scientific text, we present a novel framework that utilizes external knowledge for joint entity and relation extraction named KECI (Knowledge-Enhanced Collective Inference). Given an input text, KECI first constructs an initial span graph representing its initial understanding of the text. It then uses an entity linker to form a knowledge graph containing relevant background knowledge for the the entity mentions in the text. To make the final predictions, KECI fuses the initial span graph and the knowledge graph into a more refined graph using an attention mechanism. KECI takes a collective approach to link mention spans to entities by integrating global relational information into local representations using graph convolutional networks. Our experimental results show that the framework is highly effective, achieving new state-of-the-art results in two different benchmark datasets: BioRelEx (binding interaction detection) and ADE (adverse drug event extraction). For example, KECI achieves absolute improvements of 4.59% and 4.91% in F1 scores over the state-of-the-art on the BioRelEx entity and relation extraction tasks.

Related papers

• Graph Relation Distillation for Efficient Biomedical Instance Segmentation [80.51124447333493]
  We propose a graph relation distillation approach for efficient biomedical instance segmentation. We introduce two graph distillation schemes deployed at both the intra-image level and the inter-image level. Experimental results on a number of biomedical datasets validate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2024-01-12T04:41:23Z)
• Enhancing Biomedical Lay Summarisation with External Knowledge Graphs [28.956500948255677]
  We investigate the effectiveness of three different approaches for incorporating knowledge graphs within lay summarisation models. Our results confirm that integrating graph-based domain knowledge can significantly benefit lay summarisation by substantially increasing the readability of generated text.
  arXiv  Detail & Related papers  (2023-10-24T10:25:21Z)
• Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich Document [37.05334263712291]
  We propose a GlObal Structure knowledge-guided relation Extraction (GOSE) framework. GOSE initiates by generating preliminary relation predictions on entity pairs extracted from a scanned image of the document. Global structure knowledge is captured from the preceding iterative predictions, which are then incorporated into the representations of the entities.
  arXiv  Detail & Related papers  (2023-05-23T09:18:47Z)
• Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generation [92.73584302508907]
  We propose a knowledge graph with Dynamic structure and nodes to facilitate medical report generation with Contrastive Learning. In detail, the fundamental structure of our graph is pre-constructed from general knowledge. Each image feature is integrated with its very own updated graph before being fed into the decoder module for report generation.
  arXiv  Detail & Related papers  (2023-03-18T03:53:43Z)
• Knowledge-Enhanced Relation Extraction Dataset [8.612433805862619]
  There is currently no public dataset that encompasses both evidence sentences and knowledge graphs for knowledge-enhanced relation extraction. We introduce the Knowledge-Enhanced Relation Extraction dataset (KERED) KERED annotates each sentence with a relational fact, and it provides knowledge context for entities through entity linking.
  arXiv  Detail & Related papers  (2022-10-19T13:23:10Z)
• Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis [96.53859361560505]
  We propose a knowledge graph augmented network (KGAN) to incorporate external knowledge with explicitly syntactic and contextual information. KGAN captures the sentiment feature representations from multiple perspectives, i.e., context-, syntax- and knowledge-based. Experiments on three popular ABSA benchmarks demonstrate the effectiveness and robustness of our KGAN.
  arXiv  Detail & Related papers  (2022-01-13T08:25:53Z)
• Edge: Enriching Knowledge Graph Embeddings with External Text [32.01476220906261]
  We propose a knowledge graph enrichment and embedding framework named Edge. Given an original knowledge graph, we first generate a rich but noisy augmented graph using external texts in semantic and structural level. To distill the relevant knowledge and suppress the introduced noise, we design a graph alignment term in a shared embedding space between the original graph and augmented graph.
  arXiv  Detail & Related papers  (2021-04-11T03:47:06Z)
• Biomedical Event Extraction with Hierarchical Knowledge Graphs [34.078835099079285]
  We propose to incorporate domain knowledge from Unified Medical Language System (UMLS) to a pre-trained language model via Graph Edge-conditioned Attention Networks (GEANet) and hierarchical graph representation. On BioNLP 2011 GENIA Event Extraction task, our approach achieved 1.41% F1 and 3.19% F1 improvements on all events and complex events, respectively.
  arXiv  Detail & Related papers  (2020-09-20T02:25:05Z)
• ENT-DESC: Entity Description Generation by Exploring Knowledge Graph [53.03778194567752]
  In practice, the input knowledge could be more than enough, since the output description may only cover the most significant knowledge. We introduce a large-scale and challenging dataset to facilitate the study of such a practical scenario in KG-to-text. We propose a multi-graph structure that is able to represent the original graph information more comprehensively.
  arXiv  Detail & Related papers  (2020-04-30T14:16:19Z)
• Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning [73.0598186896953]
  We present two self-supervised tasks learning over raw text with the guidance from knowledge graphs. Building upon entity-level masked language models, our first contribution is an entity masking scheme. In contrast to existing paradigms, our approach uses knowledge graphs implicitly, only during pre-training.
  arXiv  Detail & Related papers  (2020-04-29T14:22:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.