Global-to-Local Neural Networks for Document-Level Relation Extraction

• URL: http://arxiv.org/abs/2009.10359v1
• Date: Tue, 22 Sep 2020 07:30:19 GMT
• Title: Global-to-Local Neural Networks for Document-Level Relation Extraction
• Authors: Difeng Wang and Wei Hu and Ermei Cao and Weijian Sun
• Abstract summary: Relation extraction (RE) aims to identify the semantic relations between named entities in text. Recent years have witnessed it raised to the document level, which requires complex reasoning with entities and mentions throughout an entire document. We propose a novel model to document-level RE, by encoding the document information in terms of entity global and local representations as well as context relation representations.
• Score: 11.900280120655898
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Relation extraction (RE) aims to identify the semantic relations between named entities in text. Recent years have witnessed it raised to the document level, which requires complex reasoning with entities and mentions throughout an entire document. In this paper, we propose a novel model to document-level RE, by encoding the document information in terms of entity global and local representations as well as context relation representations. Entity global representations model the semantic information of all entities in the document, entity local representations aggregate the contextual information of multiple mentions of specific entities, and context relation representations encode the topic information of other relations. Experimental results demonstrate that our model achieves superior performance on two public datasets for document-level RE. It is particularly effective in extracting relations between entities of long distance and having multiple mentions.

Related papers

• Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval [49.42043077545341]
  We propose a knowledge-aware query expansion framework, augmenting LLMs with structured document relations from knowledge graph (KG) We leverage document texts as rich KG node representations and use document-based relation filtering for our Knowledge-Aware Retrieval (KAR)
  arXiv  Detail & Related papers  (2024-10-17T17:03:23Z)
• Hypergraph based Understanding for Document Semantic Entity Recognition [65.84258776834524]
  We build a novel hypergraph attention document semantic entity recognition framework, HGA, which uses hypergraph attention to focus on entity boundaries and entity categories at the same time. Our results on FUNSD, CORD, XFUNDIE show that our method can effectively improve the performance of semantic entity recognition tasks.
  arXiv  Detail & Related papers  (2024-07-09T14:35:49Z)
• SRFUND: A Multi-Granularity Hierarchical Structure Reconstruction Benchmark in Form Understanding [55.48936731641802]
  We present the SRFUND, a hierarchically structured multi-task form understanding benchmark. SRFUND provides refined annotations on top of the original FUNSD and XFUND datasets. The dataset includes eight languages including English, Chinese, Japanese, German, French, Spanish, Italian, and Portuguese.
  arXiv  Detail & Related papers  (2024-06-13T02:35:55Z)
• Document-level Relation Extraction with Cross-sentence Reasoning Graph [14.106582119686635]
  Relation extraction (RE) has recently moved from the sentence-level to document-level. We propose a novel document-level RE model with a GRaph information Aggregation and Cross-sentence Reasoning network (GRACR) Experimental results show GRACR achieves excellent performance on two public datasets of document-level RE.
  arXiv  Detail & Related papers  (2023-03-07T14:14:12Z)
• Enhancing Document-level Relation Extraction by Entity Knowledge Injection [33.35887114768141]
  Document-level relation extraction (RE) aims to identify the relations between entities throughout an entire document. Large-scale knowledge graphs (KGs) contain a wealth of real-world facts, and can provide valuable knowledge to document-level RE. We propose an entity knowledge injection framework to enhance current document-level RE models.
  arXiv  Detail & Related papers  (2022-07-23T06:45:11Z)
• Relation-Specific Attentions over Entity Mentions for Enhanced Document-Level Relation Extraction [4.685620089585031]
  We propose RSMAN which performs selective attentions over different entity mentions with respect to candidate relations. Our experiments upon two benchmark datasets show that our RSMAN can bring significant improvements for some backbone models.
  arXiv  Detail & Related papers  (2022-05-28T10:40:31Z)
• UnifieR: A Unified Retriever for Large-Scale Retrieval [84.61239936314597]
  Large-scale retrieval is to recall relevant documents from a huge collection given a query. Recent retrieval methods based on pre-trained language models (PLM) can be coarsely categorized into either dense-vector or lexicon-based paradigms. We propose a new learning framework, UnifieR which unifies dense-vector and lexicon-based retrieval in one model with a dual-representing capability.
  arXiv  Detail & Related papers  (2022-05-23T11:01:59Z)
• Document-level Relation Extraction as Semantic Segmentation [38.614931876015625]
  Document-level relation extraction aims to extract relations among multiple entity pairs from a document. This paper approaches the problem by predicting an entity-level relation matrix to capture local and global information. We propose a Document U-shaped Network for document-level relation extraction.
  arXiv  Detail & Related papers  (2021-06-07T13:44:44Z)
• Coarse-to-Fine Entity Representations for Document-level Relation Extraction [28.39444850200523]
  Document-level Relation Extraction (RE) requires extracting relations expressed within and across sentences. Recent works show that graph-based methods, usually constructing a document-level graph that captures document-aware interactions, can obtain useful entity representations. We propose the textbfCoarse-to-textbfFine textbfEntity textbfRepresentation model (textbfCFER) that adopts a coarse-to-fine strategy.
  arXiv  Detail & Related papers  (2020-12-04T10:18:59Z)
• Global Attention for Name Tagging [56.62059996864408]
  We present a new framework to improve name tagging by utilizing local, document-level, and corpus-level contextual information. We propose a model that learns to incorporate document-level and corpus-level contextual information alongside local contextual information via global attentions. Experiments on benchmark datasets show the effectiveness of our approach.
  arXiv  Detail & Related papers  (2020-10-19T07:27:15Z)
• SciREX: A Challenge Dataset for Document-Level Information Extraction [56.83748634747753]
  It is challenging to create a large-scale information extraction dataset at the document level. We introduce SciREX, a document level IE dataset that encompasses multiple IE tasks. We develop a neural model as a strong baseline that extends previous state-of-the-art IE models to document-level IE.
  arXiv  Detail & Related papers  (2020-05-01T17:30:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.