Similarity-based Memory Enhanced Joint Entity and Relation Extraction

• URL: http://arxiv.org/abs/2307.11762v1
• Date: Fri, 14 Jul 2023 12:26:56 GMT
• Title: Similarity-based Memory Enhanced Joint Entity and Relation Extraction
• Authors: Witold Kosciukiewicz, Mateusz Wojcik, Tomasz Kajdanowicz, Adam Gonczarek
• Abstract summary: Document-level joint entity and relation extraction is a challenging information extraction problem. We present a multi-task learning framework with bidirectional memory-like dependency between tasks. Our empirical studies show that the proposed approach outperforms the existing methods.
• Score: 3.9659135716762894
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Document-level joint entity and relation extraction is a challenging information extraction problem that requires a unified approach where a single neural network performs four sub-tasks: mention detection, coreference resolution, entity classification, and relation extraction. Existing methods often utilize a sequential multi-task learning approach, in which the arbitral decomposition causes the current task to depend only on the previous one, missing the possible existence of the more complex relationships between them. In this paper, we present a multi-task learning framework with bidirectional memory-like dependency between tasks to address those drawbacks and perform the joint problem more accurately. Our empirical studies show that the proposed approach outperforms the existing methods and achieves state-of-the-art results on the BioCreative V CDR corpus.

Related papers

• A Decoupling and Aggregating Framework for Joint Extraction of Entities and Relations [7.911978021993282]
  We propose a novel model to jointly extract entities and relations. We propose to decouple the feature encoding process into three parts, namely encoding subjects, encoding objects, and encoding relations. Our model outperforms several previous state-of-the-art models.
  arXiv  Detail & Related papers  (2024-05-14T04:27:16Z)
• Multi-modal Causal Structure Learning and Root Cause Analysis [67.67578590390907]
  We propose Mulan, a unified multi-modal causal structure learning method for root cause localization. We leverage a log-tailored language model to facilitate log representation learning, converting log sequences into time-series data. We also introduce a novel key performance indicator-aware attention mechanism for assessing modality reliability and co-learning a final causal graph.
  arXiv  Detail & Related papers  (2024-02-04T05:50:38Z)
• CARE: Co-Attention Network for Joint Entity and Relation Extraction [0.0]
  We propose a Co-Attention network for joint entity and relation extraction. Our approach includes adopting a parallel encoding strategy to learn separate representations for each subtask. At the core of our approach is the co-attention module that captures two-way interaction between the two subtasks.
  arXiv  Detail & Related papers  (2023-08-24T03:40:54Z)
• Multimodal Relation Extraction with Cross-Modal Retrieval and Synthesis [89.04041100520881]
  This research proposes to retrieve textual and visual evidence based on the object, sentence, and whole image. We develop a novel approach to synthesize the object-level, image-level, and sentence-level information for better reasoning between the same and different modalities.
  arXiv  Detail & Related papers  (2023-05-25T15:26:13Z)
• ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select [53.071352033539526]
  We study the problem of extracting N-ary relations from scientific articles. Our proposed method ReSel decomposes this task into a two-stage procedure. Our experiments on three scientific information extraction datasets show that ReSel outperforms state-of-the-art baselines significantly.
  arXiv  Detail & Related papers  (2022-10-26T02:28:02Z)
• OneRel:Joint Entity and Relation Extraction with One Module in One Step [42.576188878294886]
  Joint entity and relation extraction is an essential task in natural language processing and knowledge graph construction. We propose a novel joint entity and relation extraction model, named OneRel, which casts joint extraction as a fine-grained triple classification problem.
  arXiv  Detail & Related papers  (2022-03-10T15:09:59Z)
• Towards Effective Multi-Task Interaction for Entity-Relation Extraction: A Unified Framework with Selection Recurrent Network [4.477310325275069]
  Entity-relation extraction aims to jointly solve named entity recognition (NER) and relation extraction (RE) Recent approaches use either one-way sequential information propagation in a pipeline manner or two-way implicit interaction with a shared encoder. We propose a novel and unified cascade framework that combines the advantages of both sequential information propagation and implicit interaction.
  arXiv  Detail & Related papers  (2022-02-15T09:54:33Z)
• On the relationship between disentanglement and multi-task learning [62.997667081978825]
  We take a closer look at the relationship between disentanglement and multi-task learning based on hard parameter sharing. We show that disentanglement appears naturally during the process of multi-task neural network training.
  arXiv  Detail & Related papers  (2021-10-07T14:35:34Z)
• SAIS: Supervising and Augmenting Intermediate Steps for Document-Level Relation Extraction [51.27558374091491]
  We propose to explicitly teach the model to capture relevant contexts and entity types by supervising and augmenting intermediate steps (SAIS) for relation extraction. Based on a broad spectrum of carefully designed tasks, our proposed SAIS method not only extracts relations of better quality due to more effective supervision, but also retrieves the corresponding supporting evidence more accurately.
  arXiv  Detail & Related papers  (2021-09-24T17:37:35Z)
• Cross-Supervised Joint-Event-Extraction with Heterogeneous Information Networks [61.950353376870154]
  Joint-event-extraction is a sequence-to-sequence labeling task with a tag set composed of tags of triggers and entities. We propose a Cross-Supervised Mechanism (CSM) to alternately supervise the extraction of triggers or entities. Our approach outperforms the state-of-the-art methods in both entity and trigger extraction.
  arXiv  Detail & Related papers  (2020-10-13T11:51:17Z)
• Recurrent Interaction Network for Jointly Extracting Entities and Classifying Relations [45.79634026256055]
  We design a multi-task learning model which allows the learning of interactions dynamically. Empirical studies on two real-world datasets confirm the superiority of the proposed model.
  arXiv  Detail & Related papers  (2020-05-01T01:03:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.