Retrieval-Augmented Generative Question Answering for Event Argument Extraction

• URL: http://arxiv.org/abs/2211.07067v1
• Date: Mon, 14 Nov 2022 02:00:32 GMT
• Title: Retrieval-Augmented Generative Question Answering for Event Argument Extraction
• Authors: Xinya Du and Heng Ji
• Abstract summary: We propose a retrieval-augmented generative QA model (R-GQA) for event argument extraction. It retrieves the most similar QA pair and augments it as prompt to the current example's context, then decodes the arguments as answers. Our approach outperforms substantially prior methods across various settings.
• Score: 66.24622127143044
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Event argument extraction has long been studied as a sequential prediction problem with extractive-based methods, tackling each argument in isolation. Although recent work proposes generation-based methods to capture cross-argument dependency, they require generating and post-processing a complicated target sequence (template). Motivated by these observations and recent pretrained language models' capabilities of learning from demonstrations. We propose a retrieval-augmented generative QA model (R-GQA) for event argument extraction. It retrieves the most similar QA pair and augments it as prompt to the current example's context, then decodes the arguments as answers. Our approach outperforms substantially prior methods across various settings (i.e. fully supervised, domain transfer, and fewshot learning). Finally, we propose a clustering-based sampling strategy (JointEnc) and conduct a thorough analysis of how different strategies influence the few-shot learning performance. The implementations are available at https:// github.com/xinyadu/RGQA

Related papers

• Asking and Answering Questions to Extract Event-Argument Structures [7.997025284201876]
  This paper presents a question-answering approach to extract document-level event-argument structures. We automatically ask and answer questions for each argument type an event may have. We use a simple span-swapping technique, coreference resolution, and large language models to augment the training instances.
  arXiv  Detail & Related papers  (2024-04-25T08:43:06Z)
• AMERICANO: Argument Generation with Discourse-driven Decomposition and Agent Interaction [25.38899822861742]
  We propose Americano, a novel framework with agent interaction for argument generation. Our approach decomposes the generation process into sequential actions grounded on argumentation theory. Our method outperforms both end-to-end and chain-of-thought prompting methods.
  arXiv  Detail & Related papers  (2023-10-31T10:47:33Z)
• Event Extraction as Question Generation and Answering [72.04433206754489]
  Recent work on Event Extraction has reframed the task as Question Answering (QA) We propose QGA-EE, which enables a Question Generation (QG) model to generate questions that incorporate rich contextual information instead of using fixed templates. Experiments show that QGA-EE outperforms all prior single-task-based models on the ACE05 English dataset.
  arXiv  Detail & Related papers  (2023-07-10T01:46:15Z)
• An Empirical Comparison of LM-based Question and Answer Generation Methods [79.31199020420827]
  Question and answer generation (QAG) consists of generating a set of question-answer pairs given a context. In this paper, we establish baselines with three different QAG methodologies that leverage sequence-to-sequence language model (LM) fine-tuning. Experiments show that an end-to-end QAG model, which is computationally light at both training and inference times, is generally robust and outperforms other more convoluted approaches.
  arXiv  Detail & Related papers  (2023-05-26T14:59:53Z)
• RetICL: Sequential Retrieval of In-Context Examples with Reinforcement Learning [53.52699766206808]
  We propose Retrieval for In-Context Learning (RetICL), a learnable method for modeling and optimally selecting examples sequentially for in-context learning. We evaluate RetICL on math word problem solving and scientific question answering tasks and show that it consistently outperforms or matches and learnable baselines.
  arXiv  Detail & Related papers  (2023-05-23T20:15:56Z)
• DORE: Document Ordered Relation Extraction based on Generative Framework [56.537386636819626]
  This paper investigates the root cause of the underwhelming performance of the existing generative DocRE models. We propose to generate a symbolic and ordered sequence from the relation matrix which is deterministic and easier for model to learn. Experimental results on four datasets show that our proposed method can improve the performance of the generative DocRE models.
  arXiv  Detail & Related papers  (2022-10-28T11:18:10Z)
• CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction [22.746071199667146]
  Implicit event argument extraction (EAE) aims to identify arguments that could scatter over the document. We propose a Curriculum learning based Prompt tuning (CUP) approach, which resolves implicit EAE by four learning stages. In addition, we integrate a prompt-based encoder-decoder model to elicit related knowledge from pre-trained language models.
  arXiv  Detail & Related papers  (2022-05-01T16:03:54Z)
• Generating Disentangled Arguments with Prompts: A Simple Event Extraction Framework that Works [9.36117752274482]
  Event Extraction bridges the gap between text and event signals. We introduce the prompt-based learning strategy to the domain of Event Extraction. In terms of F1 score on Argument Extraction, our simple architecture is stronger than any other generative counterpart.
  arXiv  Detail & Related papers  (2021-10-09T09:36:08Z)
• Reinforcement Learning-based Dialogue Guided Event Extraction to Exploit Argument Relations [70.35379323231241]
  This paper presents a better approach for event extraction by explicitly utilizing the relationships of event arguments. We employ reinforcement learning and incremental learning to extract multiple arguments via a multi-turned, iterative process. Experimental results show that our approach consistently outperforms seven state-of-the-art event extraction methods.
  arXiv  Detail & Related papers  (2021-06-23T13:24:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.