Event Extraction as Natural Language Generation

• URL: http://arxiv.org/abs/2108.12724v1
• Date: Sun, 29 Aug 2021 00:27:31 GMT
• Title: Event Extraction as Natural Language Generation
• Authors: I-Hung Hsu, Kuan-Hao Huang, Elizabeth Boschee, Scott Miller, Prem Natarajan, Kai-Wei Chang and Nanyun Peng
• Abstract summary: Event extraction is usually formulated as a classification or structured prediction problem. We propose GenEE, a model that not only captures complex dependencies within an event but also generalizes well to unseen or rare event types. Empirical results show that our model achieves strong performance on event extraction tasks under all zero-shot, few-shot, and high-resource scenarios.
• Score: 42.081626647997616
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Event extraction (EE), the task that identifies event triggers and their arguments in text, is usually formulated as a classification or structured prediction problem. Such models usually reduce labels to numeric identifiers, making them unable to take advantage of label semantics (e.g. an event type named Arrest is related to words like arrest, detain, or apprehend). This prevents the generalization to new event types. In this work, we formulate EE as a natural language generation task and propose GenEE, a model that not only captures complex dependencies within an event but also generalizes well to unseen or rare event types. Given a passage and an event type, GenEE is trained to generate a natural sentence following a predefined template for that event type. The generated output is then decoded into trigger and argument predictions. The autoregressive generation process naturally models the dependencies among the predictions -- each new word predicted depends on those already generated in the output sentence. Using carefully designed input prompts during generation, GenEE is able to capture label semantics, which enables the generalization to new event types. Empirical results show that our model achieves strong performance on event extraction tasks under all zero-shot, few-shot, and high-resource scenarios. Especially, in the high-resource setting, GenEE outperforms the state-of-the-art model on argument extraction and gets competitive results with the current best on end-to-end EE tasks.

Related papers

• Prompt-based Graph Model for Joint Liberal Event Extraction and Event Schema Induction [1.3154296174423619]
  Events are essential components of speech and texts, describing the changes in the state of entities. The event extraction task aims to identify and classify events and find their participants according to event schemas. The researchers propose Liberal Event Extraction (LEE), which aims to extract events and discover event schemas simultaneously.
  arXiv  Detail & Related papers  (2024-03-19T07:56:42Z)
• Improving Event Definition Following For Zero-Shot Event Detection [66.27883872707523]
  Existing approaches on zero-shot event detection usually train models on datasets annotated with known event types. We aim to improve zero-shot event detection by training models to better follow event definitions.
  arXiv  Detail & Related papers  (2024-03-05T01:46:50Z)
• Continual Event Extraction with Semantic Confusion Rectification [50.59450741139265]
  We study continual event extraction, which aims to extract incessantly emerging event information while avoiding forgetting. We observe that the semantic confusion on event types stems from the annotations of the same text being updated over time. This paper proposes a novel continual event extraction model with semantic confusion rectification.
  arXiv  Detail & Related papers  (2023-10-24T02:48:50Z)
• A Generative Approach for Script Event Prediction via Contrastive Fine-tuning [35.87615178251874]
  Script event prediction aims to predict the subsequent event given the context. Recent works have attempted to improve event correlation reasoning by using pretrained language models and incorporating external knowledge. We propose a novel generative approach for this task, in which a pretrained language model is fine-tuned with an event-centric pretraining objective.
  arXiv  Detail & Related papers  (2022-12-07T07:32:47Z)
• Efficient Zero-shot Event Extraction with Context-Definition Alignment [50.15061819297237]
  Event extraction (EE) is the task of identifying interested event mentions from text. We argue that using the static embedding of the event type name might not be enough because a single word could be ambiguous. We name our approach Zero-shot Event extraction with Definition (ZED)
  arXiv  Detail & Related papers  (2022-11-09T19:06:22Z)
• Dynamic Prefix-Tuning for Generative Template-based Event Extraction [31.581360683375337]
  We propose a generative template-based event extraction method with dynamic prefix (GTEE-DynPref) Experimental results show that our model achieves competitive results with the state-of-the-art classification-based model OneIE on ACE 2005. Our model is proven to be portable to new types of events effectively.
  arXiv  Detail & Related papers  (2022-05-12T15:38:34Z)
• Query and Extract: Refining Event Extraction as Type-oriented Binary Decoding [51.57864297948228]
  We propose a novel event extraction framework that takes event types and argument roles as natural language queries. Our framework benefits from the attention mechanisms to better capture the semantic correlation between the event types or argument roles and the input text.
  arXiv  Detail & Related papers  (2021-10-14T15:49:40Z)
• Unsupervised Label-aware Event Trigger and Argument Classification [73.86358632937372]
  We propose an unsupervised event extraction pipeline, which first identifies events with available tools (e.g., SRL) and then automatically maps them to pre-defined event types. We leverage pre-trained language models to contextually represent pre-defined types for both event triggers and arguments. We successfully map 83% of the triggers and 54% of the arguments to the correct types, almost doubling the performance of previous zero-shot approaches.
  arXiv  Detail & Related papers  (2020-12-30T17:47:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.