Are Triggers Needed for Document-Level Event Extraction?
- URL: http://arxiv.org/abs/2411.08708v2
- Date: Thu, 26 Jun 2025 21:13:38 GMT
- Title: Are Triggers Needed for Document-Level Event Extraction?
- Authors: Shaden Shaar, Wayne Chen, Maitreyi Chatterjee, Barry Wang, Wenting Zhao, Claire Cardie,
- Abstract summary: We study the role of triggers in document-level event extraction.<n>We find that whether or not systems benefit from explicitly extracting triggers depends on dataset characteristics.<n>Perhaps surprisingly, we also observe that the mere existence of triggers in the input, even random ones, is important for prompt-based in-context learning approaches to the task.
- Score: 16.944314894087075
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most existing work on event extraction has focused on sentence-level texts and presumes the identification of a trigger-span -- a word or phrase in the input that evokes the occurrence of an event of interest. Event arguments are then extracted with respect to the trigger. Indeed, triggers are treated as integral to, and trigger detection as an essential component of, event extraction. In this paper, we provide the first investigation of the role of triggers for the more difficult and much less studied task of document-level event extraction. We analyze their usefulness in multiple end-to-end and pipelined transformer-based event extraction models for three document-level event extraction datasets, measuring performance using triggers of varying quality (human-annotated, LLM-generated, keyword-based, and random). We find that whether or not systems benefit from explicitly extracting triggers depends both on dataset characteristics (i.e. the typical number of events per document) and task-specific information available during extraction (i.e. natural language event schemas). Perhaps surprisingly, we also observe that the mere existence of triggers in the input, even random ones, is important for prompt-based in-context learning approaches to the task.
Related papers
- MAVEN-Arg: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation [104.6065882758648]
MAVEN-Arg is the first all-in-one dataset supporting event detection, event argument extraction, and event relation extraction.
As an EAE benchmark, MAVEN-Arg offers three main advantages: (1) a comprehensive schema covering 162 event types and 612 argument roles, all with expert-written definitions and examples; (2) a large data scale, containing 98,591 events and 290,613 arguments obtained with laborious human annotation; and (3) the exhaustive annotation supporting all task variants of EAE.
arXiv Detail & Related papers (2023-11-15T16:52:14Z) - Boosting Event Extraction with Denoised Structure-to-Text Augmentation [52.21703002404442]
Event extraction aims to recognize pre-defined event triggers and arguments from texts.
Recent data augmentation methods often neglect the problem of grammatical incorrectness.
We propose a denoised structure-to-text augmentation framework for event extraction DAEE.
arXiv Detail & Related papers (2023-05-16T16:52:07Z) - LED: A Dataset for Life Event Extraction from Dialogs [57.390999707053915]
Lifelogging has gained more attention due to its wide applications, such as personalized recommendations or memory assistance.
Life Event Dialog is a dataset containing fine-grained life event annotations on conversational data.
We explore three information extraction (IE) frameworks to address the conversational life event extraction task.
arXiv Detail & Related papers (2023-04-17T14:46:59Z) - PILED: An Identify-and-Localize Framework for Few-Shot Event Detection [79.66042333016478]
In our study, we employ cloze prompts to elicit event-related knowledge from pretrained language models.
We minimize the number of type-specific parameters, enabling our model to quickly adapt to event detection tasks for new types.
arXiv Detail & Related papers (2022-02-15T18:01:39Z) - Zero-Shot Information Extraction as a Unified Text-to-Triple Translation [56.01830747416606]
We cast a suite of information extraction tasks into a text-to-triple translation framework.
We formalize the task as a translation between task-specific input text and output triples.
We study the zero-shot performance of this framework on open information extraction.
arXiv Detail & Related papers (2021-09-23T06:54:19Z) - Learning Constraints and Descriptive Segmentation for Subevent Detection [74.48201657623218]
We propose an approach to learning and enforcing constraints that capture dependencies between subevent detection and EventSeg prediction.
We adopt Rectifier Networks for constraint learning and then convert the learned constraints to a regularization term in the loss function of the neural model.
arXiv Detail & Related papers (2021-09-13T20:50:37Z) - CasEE: A Joint Learning Framework with Cascade Decoding for Overlapping
Event Extraction [9.300138832652658]
Event extraction (EE) is a crucial information extraction task that aims to extract event information in texts.
This work systematically studies the realistic event overlapping problem, where a word may serve as triggers with several types or arguments with different roles.
We propose a novel joint learning framework with cascade decoding for overlapping event extraction, termed as CasEE.
arXiv Detail & Related papers (2021-07-04T10:01:55Z) - Event Argument Extraction using Causal Knowledge Structures [9.56216681584111]
Event Argument extraction refers to the task of extracting structured information from unstructured text for a particular event of interest.
Most of the existing works model this task at a sentence level, restricting the context to a local scope.
We propose an external knowledge aided approach to infuse document-level event information to aid the extraction of complex event arguments.
arXiv Detail & Related papers (2021-05-02T13:59:07Z) - Document-Level Event Argument Extraction by Conditional Generation [75.73327502536938]
Event extraction has long been treated as a sentence-level task in the IE community.
We propose a document-level neural event argument extraction model by formulating the task as conditional generation following event templates.
We also compile a new document-level event extraction benchmark dataset WikiEvents.
arXiv Detail & Related papers (2021-04-13T03:36:38Z) - Document-level Event Extraction with Efficient End-to-end Learning of
Cross-event Dependencies [37.96254956540803]
We propose an end-to-end model leveraging Deep Value Networks (DVN), a structured prediction algorithm, to efficiently capture cross-event dependencies for document-level event extraction.
Our approach achieves comparable performance to CRF-based models on ACE05, while enjoys significantly higher computational efficiency.
arXiv Detail & Related papers (2020-10-24T05:28:16Z) - Probing and Fine-tuning Reading Comprehension Models for Few-shot Event
Extraction [17.548548562222766]
We propose a reading comprehension framework for event extraction.
By constructing proper query templates, our approach can effectively distill rich knowledge about tasks and label semantics.
Our method achieves state-of-the-art performance on the ACE 2005 benchmark when trained with full supervision.
arXiv Detail & Related papers (2020-10-21T21:48:39Z) - Detecting Ongoing Events Using Contextual Word and Sentence Embeddings [110.83289076967895]
This paper introduces the Ongoing Event Detection (OED) task.
The goal is to detect ongoing event mentions only, as opposed to historical, future, hypothetical, or other forms or events that are neither fresh nor current.
Any application that needs to extract structured information about ongoing events from unstructured texts can take advantage of an OED system.
arXiv Detail & Related papers (2020-07-02T20:44:05Z) - Event Arguments Extraction via Dilate Gated Convolutional Neural Network
with Enhanced Local Features [13.862428694544635]
Event extraction plays an important role in information-extraction to understand the world.
In this work, we proposed a novel Event Extraction approach based on multi-layer Dilate Gated Convolutional Neural Network (EE-DGCNN)
Experiments demonstrated significant performance improvement beyond state-of-art event extraction approaches on real-world datasets.
arXiv Detail & Related papers (2020-06-02T18:05:34Z) - Document-Level Event Role Filler Extraction using Multi-Granularity
Contextualized Encoding [40.13163091122463]
Event extraction is a difficult task since it requires a view of a larger context to determine which spans of text correspond to event role fillers.
We first investigate how end-to-end neural sequence models perform on document-level role filler extraction.
We show that our best system performs substantially better than prior work.
arXiv Detail & Related papers (2020-05-13T20:42:17Z) - Event Extraction by Answering (Almost) Natural Questions [40.13163091122463]
We introduce a new paradigm for event extraction by formulating it as a question answering (QA) task.
Empirical results demonstrate that our framework outperforms prior methods substantially.
arXiv Detail & Related papers (2020-04-28T16:15:46Z) - Improving Multi-Turn Response Selection Models with Complementary
Last-Utterance Selection by Instance Weighting [84.9716460244444]
We consider utilizing the underlying correlation in the data resource itself to derive different kinds of supervision signals.
We conduct extensive experiments in two public datasets and obtain significant improvement in both datasets.
arXiv Detail & Related papers (2020-02-18T06:29:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.