Event Presence Prediction Helps Trigger Detection Across Languages
- URL: http://arxiv.org/abs/2009.07188v1
- Date: Tue, 15 Sep 2020 15:52:21 GMT
- Title: Event Presence Prediction Helps Trigger Detection Across Languages
- Authors: Parul Awasthy and Tahira Naseem and Jian Ni and Taesun Moon and Radu
Florian
- Abstract summary: We show that a Transformer based architecture can effectively model event extraction as a sequence labeling task.
We propose a combination of sentence level and token level training objectives that significantly boosts the performance of a BERT based event extraction model.
- Score: 13.06818350795583
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The task of event detection and classification is central to most information
retrieval applications. We show that a Transformer based architecture can
effectively model event extraction as a sequence labeling task. We propose a
combination of sentence level and token level training objectives that
significantly boosts the performance of a BERT based event extraction model.
Our approach achieves a new state-of-the-art performance on ACE 2005 data for
English and Chinese. We also test our model on ERE Spanish, achieving an
average gain of 2 absolute F1 points over prior best performing model.
Related papers
- Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance Segmentation [105.23631749213729]
We propose a novel method for unsupervised pre-training in low-data regimes.
Inspired by the recently successful prompting technique, we introduce a new method, Unsupervised Pre-training with Language-Vision Prompts.
We show that our method can converge faster and perform better than CNN-based models in low-data regimes.
arXiv Detail & Related papers (2024-05-22T06:48:43Z) - Semantic Pivoting Model for Effective Event Detection [19.205550116466604]
Event Detection aims to identify and classify mentions of event instances from unstructured articles.
Existing techniques for event detection only use homogeneous one-hot vectors to represent the event type classes, ignoring the fact that the semantic meaning of the types is important to the task.
We propose a Semantic Pivoting Model for Effective Event Detection (SPEED), which explicitly incorporates prior information during training and captures semantically meaningful correlations between input and events.
arXiv Detail & Related papers (2022-11-01T19:20:34Z) - Few-shot Incremental Event Detection [3.508346077709686]
Event detection tasks can enable the quick detection of events from texts.
To extend them to detect a new class without losing the ability to detect old classes requires costly retraining of the model from scratch.
We define a new task, few-shot incremental event detection, which focuses on learning to detect a new event class with limited data.
arXiv Detail & Related papers (2022-09-05T14:21:26Z) - Segment-level Metric Learning for Few-shot Bioacoustic Event Detection [56.59107110017436]
We propose a segment-level few-shot learning framework that utilizes both the positive and negative events during model optimization.
Our system achieves an F-measure of 62.73 on the DCASE 2022 challenge task 5 (DCASE2022-T5) validation set, outperforming the performance of the baseline prototypical network 34.02 by a large margin.
arXiv Detail & Related papers (2022-07-15T22:41:30Z) - Improve Event Extraction via Self-Training with Gradient Guidance [10.618929821822892]
We propose a Self-Training with Feedback (STF) framework to overcome the main factor that hinders the progress of event extraction.
STF consists of (1) a base event extraction model trained on existing event annotations and then applied to large-scale unlabeled corpora to predict new event mentions as pseudo training samples, and (2) a novel scoring model that takes in each new predicted event trigger, an argument, its argument role, as well as their paths in the AMR graph to estimate a compatibility score.
Experimental results on three benchmark datasets, including ACE05-E, ACE05-E+, and ERE
arXiv Detail & Related papers (2022-05-25T04:40:17Z) - PILED: An Identify-and-Localize Framework for Few-Shot Event Detection [79.66042333016478]
In our study, we employ cloze prompts to elicit event-related knowledge from pretrained language models.
We minimize the number of type-specific parameters, enabling our model to quickly adapt to event detection tasks for new types.
arXiv Detail & Related papers (2022-02-15T18:01:39Z) - Robust Event Classification Using Imperfect Real-world PMU Data [58.26737360525643]
We study robust event classification using imperfect real-world phasor measurement unit (PMU) data.
We develop a novel machine learning framework for training robust event classifiers.
arXiv Detail & Related papers (2021-10-19T17:41:43Z) - Learning Constraints and Descriptive Segmentation for Subevent Detection [74.48201657623218]
We propose an approach to learning and enforcing constraints that capture dependencies between subevent detection and EventSeg prediction.
We adopt Rectifier Networks for constraint learning and then convert the learned constraints to a regularization term in the loss function of the neural model.
arXiv Detail & Related papers (2021-09-13T20:50:37Z) - EventPoint: Self-Supervised Local Descriptor Learning for Event Cameras [2.3300629798610446]
We propose a method of extracting intrest points and descriptors using self-supervised learning method on frame-based event data, which is called EventPoint.
We train our model on real event-form driving dataset--DSEC with the self-supervised learning method we proposed, the training progress fully consider the characteristics of event data.
arXiv Detail & Related papers (2021-09-01T06:58:14Z) - Unsupervised Paraphrasing with Pretrained Language Models [85.03373221588707]
We propose a training pipeline that enables pre-trained language models to generate high-quality paraphrases in an unsupervised setting.
Our recipe consists of task-adaptation, self-supervision, and a novel decoding algorithm named Dynamic Blocking.
We show with automatic and human evaluations that our approach achieves state-of-the-art performance on both the Quora Question Pair and the ParaNMT datasets.
arXiv Detail & Related papers (2020-10-24T11:55:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.