Continual Event Extraction with Semantic Confusion Rectification

• URL: http://arxiv.org/abs/2310.15470v1
• Date: Tue, 24 Oct 2023 02:48:50 GMT
• Title: Continual Event Extraction with Semantic Confusion Rectification
• Authors: Zitao Wang and Xinyi Wang and Wei Hu
• Abstract summary: We study continual event extraction, which aims to extract incessantly emerging event information while avoiding forgetting. We observe that the semantic confusion on event types stems from the annotations of the same text being updated over time. This paper proposes a novel continual event extraction model with semantic confusion rectification.
• Score: 50.59450741139265
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We study continual event extraction, which aims to extract incessantly emerging event information while avoiding forgetting. We observe that the semantic confusion on event types stems from the annotations of the same text being updated over time. The imbalance between event types even aggravates this issue. This paper proposes a novel continual event extraction model with semantic confusion rectification. We mark pseudo labels for each sentence to alleviate semantic confusion. We transfer pivotal knowledge between current and previous models to enhance the understanding of event types. Moreover, we encourage the model to focus on the semantics of long-tailed event types by leveraging other associated types. Experimental results show that our model outperforms state-of-the-art baselines and is proficient in imbalanced datasets.

Related papers

• Improving Event Definition Following For Zero-Shot Event Detection [66.27883872707523]
  Existing approaches on zero-shot event detection usually train models on datasets annotated with known event types. We aim to improve zero-shot event detection by training models to better follow event definitions.
  arXiv  Detail & Related papers  (2024-03-05T01:46:50Z)
• What happens before and after: Multi-Event Commonsense in Event Coreference Resolution [9.57377689986741]
  We propose a model that extends event mentions with temporal commonsense inferences. We show that incorporating such inferences into an existing event coreference model improves its performance.
  arXiv  Detail & Related papers  (2023-02-20T01:51:01Z)
• A Generative Approach for Script Event Prediction via Contrastive Fine-tuning [35.87615178251874]
  Script event prediction aims to predict the subsequent event given the context. Recent works have attempted to improve event correlation reasoning by using pretrained language models and incorporating external knowledge. We propose a novel generative approach for this task, in which a pretrained language model is fine-tuned with an event-centric pretraining objective.
  arXiv  Detail & Related papers  (2022-12-07T07:32:47Z)
• Efficient Zero-shot Event Extraction with Context-Definition Alignment [50.15061819297237]
  Event extraction (EE) is the task of identifying interested event mentions from text. We argue that using the static embedding of the event type name might not be enough because a single word could be ambiguous. We name our approach Zero-shot Event extraction with Definition (ZED)
  arXiv  Detail & Related papers  (2022-11-09T19:06:22Z)
• Semantic Pivoting Model for Effective Event Detection [19.205550116466604]
  Event Detection aims to identify and classify mentions of event instances from unstructured articles. Existing techniques for event detection only use homogeneous one-hot vectors to represent the event type classes, ignoring the fact that the semantic meaning of the types is important to the task. We propose a Semantic Pivoting Model for Effective Event Detection (SPEED), which explicitly incorporates prior information during training and captures semantically meaningful correlations between input and events.
  arXiv  Detail & Related papers  (2022-11-01T19:20:34Z)
• Unifying Event Detection and Captioning as Sequence Generation via Pre-Training [53.613265415703815]
  We propose a unified pre-training and fine-tuning framework to enhance the inter-task association between event detection and captioning. Our model outperforms the state-of-the-art methods, and can be further boosted when pre-trained on extra large-scale video-text data.
  arXiv  Detail & Related papers  (2022-07-18T14:18:13Z)
• Semi-supervised New Event Type Induction and Description via Contrastive Loss-Enforced Batch Attention [56.46649994444616]
  We present a novel approach to semi-supervised new event type induction using a masked contrastive loss. We extend our approach to two new tasks: predicting the type name of the discovered clusters and linking them to FrameNet frames.
  arXiv  Detail & Related papers  (2022-02-12T00:32:22Z)
• Unsupervised Label-aware Event Trigger and Argument Classification [73.86358632937372]
  We propose an unsupervised event extraction pipeline, which first identifies events with available tools (e.g., SRL) and then automatically maps them to pre-defined event types. We leverage pre-trained language models to contextually represent pre-defined types for both event triggers and arguments. We successfully map 83% of the triggers and 54% of the arguments to the correct types, almost doubling the performance of previous zero-shot approaches.
  arXiv  Detail & Related papers  (2020-12-30T17:47:24Z)
• Probing and Fine-tuning Reading Comprehension Models for Few-shot Event Extraction [17.548548562222766]
  We propose a reading comprehension framework for event extraction. By constructing proper query templates, our approach can effectively distill rich knowledge about tasks and label semantics. Our method achieves state-of-the-art performance on the ACE 2005 benchmark when trained with full supervision.
  arXiv  Detail & Related papers  (2020-10-21T21:48:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.