Causality Detection using Multiple Annotation Decision
- URL: http://arxiv.org/abs/2210.14852v1
- Date: Wed, 26 Oct 2022 16:50:10 GMT
- Title: Causality Detection using Multiple Annotation Decision
- Authors: Quynh Anh Nguyen, Arka Mitra
- Abstract summary: The work is associated with Subtask 1 of Shared Task 3 that aims to detect causality in protest news corpus.
The experiments showed that bert-based-uncased with refined cross-entropy outperformed the others, achieving a F1 score of 0.8501 on the Causal News Corpus dataset.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The paper describes the work that has been submitted to the 5th workshop on
Challenges and Applications of Automated Extraction of socio-political events
from text (CASE 2022). The work is associated with Subtask 1 of Shared Task 3
that aims to detect causality in protest news corpus. The authors used
different large language models with customized cross-entropy loss functions
that exploit annotation information. The experiments showed that
bert-based-uncased with refined cross-entropy outperformed the others,
achieving a F1 score of 0.8501 on the Causal News Corpus dataset.
Related papers
- Causal Micro-Narratives [62.47217054314046]
We present a novel approach to classify causal micro-narratives from text.
These narratives are sentence-level explanations of the cause(s) and/or effect(s) of a target subject.
arXiv Detail & Related papers (2024-10-07T17:55:10Z) - Inducing Causal Structure for Abstractive Text Summarization [76.1000380429553]
We introduce a Structural Causal Model (SCM) to induce the underlying causal structure of the summarization data.
We propose a Causality Inspired Sequence-to-Sequence model (CI-Seq2Seq) to learn the causal representations that can mimic the causal factors.
Experimental results on two widely used text summarization datasets demonstrate the advantages of our approach.
arXiv Detail & Related papers (2023-08-24T16:06:36Z) - Event Causality Identification with Causal News Corpus -- Shared Task 3,
CASE 2022 [3.0775142635531685]
Event Causality Identification Shared Task of CASE 2022 involved two subtasks.
Subtask 1 required participants to predict if a sentence contains a causal relation or not.
Subtask 2 required participants to identify the Cause, Effect and Signal spans per causal sentence.
arXiv Detail & Related papers (2022-11-22T10:34:09Z) - UniCausal: Unified Benchmark and Repository for Causal Text Mining [7.402967063220846]
We propose UniCausal, a unified benchmark for causal text mining across three tasks.
We consolidate and align annotations of six high quality, mainly human-annotated, corpora.
To create an initial benchmark, we fine-tuned BERT pre-trained language models to each task, achieving 70.10% Binary F1, 52.42% Macro F1, and 84.68% Binary F1 scores respectively.
arXiv Detail & Related papers (2022-08-19T06:14:05Z) - DSC-IITISM at FinCausal 2021: Combining POS tagging with Attention-based
Contextual Representations for Identifying Causal Relationships in Financial
Documents [0.0]
Causality detection has applications in information retrieval, event prediction, question answering, financial analysis, and market research.
In this study, we explore several methods to identify and extract cause-effect pairs in financial documents using transformers.
Our best methodology achieves an F1-Score of 0.9551, and an Exact Match Score of 0.8777 on the blind test.
arXiv Detail & Related papers (2021-10-31T13:09:19Z) - Learning Constraints and Descriptive Segmentation for Subevent Detection [74.48201657623218]
We propose an approach to learning and enforcing constraints that capture dependencies between subevent detection and EventSeg prediction.
We adopt Rectifier Networks for constraint learning and then convert the learned constraints to a regularization term in the loss function of the neural model.
arXiv Detail & Related papers (2021-09-13T20:50:37Z) - Nested Counterfactual Identification from Arbitrary Surrogate
Experiments [95.48089725859298]
We study the identification of nested counterfactuals from an arbitrary combination of observations and experiments.
Specifically, we prove the counterfactual unnesting theorem (CUT), which allows one to map arbitrary nested counterfactuals to unnested ones.
arXiv Detail & Related papers (2021-07-07T12:51:04Z) - IIT_kgp at FinCausal 2020, Shared Task 1: Causality Detection using
Sentence Embeddings in Financial Reports [0.0]
This work is associated with the first sub-task of identifying causality in sentences.
BERT (Large) performed the best, giving a F1 score of 0.958, in the task of detecting the causality of sentences in financial texts and reports.
arXiv Detail & Related papers (2020-11-16T00:57:14Z) - Adversarial Semantic Collisions [129.55896108684433]
We study semantic collisions: texts that are semantically unrelated but judged as similar by NLP models.
We develop gradient-based approaches for generating semantic collisions.
We show how to generate semantic collisions that evade perplexity-based filtering.
arXiv Detail & Related papers (2020-11-09T20:42:01Z) - "What Are You Trying to Do?" Semantic Typing of Event Processes [94.3499255880101]
This paper studies a new cognitively motivated semantic typing task, multi-axis event process typing.
We develop a large dataset containing over 60k event processes, featuring ultra fine-grained typing on both the action and object type axes.
We propose a hybrid learning framework, P2GT, which addresses the challenging typing problem with indirect supervision from glosses1and a joint learning-to-rank framework.
arXiv Detail & Related papers (2020-10-13T22:37:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.