IIT_kgp at FinCausal 2020, Shared Task 1: Causality Detection using
Sentence Embeddings in Financial Reports
- URL: http://arxiv.org/abs/2011.07670v1
- Date: Mon, 16 Nov 2020 00:57:14 GMT
- Title: IIT_kgp at FinCausal 2020, Shared Task 1: Causality Detection using
Sentence Embeddings in Financial Reports
- Authors: Arka Mitra, Harshvardhan Srivastava, Yugam Tiwari
- Abstract summary: This work is associated with the first sub-task of identifying causality in sentences.
BERT (Large) performed the best, giving a F1 score of 0.958, in the task of detecting the causality of sentences in financial texts and reports.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The paper describes the work that the team submitted to FinCausal 2020 Shared
Task. This work is associated with the first sub-task of identifying causality
in sentences. The various models used in the experiments tried to obtain a
latent space representation for each of the sentences. Linear regression was
performed on these representations to classify whether the sentence is causal
or not. The experiments have shown BERT (Large) performed the best, giving a F1
score of 0.958, in the task of detecting the causality of sentences in
financial texts and reports. The class imbalance was dealt with a modified loss
function to give a better metric score for the evaluation.
Related papers
- Causal Micro-Narratives [62.47217054314046]
We present a novel approach to classify causal micro-narratives from text.
These narratives are sentence-level explanations of the cause(s) and/or effect(s) of a target subject.
arXiv Detail & Related papers (2024-10-07T17:55:10Z) - Do LLMs Think Fast and Slow? A Causal Study on Sentiment Analysis [136.13390762317698]
Sentiment analysis (SA) aims to identify the sentiment expressed in a text, such as a product review.
Given a review and the sentiment associated with it, this work formulates SA as a combination of two tasks.
We classify a sample as C1 if its overall sentiment score approximates an average of all the sentence-level sentiments in the review, and C2 if the overall sentiment score approximates an average of the peak and end sentiments.
arXiv Detail & Related papers (2024-04-17T04:04:34Z) - TEDB System Description to a Shared Task on Euphemism Detection 2022 [0.0]
We considered Transformer-based models which are the current state-of-the-art methods for text classification.
Our best result of 0.816 F1-score consists of a euphemism-detection-finetuned/TimeLMs-pretrained RoBERTa model as a feature extractor.
arXiv Detail & Related papers (2023-01-16T20:37:56Z) - Event Causality Identification with Causal News Corpus -- Shared Task 3,
CASE 2022 [3.0775142635531685]
Event Causality Identification Shared Task of CASE 2022 involved two subtasks.
Subtask 1 required participants to predict if a sentence contains a causal relation or not.
Subtask 2 required participants to identify the Cause, Effect and Signal spans per causal sentence.
arXiv Detail & Related papers (2022-11-22T10:34:09Z) - Causality Detection using Multiple Annotation Decision [0.0]
The work is associated with Subtask 1 of Shared Task 3 that aims to detect causality in protest news corpus.
The experiments showed that bert-based-uncased with refined cross-entropy outperformed the others, achieving a F1 score of 0.8501 on the Causal News Corpus dataset.
arXiv Detail & Related papers (2022-10-26T16:50:10Z) - RuArg-2022: Argument Mining Evaluation [69.87149207721035]
This paper is a report of the organizers on the first competition of argumentation analysis systems dealing with Russian language texts.
A corpus containing 9,550 sentences (comments on social media posts) on three topics related to the COVID-19 pandemic was prepared.
The system that won the first place in both tasks used the NLI (Natural Language Inference) variant of the BERT architecture.
arXiv Detail & Related papers (2022-06-18T17:13:37Z) - CIS2: A Simplified Commonsense Inference Evaluation for Story Prose [21.32351425259654]
We look at the domain of commonsense reasoning within story prose, which we call contextual commonsense inference (CCI)
We introduce the task contextual commonsense inference in sentence selection (CIS$2$), a simplified task that avoids conflation by eliminating language generation altogether.
arXiv Detail & Related papers (2022-02-16T06:14:37Z) - DSC-IITISM at FinCausal 2021: Combining POS tagging with Attention-based
Contextual Representations for Identifying Causal Relationships in Financial
Documents [0.0]
Causality detection has applications in information retrieval, event prediction, question answering, financial analysis, and market research.
In this study, we explore several methods to identify and extract cause-effect pairs in financial documents using transformers.
Our best methodology achieves an F1-Score of 0.9551, and an Exact Match Score of 0.8777 on the blind test.
arXiv Detail & Related papers (2021-10-31T13:09:19Z) - Narrative Incoherence Detection [76.43894977558811]
We propose the task of narrative incoherence detection as a new arena for inter-sentential semantic understanding.
Given a multi-sentence narrative, decide whether there exist any semantic discrepancies in the narrative flow.
arXiv Detail & Related papers (2020-12-21T07:18:08Z) - On the Sentence Embeddings from Pre-trained Language Models [78.45172445684126]
In this paper, we argue that the semantic information in the BERT embeddings is not fully exploited.
We find that BERT always induces a non-smooth anisotropic semantic space of sentences, which harms its performance of semantic similarity.
We propose to transform the anisotropic sentence embedding distribution to a smooth and isotropic Gaussian distribution through normalizing flows that are learned with an unsupervised objective.
arXiv Detail & Related papers (2020-11-02T13:14:57Z) - L2R2: Leveraging Ranking for Abductive Reasoning [65.40375542988416]
The abductive natural language inference task ($alpha$NLI) is proposed to evaluate the abductive reasoning ability of a learning system.
A novel $L2R2$ approach is proposed under the learning-to-rank framework.
Experiments on the ART dataset reach the state-of-the-art in the public leaderboard.
arXiv Detail & Related papers (2020-05-22T15:01:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.