Introducing the ICBe Dataset: Very High Recall and Precision Event
Extraction from Narratives about International Crises
- URL: http://arxiv.org/abs/2202.07081v1
- Date: Mon, 14 Feb 2022 23:03:52 GMT
- Title: Introducing the ICBe Dataset: Very High Recall and Precision Event
Extraction from Narratives about International Crises
- Authors: Rex W. Douglass, Thomas Leo Scherer, J. Andr\'es Gannon, Erik Gartzke,
Jon Lindsay, Shannon Carcelli, Jonathan Wilkenfeld, David M. Quinn, Catherine
Aiken, Jose Miguel Cabezas Navarro, Neil Lund, Egle Murauskaite, Diana
Partridge
- Abstract summary: We conceive of international affairs as a strategic chess game between adversaries, requiring a systematic way to measure pieces, moves, and gambits.
We develop such a measurement strategy with an ontology of crisis actions and interactions and apply it to a high-quality corpus of crisis narratives recorded by the International Crisis Behavior (ICB) Project.
We introduce a new crisis event dataset ICB Events (ICBe). We find that ICBe captures the process of a crisis with greater accuracy and granularity than other well-regarded events or crisis datasets.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: How do international crises unfold? We conceive of international affairs as a
strategic chess game between adversaries, necessitating a systematic way to
measure pieces, moves, and gambits accurately and consistently over different
contexts and periods. We develop such a measurement strategy with an ontology
of crisis actions and interactions and apply it to a high-quality corpus of
crisis narratives recorded by the International Crisis Behavior (ICB) Project.
We demonstrate that the ontology has high coverage over most of the thoughts,
speech, and actions contained in these narratives and produces high inter-coder
agreement when applied by human coders. We introduce a new crisis event dataset
ICB Events (ICBe). We find that ICBe captures the process of a crisis with
greater accuracy and granularity than other well-regarded events or crisis
datasets. We make the data, replication material, and additional visualizations
available at a companion website www.crisisevents.org.
Related papers
- Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Play [69.57968387772428]
Complex news events, such as natural disasters and socio-political conflicts, require swift responses from the government and society.
We develop a controllable complex news event simulator guided by both the event schema representing domain knowledge.
We introduce a geo-diverse commonsense and cultural norm-aware knowledge enhancement component.
arXiv Detail & Related papers (2024-10-24T17:21:43Z) - Temporal Relational Reasoning of Large Language Models for Detecting Stock Portfolio Crashes [46.259921167692895]
We propose an algorithmic framework named Temporal Reasoning (TRR)
TRR seeks to emulate the spectrum of human cognitive capabilities used for complex problem-solving.
We show that TRR is able to outperform state-of-the-art solutions on detecting stock portfolio crashes.
arXiv Detail & Related papers (2024-10-07T11:15:52Z) - Crisis Communication in the Face of Data Breaches [0.19116784879310028]
This paper examines data breach crisis communication strategies and their practical executions.
The paper contributes to the research domain by focusing specifically on data breach crises, their peculiarities, and their management.
arXiv Detail & Related papers (2024-06-03T19:21:04Z) - CrisisKAN: Knowledge-infused and Explainable Multimodal Attention
Network for Crisis Event Classification [25.93602006155562]
CrisisKAN is a Knowledge-infused and Explainable Multimodal Attention Network that entails images and texts in conjunction with external knowledge from Wikipedia to classify crisis events.
To enrich the context-specific understanding of textual information, we integrated Wikipedia knowledge using proposed wiki extraction algorithm.
In order to ensure reliability, we employ a model-specific approach calledGrad-CAM that provides a robust explanation of the predictions of the proposed model.
arXiv Detail & Related papers (2024-01-11T13:22:38Z) - CrisisMatch: Semi-Supervised Few-Shot Learning for Fine-Grained Disaster
Tweet Classification [51.58605842457186]
We present a fine-grained disaster tweet classification model under the semi-supervised, few-shot learning setting.
Our model, CrisisMatch, effectively classifies tweets into fine-grained classes of interest using few labeled data and large amounts of unlabeled data.
arXiv Detail & Related papers (2023-10-23T07:01:09Z) - DeCrisisMB: Debiased Semi-Supervised Learning for Crisis Tweet
Classification via Memory Bank [52.20298962359658]
In crisis events, people often use social media platforms such as Twitter to disseminate information about the situation, warnings, advice, and support.
fully-supervised approaches require annotating vast amounts of data and are impractical due to limited response time.
Semi-supervised models can be biased, performing moderately well for certain classes while performing extremely poorly for others.
We propose a simple but effective debiasing method, DeCrisisMB, that utilizes a Memory Bank to store and perform equal sampling for generated pseudo-labels from each class at each training.
arXiv Detail & Related papers (2023-10-23T05:25:51Z) - CrisisTransformers: Pre-trained language models and sentence encoders for crisis-related social media texts [3.690904966341072]
Social media platforms play an essential role in crisis communication, but analyzing crisis-related social media texts is challenging due to their informal nature.
This study introduces CrisisTransformers, an ensemble of pre-trained language models and sentence encoders trained on an extensive corpus of over 15 billion word tokens from tweets.
arXiv Detail & Related papers (2023-09-11T14:36:16Z) - CrisisLTLSum: A Benchmark for Local Crisis Event Timeline Extraction and
Summarization [62.77066949111921]
This paper presents CrisisLTLSum, the largest dataset of local crisis event timelines available to date.
CrisisLTLSum contains 1,000 crisis event timelines across four domains: wildfires, local fires, traffic, and storms.
Our initial experiments indicate a significant gap between the performance of strong baselines compared to the human performance on both tasks.
arXiv Detail & Related papers (2022-10-25T17:32:40Z) - Cross-Lingual and Cross-Domain Crisis Classification for Low-Resource
Scenarios [4.147346416230273]
We study the task of automatically classifying messages related to crisis events by leveraging cross-language and cross-domain labeled data.
Our goal is to make use of labeled data from high-resource languages to classify messages from other (low-resource) languages and/or of new (previously unseen) types of crisis situations.
Our empirical findings show that it is indeed possible to leverage data from crisis events in English to classify the same type of event in other languages, such as Spanish and Italian.
arXiv Detail & Related papers (2022-09-05T20:57:23Z) - Event-Related Bias Removal for Real-time Disaster Events [67.2965372987723]
Social media has become an important tool to share information about crisis events such as natural disasters and mass attacks.
Detecting actionable posts that contain useful information requires rapid analysis of huge volume of data in real-time.
We train an adversarial neural model to remove latent event-specific biases and improve the performance on tweet importance classification.
arXiv Detail & Related papers (2020-11-02T02:03:07Z) - CrisisBERT: a Robust Transformer for Crisis Classification and
Contextual Crisis Embedding [2.7718973516070684]
We propose an end-to-end transformer-based model for two crisis classification tasks, namely crisis detection and crisis recognition.
We also proposed Crisis2Vec, an attention-based, document-level contextual embedding architecture for crisis embedding.
arXiv Detail & Related papers (2020-05-11T09:57:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.