An Empirical Methodology for Detecting and Prioritizing Needs during Crisis Events

• URL: http://arxiv.org/abs/2006.01439v1
• Date: Tue, 2 Jun 2020 08:02:29 GMT
• Title: An Empirical Methodology for Detecting and Prioritizing Needs during Crisis Events
• Authors: M. Janina Sarol, Ly Dinh, Rezvaneh Rezapour, Chieh-Li Chin, Pingjing Yang, Jana Diesner
• Abstract summary: Social media platforms such as Twitter contain vast amount of information about the general public's needs. In this study, we propose two novel methods for two distinct but related needs detection tasks. We evaluated our methods on a set of tweets about the COVID-19 crisis.
• Score: 2.0605537665985687
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In times of crisis, identifying the essential needs is a crucial step to providing appropriate resources and services to affected entities. Social media platforms such as Twitter contain vast amount of information about the general public's needs. However, the sparsity of the information as well as the amount of noisy content present a challenge to practitioners to effectively identify shared information on these platforms. In this study, we propose two novel methods for two distinct but related needs detection tasks: the identification of 1) a list of resources needed ranked by priority, and 2) sentences that specify who-needs-what resources. We evaluated our methods on a set of tweets about the COVID-19 crisis. For task 1 (detecting top needs), we compared our results against two given lists of resources and achieved 64% precision. For task 2 (detecting who-needs-what), we compared our results on a set of 1,000 annotated tweets and achieved a 68% F1-score.

Related papers

• Collaborative Knowledge Infusion for Low-resource Stance Detection [83.88515573352795]
  Target-related knowledge is often needed to assist stance detection models. We propose a collaborative knowledge infusion approach for low-resource stance detection tasks.
  arXiv  Detail & Related papers  (2024-03-28T08:32:14Z)
• Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models [73.79091519226026]
  Uncertainty of Thoughts (UoT) is an algorithm to augment large language models with the ability to actively seek information by asking effective questions. In experiments on medical diagnosis, troubleshooting, and the 20 Questions game, UoT achieves an average performance improvement of 38.1% in the rate of successful task completion.
  arXiv  Detail & Related papers  (2024-02-05T18:28:44Z)
• Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Survey [23.854086903936647]
  We provide a structured overview of mainstream techniques for low-resource DR. We divide the techniques into three main categories: (1) only documents are needed; (2) documents and questions are needed; and (3) documents and question-answer pairs are needed. For every technique, we introduce its general-form algorithm, highlight the open issues and pros and cons. Promising directions are outlined for future research.
  arXiv  Detail & Related papers  (2022-08-05T14:35:03Z)
• Algorithmic Fairness Datasets: the Story so Far [68.45921483094705]
  Data-driven algorithms are studied in diverse domains to support critical decisions, directly impacting people's well-being. A growing community of researchers has been investigating the equity of existing algorithms and proposing novel ones, advancing the understanding of risks and opportunities of automated decision-making for historically disadvantaged populations. Progress in fair Machine Learning hinges on data, which can be appropriately used only if adequately documented. Unfortunately, the algorithmic fairness community suffers from a collective data documentation debt caused by a lack of information on specific resources (opacity) and scatteredness of available information (sparsity)
  arXiv  Detail & Related papers  (2022-02-03T17:25:46Z)
• Active Multi-Task Representation Learning [50.13453053304159]
  We give the first formal study on resource task sampling by leveraging the techniques from active learning. We propose an algorithm that iteratively estimates the relevance of each source task to the target task and samples from each source task based on the estimated relevance.
  arXiv  Detail & Related papers  (2022-02-02T08:23:24Z)
• UCD-CS at TREC 2021 Incident Streams Track [3.4392739159262145]
  The TREC Incident Streams (IS) track is a research challenge organised for this purpose. The track asks participating systems to both classify a stream of crisis-related tweets into humanitarian aid related information types. We report on the participation of the University College Dublin School of Computer Science (UCD-CS) in TREC-IS 2021.
  arXiv  Detail & Related papers  (2021-12-07T14:47:27Z)
• Exposing Query Identification for Search Transparency [69.06545074617685]
  We explore the feasibility of approximate exposing query identification (EQI) as a retrieval task by reversing the role of queries and documents in two classes of search systems. We derive an evaluation metric to measure the quality of a ranking of exposing queries, as well as conducting an empirical analysis focusing on various practical aspects of approximate EQI.
  arXiv  Detail & Related papers  (2021-10-14T20:19:27Z)
• Wizard of Search Engine: Access to Information Through Conversations with Search Engines [58.53420685514819]
  We make efforts to facilitate research on CIS from three aspects. We formulate a pipeline for CIS with six sub-tasks: intent detection (ID), keyphrase extraction (KE), action prediction (AP), query selection (QS), passage selection (PS) and response generation (RG) We release a benchmark dataset, called wizard of search engine (WISE), which allows for comprehensive and in-depth research on all aspects of CIS.
  arXiv  Detail & Related papers  (2021-05-18T06:35:36Z)
• Multi-task transfer learning for finding actionable information from crisis-related messages on social media [3.4392739159262145]
  The Incident streams (IS) track is a research challenge aimed at finding important information from social media during crises for emergency response purposes. Given a stream of crisis-related tweets, the IS challenge asks a participating system to classify what the types of users' concerns or needs are expressed in each tweet. We describe our multi-task transfer learning approach for this challenge.
  arXiv  Detail & Related papers  (2021-02-26T11:11:33Z)
• I-AID: Identifying Actionable Information from Disaster-related Tweets [0.0]
  Social media plays a significant role in disaster management by providing valuable data about affected people, donations and help requests. We propose I-AID, a multimodel approach to automatically categorize tweets into multi-label information types. Our results indicate that I-AID outperforms state-of-the-art approaches in terms of weighted average F1 score by +6% and +4% on the TREC-IS dataset and COVID-19 Tweets, respectively.
  arXiv  Detail & Related papers  (2020-08-04T19:07:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.