Enhancing Trustworthiness and Minimising Bias Issues in Leveraging Social Media Data for Disaster Management Response
- URL: http://arxiv.org/abs/2409.00004v1
- Date: Thu, 15 Aug 2024 10:59:20 GMT
- Title: Enhancing Trustworthiness and Minimising Bias Issues in Leveraging Social Media Data for Disaster Management Response
- Authors: Samia Abid, Bhupesh Kumar Mishra, Dhavalkumar Thakker, Nishikant Mishra,
- Abstract summary: Leveraging real-time data can significantly deal with data uncertainty and enhance disaster response efforts.
Social media appeared as an effective source of real-time data as there has been extensive use of social media during and after the disasters.
It also brings forth challenges regarding trustworthiness and bias in these data.
We aim to investigate and identify the factors that can be used to enhance trustworthiness and minimize bias.
- Score: 0.1499944454332829
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Disaster events often unfold rapidly, necessitating a swift and effective response. Developing action plans, resource allocation, and resolution of help requests in disaster scenarios is time-consuming and complex since disaster-relevant information is often uncertain. Leveraging real-time data can significantly deal with data uncertainty and enhance disaster response efforts. To deal with real-time data uncertainty, social media appeared as an alternative effective source of real-time data as there has been extensive use of social media during and after the disasters. However, it also brings forth challenges regarding trustworthiness and bias in these data. To fully leverage social media data for disaster management, it becomes crucial to mitigate biases that may arise due to specific disaster types or regional contexts. Additionally, the presence of misinformation within social media data raises concerns about the reliability of data sources, potentially impeding actionable insights and leading to improper resource utilization. To overcome these challenges, our research aimed to investigate how to ensure trustworthiness and address biases in social media data. We aim to investigate and identify the factors that can be used to enhance trustworthiness and minimize bias to make an efficient and scalable disaster management system utilizing real-time social media posts, identify disaster-related keywords, and assess the severity of the disaster. By doing so, the integration of real-time social data can improve the speed and accuracy of disaster management systems
Related papers
- MisinfoEval: Generative AI in the Era of "Alternative Facts" [50.069577397751175]
We introduce a framework for generating and evaluating large language model (LLM) based misinformation interventions.
We present (1) an experiment with a simulated social media environment to measure effectiveness of misinformation interventions, and (2) a second experiment with personalized explanations tailored to the demographics and beliefs of users.
Our findings confirm that LLM-based interventions are highly effective at correcting user behavior.
arXiv Detail & Related papers (2024-10-13T18:16:50Z) - CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics [49.2719253711215]
This study introduces a novel approach to disaster text classification by enhancing a pre-trained Large Language Model (LLM)
Our methodology involves creating a comprehensive instruction dataset from disaster-related tweets, which is then used to fine-tune an open-source LLM.
This fine-tuned model can classify multiple aspects of disaster-related information simultaneously, such as the type of event, informativeness, and involvement of human aid.
arXiv Detail & Related papers (2024-06-16T23:01:10Z) - Near-real-time Earthquake-induced Fatality Estimation using Crowdsourced
Data and Large-Language Models [5.031939163610801]
We introduce an end-to-end framework to significantly improve the timeliness and accuracy of global earthquake-induced loss forecasting.
Our framework integrates a hierarchical casualty extraction model built upon large language models, prompt design, and few-shot learning.
We test the framework in real-time on a series of global earthquake events in 2022 and 2022 and show that our framework streamlines casualty data retrieval, achieving speed and accuracy comparable to manual methods by 2021.
arXiv Detail & Related papers (2023-12-04T17:09:58Z) - CrisisMatch: Semi-Supervised Few-Shot Learning for Fine-Grained Disaster
Tweet Classification [51.58605842457186]
We present a fine-grained disaster tweet classification model under the semi-supervised, few-shot learning setting.
Our model, CrisisMatch, effectively classifies tweets into fine-grained classes of interest using few labeled data and large amounts of unlabeled data.
arXiv Detail & Related papers (2023-10-23T07:01:09Z) - DeCrisisMB: Debiased Semi-Supervised Learning for Crisis Tweet
Classification via Memory Bank [52.20298962359658]
In crisis events, people often use social media platforms such as Twitter to disseminate information about the situation, warnings, advice, and support.
fully-supervised approaches require annotating vast amounts of data and are impractical due to limited response time.
Semi-supervised models can be biased, performing moderately well for certain classes while performing extremely poorly for others.
We propose a simple but effective debiasing method, DeCrisisMB, that utilizes a Memory Bank to store and perform equal sampling for generated pseudo-labels from each class at each training.
arXiv Detail & Related papers (2023-10-23T05:25:51Z) - CrisisLTLSum: A Benchmark for Local Crisis Event Timeline Extraction and
Summarization [62.77066949111921]
This paper presents CrisisLTLSum, the largest dataset of local crisis event timelines available to date.
CrisisLTLSum contains 1,000 crisis event timelines across four domains: wildfires, local fires, traffic, and storms.
Our initial experiments indicate a significant gap between the performance of strong baselines compared to the human performance on both tasks.
arXiv Detail & Related papers (2022-10-25T17:32:40Z) - Continual Distributed Learning for Crisis Management [0.0]
Social media platforms such as Twitter provide an excellent resource for mobile communication during emergency events.
Data present in such situations is ever-changing, and resources during such crisis may not be readily available.
A low resource, continually learning system must be developed to incorporate and make NLP models robust against noisy and unordered data.
arXiv Detail & Related papers (2021-04-26T21:01:29Z) - Event-Related Bias Removal for Real-time Disaster Events [67.2965372987723]
Social media has become an important tool to share information about crisis events such as natural disasters and mass attacks.
Detecting actionable posts that contain useful information requires rapid analysis of huge volume of data in real-time.
We train an adversarial neural model to remove latent event-specific biases and improve the performance on tweet importance classification.
arXiv Detail & Related papers (2020-11-02T02:03:07Z) - Improving Community Resiliency and Emergency Response With Artificial
Intelligence [0.05541644538483946]
We are working towards a multipronged emergency response tool that provide stakeholders timely access to comprehensive, relevant, and reliable information.
Our tool consists of encoding multiple layers of open source geospatial data including flood risk location, road network strength, inundation maps that proxy inland flooding and computer vision semantic segmentation for estimating flooded areas and damaged infrastructure.
These data layers are combined and used as input data for machine learning algorithms such as finding the best evacuation routes before, during and after an emergency or providing a list of available lodging for first responders in an impacted area for first.
arXiv Detail & Related papers (2020-05-28T18:05:08Z) - Social Media Information Sharing for Natural Disaster Response [0.0]
Social media has become an essential channel for posting disaster-related information, which provide governments and relief agencies real-time data for better disaster management.
This paper aims to improve disaster relief efficiency via mining and analyzing social media data like public attitudes towards disaster response and public demands for targeted relief supplies during different types of disasters.
arXiv Detail & Related papers (2020-05-08T21:11:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.