Deep Learning Benchmarks and Datasets for Social Media Image Classification for Disaster Response

• URL: http://arxiv.org/abs/2011.08916v1
• Date: Tue, 17 Nov 2020 20:15:49 GMT
• Title: Deep Learning Benchmarks and Datasets for Social Media Image Classification for Disaster Response
• Authors: Firoj Alam, Ferda Ofli, Muhammad Imran, Tanvirul Alam and Umair Qazi
• Abstract summary: We propose new datasets for disaster type detection, informativeness classification, and damage severity assessment. We benchmark several state-of-the-art deep learning models and achieve promising results. We release our datasets and models publicly, aiming to provide proper baselines as well as to spur further research in the crisis informatics community.
• Score: 5.610924570214424
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: During a disaster event, images shared on social media helps crisis managers gain situational awareness and assess incurred damages, among other response tasks. Recent advances in computer vision and deep neural networks have enabled the development of models for real-time image classification for a number of tasks, including detecting crisis incidents, filtering irrelevant images, classifying images into specific humanitarian categories, and assessing the severity of damage. Despite several efforts, past works mainly suffer from limited resources (i.e., labeled images) available to train more robust deep learning models. In this study, we propose new datasets for disaster type detection, and informativeness classification, and damage severity assessment. Moreover, we relabel existing publicly available datasets for new tasks. We identify exact- and near-duplicates to form non-overlapping data splits, and finally consolidate them to create larger datasets. In our extensive experiments, we benchmark several state-of-the-art deep learning models and achieve promising results. We release our datasets and models publicly, aiming to provide proper baselines as well as to spur further research in the crisis informatics community.

Related papers

• Visual Context-Aware Person Fall Detection [52.49277799455569]
  We present a segmentation pipeline to semi-automatically separate individuals and objects in images. Background objects such as beds, chairs, or wheelchairs can challenge fall detection systems, leading to false positive alarms. We demonstrate that object-specific contextual transformations during training effectively mitigate this challenge.
  arXiv  Detail & Related papers  (2024-04-11T19:06:36Z)
• CrisisMatch: Semi-Supervised Few-Shot Learning for Fine-Grained Disaster Tweet Classification [51.58605842457186]
  We present a fine-grained disaster tweet classification model under the semi-supervised, few-shot learning setting. Our model, CrisisMatch, effectively classifies tweets into fine-grained classes of interest using few labeled data and large amounts of unlabeled data.
  arXiv  Detail & Related papers  (2023-10-23T07:01:09Z)
• Harnessing the Power of Text-image Contrastive Models for Automatic Detection of Online Misinformation [50.46219766161111]
  We develop a self-learning model to explore the constrastive learning in the domain of misinformation identification. Our model shows the superior performance of non-matched image-text pair detection when the training data is insufficient.
  arXiv  Detail & Related papers  (2023-04-19T02:53:59Z)
• Image Data Augmentation for Deep Learning: A Survey [8.817690876855728]
  We systematically review different image data augmentation methods. We propose a taxonomy of reviewed methods and present the strengths and limitations of these methods. We also conduct extensive experiments with various data augmentation methods on three typical computer vision tasks.
  arXiv  Detail & Related papers  (2022-04-19T02:05:56Z)
• Interpretability in Convolutional Neural Networks for Building Damage Classification in Satellite Imagery [0.0]
  We use a dataset that includes labeled pre- and post-disaster satellite imagery to assess building damage on a per-building basis. We train multiple convolutional neural networks (CNNs) to assess building damage on a per-building basis. Our research seeks to computationally contribute to aiding in this ongoing and growing humanitarian crisis, heightened by anthropogenic climate change.
  arXiv  Detail & Related papers  (2022-01-24T16:55:56Z)
• MEDIC: A Multi-Task Learning Dataset for Disaster Image Classification [6.167082944123002]
  We propose MEDIC, the largest social media image classification dataset for humanitarian response. MEDIC consists of 71,198 images to address four different tasks in a multi-task learning setup. This is the first dataset of its kind: social media image, disaster response, and multi-task learning research.
  arXiv  Detail & Related papers  (2021-08-29T11:55:50Z)
• Social Media Images Classification Models for Real-time Disaster Response [5.937482215664902]
  Images shared on social media help crisis managers in terms of gaining situational awareness and assessing incurred damages. Real-time image classification became an urgent need in order to take a faster response. Recent advances in computer vision and deep neural networks have enabled the development of models for real-time image classification.
  arXiv  Detail & Related papers  (2021-04-09T04:30:04Z)
• Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profiles [69.9674326582747]
  This paper presents a visual framework to investigate neural network models subjected to adversarial examples. We show how observing these elements can quickly pinpoint exploited areas in a model.
  arXiv  Detail & Related papers  (2021-03-18T13:04:21Z)
• Event-Related Bias Removal for Real-time Disaster Events [67.2965372987723]
  Social media has become an important tool to share information about crisis events such as natural disasters and mass attacks. Detecting actionable posts that contain useful information requires rapid analysis of huge volume of data in real-time. We train an adversarial neural model to remove latent event-specific biases and improve the performance on tweet importance classification.
  arXiv  Detail & Related papers  (2020-11-02T02:03:07Z)
• Neural Networks Are More Productive Teachers Than Human Raters: Active Mixup for Data-Efficient Knowledge Distillation from a Blackbox Model [57.41841346459995]
  We study how to train a student deep neural network for visual recognition by distilling knowledge from a blackbox teacher model in a data-efficient manner. We propose an approach that blends mixup and active learning.
  arXiv  Detail & Related papers  (2020-03-31T05:44:55Z)
• Unsupervised and Interpretable Domain Adaptation to Rapidly Filter Tweets for Emergency Services [18.57009530004948]
  We present a novel method to classify relevant tweets during an ongoing crisis using the publicly available dataset of TREC incident streams. We use dedicated attention layers for each task to provide model interpretability; critical for real-word applications. We show a practical implication of our work by providing a use-case for the COVID-19 pandemic.
  arXiv  Detail & Related papers  (2020-03-04T06:40:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.