Rapid Damage Assessment Using Social Media Images by Combining Human and Machine Intelligence

• URL: http://arxiv.org/abs/2004.06675v1
• Date: Tue, 14 Apr 2020 17:26:36 GMT
• Title: Rapid Damage Assessment Using Social Media Images by Combining Human and Machine Intelligence
• Authors: Muhammad Imran, Firoj Alam, Umair Qazi, Steve Peterson and Ferda Ofli
• Abstract summary: This work analyzes the usefulness of social media imagery content to perform rapid damage assessment during a real-world disaster. An automatic image processing system processed 280K images to understand the extent of damage caused by the disaster.
• Score: 5.610924570214424
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Rapid damage assessment is one of the core tasks that response organizations perform at the onset of a disaster to understand the scale of damage to infrastructures such as roads, bridges, and buildings. This work analyzes the usefulness of social media imagery content to perform rapid damage assessment during a real-world disaster. An automatic image processing system, which was activated in collaboration with a volunteer response organization, processed ~280K images to understand the extent of damage caused by the disaster. The system achieved an accuracy of 76% computed based on the feedback received from the domain experts who analyzed ~29K system-processed images during the disaster. An extensive error analysis reveals several insights and challenges faced by the system, which are vital for the research community to advance this line of research.

Related papers

• Deploying Rapid Damage Assessments from sUAS Imagery for Disaster Response [3.441021278275805]
  This paper presents the first AI/ML system for automating building damage assessment in uncrewed aerial systems (sUAS) imagery to be deployed operationally during federally declared disasters (Hurricanes Debby and Helene)<n>In response to major disasters, sUAS teams are dispatched to collect imagery of the affected areas to assess damage.<n>At recent disasters, teams collectively delivered between 47GB and 369GB of imagery per day, representing more imagery than can reasonably be transmitted or interpreted by subject matter experts in the disaster scene.<n>To alleviate this data avalanche encountered in practice, computer vision and machine learning techniques are
  arXiv  Detail & Related papers  (2025-11-05T02:49:15Z)
• From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Images [0.0]
  Social media images have become a crucial resource for disaster reconnaissance, providing insights into the extent of damage.<n>Traditional approaches to damage severity assessment in post-earthquake social media images often rely on classification methods.<n>This study proposes a novel approach by framing damage severity assessment as a semantic segmentation problem.
  arXiv  Detail & Related papers  (2025-07-03T16:43:56Z)
• Addressing Camera Sensors Faults in Vision-Based Navigation: Simulation and Dataset Development [41.94295877935867]
  This study focuses on an interplanetary exploration mission scenario.<n>A comprehensive analysis of potential fault cases in camera sensors used within the VBN pipeline is presented.<n>A simulation framework is introduced to recreate faulty conditions in synthetically generated images, enabling a systematic and controlled reproduction of faulty data.<n>The resulting dataset of fault-injected images provides a valuable tool for training and testing AI-based fault detection algorithms.
  arXiv  Detail & Related papers  (2025-07-03T13:23:22Z)
• BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response [50.76124284445902]
  Building damage assessment (BDA) is an essential capability in the aftermath of a disaster to reduce human casualties.<n>Recent research focuses on the development of AI models to achieve accurate mapping of unseen disaster events.<n>We present a BDA dataset using veRy-hIGH-resoluTion optical and SAR imagery (BRIGHT) to support AI-based all-weather disaster response.
  arXiv  Detail & Related papers  (2025-01-10T14:57:18Z)
• Accelerating Post-Tornado Disaster Assessment Using Advanced Deep Learning Models [0.0]
  This research introduces an innovative approach to automating post-disaster assessments through advanced deep learning models. Our proposed system employs state-of-the-art computer vision techniques to rapidly analyze images and videos from disaster sites. Our experimental results show promising performance, with ResNet50 achieving 90.28% accuracy and an inference time of 1529ms per image on multiclass damage classification.
  arXiv  Detail & Related papers  (2024-12-24T04:04:33Z)
• Towards More Robust Retrieval-Augmented Generation: Evaluating RAG Under Adversarial Poisoning Attacks [45.07581174558107]
  Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to mitigate hallucinations. RAG systems are vulnerable to adversarial poisoning attacks, where malicious passages injected into retrieval databases can mislead the model into generating factually incorrect outputs. This paper investigates both the retrieval and the generation components of RAG systems to understand how to enhance their robustness against such attacks.
  arXiv  Detail & Related papers  (2024-12-21T17:31:52Z)
• AutoRG-Brain: Grounded Report Generation for Brain MRI [57.22149878985624]
  Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment delays, increased healthcare costs, revenue loss, and operational inefficiencies. We initiate a series of work on grounded Automatic Report Generation (AutoRG) This system supports the delineation of brain structures, the localization of anomalies, and the generation of well-organized findings.
  arXiv  Detail & Related papers  (2024-07-23T17:50:00Z)
• CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics [49.2719253711215]
  This study introduces a novel approach to disaster text classification by enhancing a pre-trained Large Language Model (LLM) Our methodology involves creating a comprehensive instruction dataset from disaster-related tweets, which is then used to fine-tune an open-source LLM. This fine-tuned model can classify multiple aspects of disaster-related information simultaneously, such as the type of event, informativeness, and involvement of human aid.
  arXiv  Detail & Related papers  (2024-06-16T23:01:10Z)
• PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation [50.556961575275345]
  We propose a perception-aware fusion framework to promote segmentation robustness in adversarial scenes. We show that our scheme substantially enhances the robustness, with gains of 15.3% mIOU, compared with advanced competitors.
  arXiv  Detail & Related papers  (2023-08-08T01:55:44Z)
• Physical Adversarial Attack meets Computer Vision: A Decade Survey [55.38113802311365]
  This paper presents a comprehensive overview of physical adversarial attacks. We take the first step to systematically evaluate the performance of physical adversarial attacks. Our proposed evaluation metric, hiPAA, comprises six perspectives.
  arXiv  Detail & Related papers  (2022-09-30T01:59:53Z)
• Adversarially-Aware Robust Object Detector [85.10894272034135]
  We propose a Robust Detector (RobustDet) based on adversarially-aware convolution to disentangle gradients for model learning on clean and adversarial images. Our model effectively disentangles gradients and significantly enhances the detection robustness with maintaining the detection ability on clean images.
  arXiv  Detail & Related papers  (2022-07-13T13:59:59Z)
• Deep-Disaster: Unsupervised Disaster Detection and Localization Using Visual Data [14.308913482163558]
  We propose an unsupervised deep neural network to detect and localize damages in social media images. Our approach outperforms state-of-the-art methods in detecting and localizing the damaged areas.
  arXiv  Detail & Related papers  (2022-01-31T19:21:44Z)
• Disaster mapping from satellites: damage detection with crowdsourced point labels [4.511561231517167]
  High-resolution satellite imagery available immediately after disaster events is crucial for response planning. Damage mapping at this scale would require hundreds of expert person-hours. Crowdsourcing and recent advances in deep learning reduces the effort needed to just a few hours in real time.
  arXiv  Detail & Related papers  (2021-11-05T18:32:22Z)
• Fully convolutional Siamese neural networks for buildings damage assessment from satellite images [1.90365714903665]
  Damage assessment after natural disasters is needed to distribute aid and forces to recovery from damage dealt optimally. We develop a computational approach for an automated comparison of the same region's satellite images before and after the disaster. We include an extensive ablation study and compare different encoders, decoders, loss functions, augmentations, and several methods to combine two images.
  arXiv  Detail & Related papers  (2021-10-31T14:18:59Z)
• Detecting Damage Building Using Real-time Crowdsourced Images and Transfer Learning [53.26496452886417]
  This paper presents an automated way to extract the damaged building images after earthquakes from social media platforms such as Twitter. Using transfer learning and 6500 manually labelled images, we trained a deep learning model to recognize images with damaged buildings in the scene. The trained model achieved good performance when tested on newly acquired images of earthquakes at different locations and ran in near real-time on Twitter feed after the 2020 M7.0 earthquake in Turkey.
  arXiv  Detail & Related papers  (2021-10-12T06:31:54Z)
• Social Media Images Classification Models for Real-time Disaster Response [5.937482215664902]
  Images shared on social media help crisis managers in terms of gaining situational awareness and assessing incurred damages. Real-time image classification became an urgent need in order to take a faster response. Recent advances in computer vision and deep neural networks have enabled the development of models for real-time image classification.
  arXiv  Detail & Related papers  (2021-04-09T04:30:04Z)
• RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery [83.49145695899388]
  RescueNet is a unified model that can simultaneously segment buildings and assess the damage levels to individual buildings and can be trained end-to-end. RescueNet is tested on the large scale and diverse xBD dataset and achieves significantly better building segmentation and damage classification performance than previous methods.
  arXiv  Detail & Related papers  (2020-04-15T19:52:09Z)
• An Attention-Based System for Damage Assessment Using Satellite Imagery [18.43310705820528]
  We present Siam-U-Net-Attn model - a multi-class deep learning model with an attention mechanism - to assess damage levels of buildings. We evaluate the proposed method on xView2, a large-scale building damage assessment dataset, and demonstrate that the proposed approach achieves accurate damage scale classification and building segmentation results simultaneously.
  arXiv  Detail & Related papers  (2020-04-14T16:37:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.