From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Images

• URL: http://arxiv.org/abs/2507.02781v1
• Date: Thu, 03 Jul 2025 16:43:56 GMT
• Title: From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Images
• Authors: Danrong Zhang, Huili Huang, N. Simrill Smith, Nimisha Roy, J. David Frost,
• Abstract summary: Social media images have become a crucial resource for disaster reconnaissance, providing insights into the extent of damage.<n>Traditional approaches to damage severity assessment in post-earthquake social media images often rely on classification methods.<n>This study proposes a novel approach by framing damage severity assessment as a semantic segmentation problem.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In the aftermath of earthquakes, social media images have become a crucial resource for disaster reconnaissance, providing immediate insights into the extent of damage. Traditional approaches to damage severity assessment in post-earthquake social media images often rely on classification methods, which are inherently subjective and incapable of accounting for the varying extents of damage within an image. Addressing these limitations, this study proposes a novel approach by framing damage severity assessment as a semantic segmentation problem, aiming for a more objective analysis of damage in earthquake-affected areas. The methodology involves the construction of a segmented damage severity dataset, categorizing damage into three degrees: undamaged structures, damaged structures, and debris. Utilizing this dataset, the study fine-tunes a SegFormer model to generate damage severity segmentations for post-earthquake social media images. Furthermore, a new damage severity scoring system is introduced, quantifying damage by considering the varying degrees of damage across different areas within images, adjusted for depth estimation. The application of this approach allows for the quantification of damage severity in social media images in a more objective and comprehensive manner. By providing a nuanced understanding of damage, this study enhances the ability to offer precise guidance to disaster reconnaissance teams, facilitating more effective and targeted response efforts in the aftermath of earthquakes.

Related papers

• Multi-Label Classification Framework for Hurricane Damage Assessment [1.8434042562191815]
  This paper introduces a novel multi-label classification framework for assessing damage using aerial imagery.<n>The proposed approach integrates a feature extraction module based on ResNet and a class-specific attention mechanism to identify multiple damage types within a single image.<n>Using the Rescuenet dataset from Hurricane Michael, the proposed method achieves a mean average precision of 90.23%, outperforming existing baseline methods.
  arXiv  Detail & Related papers  (2025-07-03T03:15:23Z)
• DamageCAT: A Deep Learning Transformer Framework for Typology-Based Post-Disaster Building Damage Categorization [1.9835707645687721]
  This paper introduces DamageCAT, a novel framework that provides categorical categorical damage descriptions.<n>TypoSAT dataset contains satellite image triplets (pre-disaster, post-disaster, and damage masks) from Hurricane Ida.<n> hierarchical U-Net-based transformer architecture effectively processes pre-post disaster image pairs to identify and categorize building damage.
  arXiv  Detail & Related papers  (2025-04-15T21:53:59Z)
• Multiclass Post-Earthquake Building Assessment Integrating High-Resolution Optical and SAR Satellite Imagery, Ground Motion, and Soil Data with Transformers [0.0]
  We introduce a framework that combines high-resolution post-earthquake satellite imagery with building-specific metadata relevant to the seismic performance of the structure.<n>Our model achieves state-of-the-art performance in multiclass post-earthquake damage identification for buildings from the Turkey-Syria earthquake on February 6, 2023.
  arXiv  Detail & Related papers  (2024-12-05T23:19:51Z)
• CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics [49.2719253711215]
  This study introduces a novel approach to disaster text classification by enhancing a pre-trained Large Language Model (LLM)<n>Our methodology involves creating a comprehensive instruction dataset from disaster-related tweets, which is then used to fine-tune an open-source LLM.<n>This fine-tuned model can classify multiple aspects of disaster-related information simultaneously, such as the type of event, informativeness, and involvement of human aid.
  arXiv  Detail & Related papers  (2024-06-16T23:01:10Z)
• A hierarchical semantic segmentation framework for computer vision-based bridge damage detection [3.8999448636733516]
  Computer vision-based damage detection using remote cameras and unmanned aerial vehicles (UAVs) enables efficient and low-cost bridge health monitoring.<n>This paper introduces a semantic segmentation framework that imposes the hierarchical semantic relationship between component category and damage types.<n>In this way, the damage detection model could focus on learning features from possible damaged regions only and avoid the effects of other irrelevant regions.
  arXiv  Detail & Related papers  (2022-07-18T18:42:54Z)
• Detecting Damage Building Using Real-time Crowdsourced Images and Transfer Learning [53.26496452886417]
  This paper presents an automated way to extract the damaged building images after earthquakes from social media platforms such as Twitter. Using transfer learning and 6500 manually labelled images, we trained a deep learning model to recognize images with damaged buildings in the scene. The trained model achieved good performance when tested on newly acquired images of earthquakes at different locations and ran in near real-time on Twitter feed after the 2020 M7.0 earthquake in Turkey.
  arXiv  Detail & Related papers  (2021-10-12T06:31:54Z)
• Attention Based Semantic Segmentation on UAV Dataset for Natural Disaster Damage Assessment [0.7614628596146599]
  We implement a novel self-attention based semantic segmentation model on a high resolution UAV dataset. The result inspires to use self-attention schemes in natural disaster damage assessment which will save human lives and reduce economic losses.
  arXiv  Detail & Related papers  (2021-05-30T13:39:03Z)
• Deep Image Destruction: A Comprehensive Study on Vulnerability of Deep Image-to-Image Models against Adversarial Attacks [104.8737334237993]
  We present comprehensive investigations into the vulnerability of deep image-to-image models to adversarial attacks. For five popular image-to-image tasks, 16 deep models are analyzed from various standpoints. We show that unlike in image classification tasks, the performance degradation on image-to-image tasks can largely differ depending on various factors.
  arXiv  Detail & Related papers  (2021-04-30T14:20:33Z)
• Assessing out-of-domain generalization for robust building damage detection [78.6363825307044]
  Building damage detection can be automated by applying computer vision techniques to satellite imagery. Models must be robust to a shift in distribution between disaster imagery available for training and the images of the new event. We argue that future work should focus on the OOD regime instead.
  arXiv  Detail & Related papers  (2020-11-20T10:30:43Z)
• Understanding and Diagnosing Vulnerability under Adversarial Attacks [62.661498155101654]
  Deep Neural Networks (DNNs) are known to be vulnerable to adversarial attacks. We propose a novel interpretability method, InterpretGAN, to generate explanations for features used for classification in latent variables. We also design the first diagnostic method to quantify the vulnerability contributed by each layer.
  arXiv  Detail & Related papers  (2020-07-17T01:56:28Z)
• RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery [83.49145695899388]
  RescueNet is a unified model that can simultaneously segment buildings and assess the damage levels to individual buildings and can be trained end-to-end. RescueNet is tested on the large scale and diverse xBD dataset and achieves significantly better building segmentation and damage classification performance than previous methods.
  arXiv  Detail & Related papers  (2020-04-15T19:52:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.