Multi-Modal Attention for Automated Disaster Damage Assessment Using Remote Sensing Imagery and Deep Learning

• URL: http://arxiv.org/abs/2606.14963v1
• Date: Fri, 12 Jun 2026 21:11:53 GMT
• Title: Multi-Modal Attention for Automated Disaster Damage Assessment Using Remote Sensing Imagery and Deep Learning
• Abstract summary: This paper introduces a novel framework leveraging remote sensing imagery and deep learning to automate building damage classification.<n>Using pre- and post-disaster satellite imagery, our model categorizes buildings into four damage levels: no damage, minor damage, major damage, and destroyed.<n>We employ a lightweight ConvNeXT-Tiny backbone to ensure efficient processing without compromising performance.
• Score: 0.3186130813218338
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Timely and accurate disaster damage assessment is crucial for effective emergency response, resource allocation, and recovery. Traditional methods, which often rely on manual inspections or sparse data, are typically slow and error-prone. This paper introduces a novel framework leveraging remote sensing imagery and deep learning to automate building damage classification. Using pre- and post-disaster satellite imagery, our model categorizes buildings into four damage levels: no damage, minor damage, major damage, and destroyed. The core innovation is a multi-modal attention mechanism that fuses bi-temporal features to explicitly detect and assess structural changes. We employ a lightweight ConvNeXT-Tiny backbone to ensure efficient processing without compromising performance. Key contributions include: (1) a cross-attention module for multi-modal data fusion, (2) an optimized preprocessing pipeline for large-scale datasets, and (3) robust data augmentation techniques. Experiments on a large-scale disaster dataset demonstrate an overall classification accuracy of 94.90%. The model effectively discriminates between damage categories and remains resilient to incomplete data. This system significantly improves assessment speed and accuracy, aiding emergency responders in prioritizing interventions. This work advances automated disaster damage detection by integrating multi-temporal imagery with deep learning, offering a scalable solution for real-time response.

Related papers

• Satellite to Street : Disaster Impact Estimator [0.12938914787881173]
  The present work proposes a deep-learning framework that jointly processes pre- and post-disaster satellite images to obtain fine-grained pixel-level damage maps: Satellite-to-Street: Disaster Impact Estimator.<n>The model uses a modified dual-input U-Net architecture with enhanced feature fusion to capture both the local structural changes as well as the broader contextual cues.
  arXiv  Detail & Related papers  (2025-11-24T06:20:40Z)
• Multi-step feature fusion for natural disaster damage assessment on satellite images [0.0]
  We introduce a novel convolutional neural network (CNN) module that performs feature fusion at multiple network levels. An additional network element - Fuse Module - was proposed to adapt any CNN model to analyze image pairs. We report over a 3 percentage point increase in the accuracy of the Vision Transformer model.
  arXiv  Detail & Related papers  (2024-10-29T09:47:32Z)
• DeepDamageNet: A two-step deep-learning model for multi-disaster building damage segmentation and classification using satellite imagery [12.869300064524122]
  We present a solution that performs the two most important tasks in building damage assessment, segmentation and classification, through deep-learning models. Our best model couples a building identification semantic segmentation convolutional neural network (CNN) to a building damage classification CNN, with a combined F1 score of 0.66. We find that though our model was able to identify buildings with relatively high accuracy, building damage classification across various disaster types is a difficult task.
  arXiv  Detail & Related papers  (2024-05-08T04:21:03Z)
• FaultGuard: A Generative Approach to Resilient Fault Prediction in Smart Electrical Grids [53.2306792009435]
  FaultGuard is the first framework for fault type and zone classification resilient to adversarial attacks. We propose a low-complexity fault prediction model and an online adversarial training technique to enhance robustness. Our model outclasses the state-of-the-art for resilient fault prediction benchmarking, with an accuracy of up to 0.958.
  arXiv  Detail & Related papers  (2024-03-26T08:51:23Z)
• Classification of structural building damage grades from multi-temporal photogrammetric point clouds using a machine learning model trained on virtual laser scanning data [58.720142291102135]
  We present a novel approach to automatically assess multi-class building damage from real-world point clouds. We use a machine learning model trained on virtual laser scanning (VLS) data. The model yields high multi-target classification accuracies (overall accuracy: 92.0% - 95.1%)
  arXiv  Detail & Related papers  (2023-02-24T12:04:46Z)
• Ranking-Based Physics-Informed Line Failure Detection in Power Grids [66.0797334582536]
  Real-time and accurate detecting of potential line failures is the first step to mitigating the extreme weather impact and activating emergency controls. Power balance equations nonlinearity, increased uncertainty in generation during extreme events, and lack of grid observability compromise the efficiency of traditional data-driven failure detection methods. This paper proposes a Physics-InformEd Line failure Detector (FIELD) that leverages grid topology information to reduce sample and time complexities and improve localization accuracy.
  arXiv  Detail & Related papers  (2022-08-31T18:19:25Z)
• Interpretability in Convolutional Neural Networks for Building Damage Classification in Satellite Imagery [0.0]
  We use a dataset that includes labeled pre- and post-disaster satellite imagery to assess building damage on a per-building basis. We train multiple convolutional neural networks (CNNs) to assess building damage on a per-building basis. Our research seeks to computationally contribute to aiding in this ongoing and growing humanitarian crisis, heightened by anthropogenic climate change.
  arXiv  Detail & Related papers  (2022-01-24T16:55:56Z)
• Meta Adversarial Perturbations [66.43754467275967]
  We show the existence of a meta adversarial perturbation (MAP) MAP causes natural images to be misclassified with high probability after being updated through only a one-step gradient ascent update. We show that these perturbations are not only image-agnostic, but also model-agnostic, as a single perturbation generalizes well across unseen data points and different neural network architectures.
  arXiv  Detail & Related papers  (2021-11-19T16:01:45Z)
• Assessing out-of-domain generalization for robust building damage detection [78.6363825307044]
  Building damage detection can be automated by applying computer vision techniques to satellite imagery. Models must be robust to a shift in distribution between disaster imagery available for training and the images of the new event. We argue that future work should focus on the OOD regime instead.
  arXiv  Detail & Related papers  (2020-11-20T10:30:43Z)
• RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery [83.49145695899388]
  RescueNet is a unified model that can simultaneously segment buildings and assess the damage levels to individual buildings and can be trained end-to-end. RescueNet is tested on the large scale and diverse xBD dataset and achieves significantly better building segmentation and damage classification performance than previous methods.
  arXiv  Detail & Related papers  (2020-04-15T19:52:09Z)
• An Attention-Based System for Damage Assessment Using Satellite Imagery [18.43310705820528]
  We present Siam-U-Net-Attn model - a multi-class deep learning model with an attention mechanism - to assess damage levels of buildings. We evaluate the proposed method on xView2, a large-scale building damage assessment dataset, and demonstrate that the proposed approach achieves accurate damage scale classification and building segmentation results simultaneously.
  arXiv  Detail & Related papers  (2020-04-14T16:37:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.