BDANet: Multiscale Convolutional Neural Network with Cross-directional Attention for Building Damage Assessment from Satellite Images

• URL: http://arxiv.org/abs/2105.07364v1
• Date: Sun, 16 May 2021 06:13:28 GMT
• Title: BDANet: Multiscale Convolutional Neural Network with Cross-directional Attention for Building Damage Assessment from Satellite Images
• Authors: Yu Shen, Sijie Zhu, Taojiannan Yang, Chen Chen, Delu Pan, Jianyu Chen, Liang Xiao, Qian Du
• Abstract summary: Building damage assessment from satellite imagery is critical before relief effort is deployed. Deep neural networks have been successfully applied to building damage assessment. We propose a novel two-stage convolutional neural network for Building Damage Assessment, called BDANet.
• Score: 24.989412626461213
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fast and effective responses are required when a natural disaster (e.g., earthquake, hurricane, etc.) strikes. Building damage assessment from satellite imagery is critical before relief effort is deployed. With a pair of pre- and post-disaster satellite images, building damage assessment aims at predicting the extent of damage to buildings. With the powerful ability of feature representation, deep neural networks have been successfully applied to building damage assessment. Most existing works simply concatenate pre- and post-disaster images as input of a deep neural network without considering their correlations. In this paper, we propose a novel two-stage convolutional neural network for Building Damage Assessment, called BDANet. In the first stage, a U-Net is used to extract the locations of buildings. Then the network weights from the first stage are shared in the second stage for building damage assessment. In the second stage, a two-branch multi-scale U-Net is employed as backbone, where pre- and post-disaster images are fed into the network separately. A cross-directional attention module is proposed to explore the correlations between pre- and post-disaster images. Moreover, CutMix data augmentation is exploited to tackle the challenge of difficult classes. The proposed method achieves state-of-the-art performance on a large-scale dataset -- xBD. The code is available at https://github.com/ShaneShen/BDANet-Building-Damage-Assessment.

Related papers

• Multi-step feature fusion for natural disaster damage assessment on satellite images [0.0]
  We introduce a novel convolutional neural network (CNN) module that performs feature fusion at multiple network levels. An additional network element - Fuse Module - was proposed to adapt any CNN model to analyze image pairs. We report over a 3 percentage point increase in the accuracy of the Vision Transformer model.
  arXiv  Detail & Related papers  (2024-10-29T09:47:32Z)
• A Geometrical Approach to Evaluate the Adversarial Robustness of Deep Neural Networks [52.09243852066406]
  Adversarial Converging Time Score (ACTS) measures the converging time as an adversarial robustness metric. We validate the effectiveness and generalization of the proposed ACTS metric against different adversarial attacks on the large-scale ImageNet dataset.
  arXiv  Detail & Related papers  (2023-10-10T09:39:38Z)
• InDuDoNet+: A Model-Driven Interpretable Dual Domain Network for Metal Artifact Reduction in CT Images [53.4351366246531]
  We construct a novel interpretable dual domain network, termed InDuDoNet+, into which CT imaging process is finely embedded. We analyze the CT values among different tissues, and merge the prior observations into a prior network for our InDuDoNet+, which significantly improve its generalization performance.
  arXiv  Detail & Related papers  (2021-12-23T15:52:37Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• Fully convolutional Siamese neural networks for buildings damage assessment from satellite images [1.90365714903665]
  Damage assessment after natural disasters is needed to distribute aid and forces to recovery from damage dealt optimally. We develop a computational approach for an automated comparison of the same region's satellite images before and after the disaster. We include an extensive ablation study and compare different encoders, decoders, loss functions, augmentations, and several methods to combine two images.
  arXiv  Detail & Related papers  (2021-10-31T14:18:59Z)
• Assessing out-of-domain generalization for robust building damage detection [78.6363825307044]
  Building damage detection can be automated by applying computer vision techniques to satellite imagery. Models must be robust to a shift in distribution between disaster imagery available for training and the images of the new event. We argue that future work should focus on the OOD regime instead.
  arXiv  Detail & Related papers  (2020-11-20T10:30:43Z)
• Cross-directional Feature Fusion Network for Building Damage Assessment from Satellite Imagery [26.767229623170497]
  Building damage assessment from satellite imagery is critical before an effective response is conducted. We propose a novel cross-directional fusion strategy to better explore the correlations between pre- and post-disaster images. The proposed method achieves state-of-the-art performance on a large-scale building damage assessment dataset.
  arXiv  Detail & Related papers  (2020-10-27T02:49:52Z)
• Improving Emergency Response during Hurricane Season using Computer Vision [0.06882042556551608]
  We have developed a framework for crisis response and management that incorporates the latest technologies in computer vision (CV), inland flood prediction, damage assessment and data visualization. Our computer-vision model analyzes spaceborne and airborne imagery to detect relevant features during and after a natural disaster. We have designed an ensemble of models to identify features including water, roads, buildings, and vegetation from the imagery.
  arXiv  Detail & Related papers  (2020-08-17T15:42:02Z)
• MSNet: A Multilevel Instance Segmentation Network for Natural Disaster Damage Assessment in Aerial Videos [74.22132693931145]
  We study the problem of efficiently assessing building damage after natural disasters like hurricanes, floods or fires. The first contribution is a new dataset, consisting of user-generated aerial videos from social media with annotations of instance-level building damage masks. The second contribution is a new model, namely MSNet, which contains novel region proposal network designs.
  arXiv  Detail & Related papers  (2020-06-30T02:23:05Z)
• RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery [83.49145695899388]
  RescueNet is a unified model that can simultaneously segment buildings and assess the damage levels to individual buildings and can be trained end-to-end. RescueNet is tested on the large scale and diverse xBD dataset and achieves significantly better building segmentation and damage classification performance than previous methods.
  arXiv  Detail & Related papers  (2020-04-15T19:52:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.