Fusing VHR Post-disaster Aerial Imagery and LiDAR Data for Roof Classification in the Caribbean

• URL: http://arxiv.org/abs/2307.16177v4
• Date: Mon, 9 Oct 2023 07:58:13 GMT
• Title: Fusing VHR Post-disaster Aerial Imagery and LiDAR Data for Roof Classification in the Caribbean
• Authors: Isabelle Tingzon, Nuala Margaret Cowan, Pierre Chrzanowski
• Abstract summary: We leverage deep learning techniques for the automated classification of roof characteristics from orthophotos and airborne LiDAR data. This work is intended to help governments produce more timely building information to improve resilience and disaster response in the Caribbean.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate and up-to-date information on building characteristics is essential for vulnerability assessment; however, the high costs and long timeframes associated with conducting traditional field surveys can be an obstacle to obtaining critical exposure datasets needed for disaster risk management. In this work, we leverage deep learning techniques for the automated classification of roof characteristics from very high-resolution orthophotos and airborne LiDAR data obtained in Dominica following Hurricane Maria in 2017. We demonstrate that the fusion of multimodal earth observation data performs better than using any single data source alone. Using our proposed methods, we achieve F1 scores of 0.93 and 0.92 for roof type and roof material classification, respectively. This work is intended to help governments produce more timely building information to improve resilience and disaster response in the Caribbean.

Related papers

• AI-Derived Structural Building Intelligence for Urban Resilience: An Application in Saint Vincent and the Grenadines [1.1470070927586018]
  We present an AI-driven workflow to automatically infer rooftop attributes from satellite imagery.<n>Our work aims to provide SIDS with novel capabilities to harness AI and Earth Observation (EO) data to enable more efficient, evidence-based urban governance.
  arXiv  Detail & Related papers  (2025-09-18T02:12:50Z)
• Bayesian-Driven Graph Reasoning for Active Radio Map Construction [96.08082552413117]
  We propose an uncertainty-aware radio map reconstruction framework that explicitly leverages graph-based reasoning tailored for waypoint navigation.<n>Our approach integrates two key deep learning components: (1) a Bayesian neural network that estimates spatial uncertainty in real time, and (2) an attention-based reinforcement learning policy that performs global reasoning.<n> Experimental results show that URAM improves reconstruction accuracy by up to 34% over existing baselines.
  arXiv  Detail & Related papers  (2025-07-29T03:32:01Z)
• A Deep Learning framework for building damage assessment using VHR SAR and geospatial data: demonstration on the 2023 Turkiye Earthquake [1.6070833439280312]
  Building damage identification shortly after a disaster is crucial for guiding emergency response and recovery efforts.<n>We introduce a novel multimodal deep learning (DL) framework for detecting building damage using single-date very high resolution (VHR) Synthetic Aperture Radar (SAR) imagery.<n>Our method integrates SAR image patches, OpenStreetMap (OSM) building footprints, digital surface model (DSM) data, and structural and exposure attributes from the Global Earthquake Model (GEM)<n>Results highlight that incorporating geospatial features significantly enhances detection performance and generalizability to previously unseen areas.
  arXiv  Detail & Related papers  (2025-06-27T15:49:58Z)
• Always Clear Depth: Robust Monocular Depth Estimation under Adverse Weather [48.65180004211851]
  We present a robust monocular depth estimation method called textbfACDepth from the perspective of high-quality training data generation and domain adaptation.<n>Specifically, we introduce a one-step diffusion model for generating samples that simulate adverse weather conditions, constructing a multi-tuple degradation dataset during training.<n>We elaborate on a multi-granularity knowledge distillation strategy (MKD) that encourages the student network to absorb knowledge from both the teacher model and pretrained Depth Anything V2.
  arXiv  Detail & Related papers  (2025-05-18T02:30:47Z)
• Post-Hurricane Debris Segmentation Using Fine-Tuned Foundational Vision Models [18.008592164636664]
  This work introduces an open-source dataset comprising approximately 1,200 manually annotated aerial RGB images from Hurricanes Ian, Ida, and Ike. To mitigate human biases and enhance data quality, labels from multiple annotators are strategically aggregated and visual prompt engineering is employed. The resulting fine-tuned model, named fCLIPSeg, achieves a Dice score of 0.70 on data from Hurricane Ida with virtually no false positives in debris-free areas.
  arXiv  Detail & Related papers  (2025-04-17T00:08:50Z)
• Deep Self-Supervised Disturbance Mapping with the OPERA Sentinel-1 Radiometric Terrain Corrected SAR Backscatter Product [41.94295877935867]
  Mapping land surface disturbances supports disaster response, resource and ecosystem management, and climate adaptation efforts. Synthetic aperture radar (SAR) is an invaluable tool for disturbance mapping, providing consistent time-series images of the ground regardless of weather or illumination conditions. NASA's Observational Products for End-Users from Remote Sensing Analysis (OPERA) project released the near-global Radiometric Terrain Corrected SAR backscatter from Sentinel-1 (RTC-S1) dataset in October 2023. In this work, we utilize this new dataset to systematically analyze land surface disturbances.
  arXiv  Detail & Related papers  (2025-01-15T20:24:18Z)
• BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response [50.76124284445902]
  Building damage assessment (BDA) is an essential capability in the aftermath of a disaster to reduce human casualties.<n>Recent research focuses on the development of AI models to achieve accurate mapping of unseen disaster events.<n>We present a BDA dataset using veRy-hIGH-resoluTion optical and SAR imagery (BRIGHT) to support AI-based all-weather disaster response.
  arXiv  Detail & Related papers  (2025-01-10T14:57:18Z)
• DiffSR: Learning Radar Reflectivity Synthesis via Diffusion Model from Satellite Observations [42.635670495018964]
  We propose a two-stage diffusion-based method called DiffSR to generate high-frequency details and high-value areas. Our method achieves state-of-the-art (SOTA) results, demonstrating the ability to generate high-frequency details and high-value areas.
  arXiv  Detail & Related papers  (2024-11-11T04:50:34Z)
• AB2CD: AI for Building Climate Damage Classification and Detection [0.0]
  We explore the implementation of deep learning techniques for precise building damage assessment in the context of natural hazards. We tackle the challenges of generalization to novel disasters and regions while accounting for the influence of low-quality and noisy labels. Our research findings showcase the potential and limitations of advanced AI solutions in enhancing the impact assessment of climate change-induced extreme weather events.
  arXiv  Detail & Related papers  (2023-09-03T03:37:04Z)
• One-class Damage Detector Using Deeper Fully-Convolutional Data Descriptions for Civil Application [0.0]
  One-class damage detection approach has an advantage in that normal images can be used to optimize model parameters. We propose a civil-purpose application for automating one-class damage detection reproducing a fully convolutional data description (FCDD) as a baseline model.
  arXiv  Detail & Related papers  (2023-03-03T06:27:15Z)
• Learning-based estimation of in-situ wind speed from underwater acoustics [58.293528982012255]
  We introduce a deep learning approach for the retrieval of wind speed time series from underwater acoustics. Our approach bridges data assimilation and learning-based frameworks to benefit both from prior physical knowledge and computational efficiency.
  arXiv  Detail & Related papers  (2022-08-18T15:27:40Z)
• Embedding Earth: Self-supervised contrastive pre-training for dense land cover classification [61.44538721707377]
  We present Embedding Earth a self-supervised contrastive pre-training method for leveraging the large availability of satellite imagery. We observe significant improvements up to 25% absolute mIoU when pre-trained with our proposed method. We find that learnt features can generalize between disparate regions opening up the possibility of using the proposed pre-training scheme.
  arXiv  Detail & Related papers  (2022-03-11T16:14:14Z)
• Interpretability in Convolutional Neural Networks for Building Damage Classification in Satellite Imagery [0.0]
  We use a dataset that includes labeled pre- and post-disaster satellite imagery to assess building damage on a per-building basis. We train multiple convolutional neural networks (CNNs) to assess building damage on a per-building basis. Our research seeks to computationally contribute to aiding in this ongoing and growing humanitarian crisis, heightened by anthropogenic climate change.
  arXiv  Detail & Related papers  (2022-01-24T16:55:56Z)
• NIDA-CLIFGAN: Natural Infrastructure Damage Assessment through Efficient Classification Combining Contrastive Learning, Information Fusion and Generative Adversarial Networks [0.0]
  The paper demonstrates a systematic effort to achieve efficient building damage classification. Results demonstrate data and computational efficiency with 10% of the collected data combined with a GAN reducing the time of computation from roughly half a day to about 1 hour.
  arXiv  Detail & Related papers  (2021-10-27T15:29:16Z)
• Assessing out-of-domain generalization for robust building damage detection [78.6363825307044]
  Building damage detection can be automated by applying computer vision techniques to satellite imagery. Models must be robust to a shift in distribution between disaster imagery available for training and the images of the new event. We argue that future work should focus on the OOD regime instead.
  arXiv  Detail & Related papers  (2020-11-20T10:30:43Z)
• TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networks [73.01104041298031]
  TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs) To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics. To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
  arXiv  Detail & Related papers  (2020-09-16T15:52:04Z)
• Learning from Multimodal and Multitemporal Earth Observation Data for Building Damage Mapping [17.324397643429638]
  We have developed a global multisensor and multitemporal dataset for building damage mapping. The global dataset contains high-resolution optical imagery and high-to-moderate-resolution multiband SAR data. We defined a damage mapping framework for the semantic segmentation of damaged buildings based on a deep convolutional neural network algorithm.
  arXiv  Detail & Related papers  (2020-09-14T05:04:19Z)
• MSNet: A Multilevel Instance Segmentation Network for Natural Disaster Damage Assessment in Aerial Videos [74.22132693931145]
  We study the problem of efficiently assessing building damage after natural disasters like hurricanes, floods or fires. The first contribution is a new dataset, consisting of user-generated aerial videos from social media with annotations of instance-level building damage masks. The second contribution is a new model, namely MSNet, which contains novel region proposal network designs.
  arXiv  Detail & Related papers  (2020-06-30T02:23:05Z)
• RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery [83.49145695899388]
  RescueNet is a unified model that can simultaneously segment buildings and assess the damage levels to individual buildings and can be trained end-to-end. RescueNet is tested on the large scale and diverse xBD dataset and achieves significantly better building segmentation and damage classification performance than previous methods.
  arXiv  Detail & Related papers  (2020-04-15T19:52:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.