CrisiSense-RAG: Crisis Sensing Multimodal Retrieval-Augmented Generation for Rapid Disaster Impact Assessment

• URL: http://arxiv.org/abs/2602.13239v1
• Date: Fri, 30 Jan 2026 02:37:38 GMT
• Title: CrisiSense-RAG: Crisis Sensing Multimodal Retrieval-Augmented Generation for Rapid Disaster Impact Assessment
• Authors: Yiming Xiao, Kai Yin, Ali Mostafavi,
• Abstract summary: CrisiSense-RAG is a multimodal retrieval-augmented generation framework for disaster impact assessment.<n>System employs hybrid dense-sparse retrieval for text sources and CLIP-based retrieval for aerial imagery.<n>System was evaluated on Hurricane Harvey across 207 ZIP-code queries.
• Score: 9.56546113027439
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Timely and spatially resolved disaster impact assessment is essential for effective emergency response. However, automated methods typically struggle with temporal asynchrony. Real-time human reports capture peak hazard conditions while high-resolution satellite imagery is frequently acquired after peak conditions. This often reflects flood recession rather than maximum extent. Naive fusion of these misaligned streams can yield dangerous underestimates when post-event imagery overrides documented peak flooding. We present CrisiSense-RAG, which is a multimodal retrieval-augmented generation framework that reframes impact assessment as evidence synthesis over heterogeneous data sources without disaster-specific fine-tuning. The system employs hybrid dense-sparse retrieval for text sources and CLIP-based retrieval for aerial imagery. A split-pipeline architecture feeds into asynchronous fusion logic that prioritizes real-time social evidence for peak flood extent while treating imagery as persistent evidence of structural damage. Evaluated on Hurricane Harvey across 207 ZIP-code queries, the framework achieves a flood extent MAE of 10.94% to 28.40% and damage severity MAE of 16.47% to 21.65% in zero-shot settings. Prompt-level alignment proves critical for quantitative validity because metric grounding improves damage estimates by up to 4.75 percentage points. These results demonstrate a practical and deployable approach to rapid resilience intelligence under real-world data constraints.

Related papers

• RoSe: Robust Self-supervised Stereo Matching under Adverse Weather Conditions [58.37558408672509]
  We propose a robust self-supervised training paradigm, consisting of two key steps: robust self-supervised scene correspondence learning and adverse weather distillation.<n>Experiments demonstrate the effectiveness and versatility of our proposed solution, which outperforms existing state-of-the-art self-supervised methods.
  arXiv  Detail & Related papers  (2025-09-23T15:41:40Z)
• Structural Damage Detection Using AI Super Resolution and Visual Language Model [0.0]
  This study proposes a novel, cost-effective framework that leverages aerial drone footage, an advanced AI-based video super-resolution model, Video Restoration Transformer (VRT), and Gemma3:27b, a 27 billion parameter Visual Language Model (VLM)<n>This integrated system is designed to improve low-resolution disaster footage, identify structural damage, and classify buildings into four damage categories, ranging from no/slight damage to total destruction, along with associated risk levels.<n>The framework achieved a classification accuracy of 84.5%, demonstrating its ability to provide highly accurate results.
  arXiv  Detail & Related papers  (2025-08-23T20:12:06Z)
• A Deep Learning framework for building damage assessment using VHR SAR and geospatial data: demonstration on the 2023 Turkiye Earthquake [1.6070833439280312]
  Building damage identification shortly after a disaster is crucial for guiding emergency response and recovery efforts.<n>We introduce a novel multimodal deep learning (DL) framework for detecting building damage using single-date very high resolution (VHR) Synthetic Aperture Radar (SAR) imagery.<n>Our method integrates SAR image patches, OpenStreetMap (OSM) building footprints, digital surface model (DSM) data, and structural and exposure attributes from the Global Earthquake Model (GEM)<n>Results highlight that incorporating geospatial features significantly enhances detection performance and generalizability to previously unseen areas.
  arXiv  Detail & Related papers  (2025-06-27T15:49:58Z)
• Flood-DamageSense: Multimodal Mamba with Multitask Learning for Building Flood Damage Assessment using SAR Remote Sensing Imagery [1.3566464121222228]
  Flood-DamageSense is the first deep-learning framework purpose-built for building-level flood-damage assessment.<n>The architecture fuses pre- and post-event SAR/InSAR scenes with very-high-resolution optical basemaps.<n>An end-to-end post-processing pipeline converts pixel-level outputs to actionable, building-scale damage maps.
  arXiv  Detail & Related papers  (2025-06-07T05:19:10Z)
• Deep Self-Supervised Disturbance Mapping with the OPERA Sentinel-1 Radiometric Terrain Corrected SAR Backscatter Product [41.94295877935867]
  Mapping land surface disturbances supports disaster response, resource and ecosystem management, and climate adaptation efforts.<n> Synthetic aperture radar (SAR) is an invaluable tool for disturbance mapping, providing consistent time-series images of the ground regardless of weather or illumination conditions.<n>NASA's Observational Products for End-Users from Remote Sensing Analysis (OPERA) project released the near-global Radiometric Terrain Corrected SAR backscatter from Sentinel-1 (RTC-S1) dataset in October 2023.<n>In this work, we utilize this new dataset to systematically analyze land surface disturbances.
  arXiv  Detail & Related papers  (2025-01-15T20:24:18Z)
• BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response [50.76124284445902]
  Building damage assessment (BDA) is an essential capability in the aftermath of a disaster to reduce human casualties.<n>Recent research focuses on the development of AI models to achieve accurate mapping of unseen disaster events.<n>We present a BDA dataset using veRy-hIGH-resoluTion optical and SAR imagery (BRIGHT) to support AI-based all-weather disaster response.
  arXiv  Detail & Related papers  (2025-01-10T14:57:18Z)
• SEN12-WATER: A New Dataset for Hydrological Applications and its Benchmarking [40.996860106131244]
  Climate and increasing droughts pose significant challenges to water resource management around the world. We present a new dataset, SEN12-WATER, along with a benchmark using a end-to-end Deep Learning framework for proactive drought-related analysis.
  arXiv  Detail & Related papers  (2024-09-25T16:50:59Z)
• Multi-Modal Learning-based Reconstruction of High-Resolution Spatial Wind Speed Fields [46.72819846541652]
  We propose a framework based on Vari Data Assimilation and Deep Learning concepts. This framework is applied to recover rich-in-time, high-resolution information on sea surface wind speed.
  arXiv  Detail & Related papers  (2023-12-14T13:40:39Z)
• Normalizing flow-based deep variational Bayesian network for seismic multi-hazards and impacts estimation from InSAR imagery [11.753558942419545]
  Interferometric Synthetic aperture radar (InSAR) data is important in providing high-resolution onsite information for rapid hazard estimation. We introduce a novel variational inference with normalizing flows derived to jointly approximate posteriors of multiple unobserved hazards and impacts from noisy InSAR imagery.
  arXiv  Detail & Related papers  (2023-10-20T20:32:43Z)
• Causality-informed Rapid Post-hurricane Building Damage Detection in Large Scale from InSAR Imagery [6.331801334141028]
  Timely and accurate assessment of hurricane-induced building damage is crucial for effective post-hurricane response and recovery efforts. Recently, remote sensing technologies provide large-scale optical or Interferometric Synthetic Aperture Radar (InSAR) imagery data immediately after a disastrous event. These InSAR imageries often contain highly noisy and mixed signals induced by co-occurring or co-located building damage, flood, flood/wind-induced vegetation changes, as well as anthropogenic activities. This paper introduces an approach for rapid post-hurricane building damage detection from InSAR imagery.
  arXiv  Detail & Related papers  (2023-10-02T18:56:05Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Assessing out-of-domain generalization for robust building damage detection [78.6363825307044]
  Building damage detection can be automated by applying computer vision techniques to satellite imagery. Models must be robust to a shift in distribution between disaster imagery available for training and the images of the new event. We argue that future work should focus on the OOD regime instead.
  arXiv  Detail & Related papers  (2020-11-20T10:30:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.