MONITRS: Multimodal Observations of Natural Incidents Through Remote Sensing

• URL: http://arxiv.org/abs/2507.16228v1
• Date: Tue, 22 Jul 2025 04:59:09 GMT
• Title: MONITRS: Multimodal Observations of Natural Incidents Through Remote Sensing
• Authors: Shreelekha Revankar, Utkarsh Mall, Cheng Perng Phoo, Kavita Bala, Bharath Hariharan,
• Abstract summary: We present MONITRS, a novel dataset of more than 10,000 FEMA disaster events with temporal satellite imagery and natural language annotations from news articles.<n>We demonstrate that fine-tuning existing MLLMs on our dataset yields significant performance improvements for disaster monitoring tasks.
• Score: 39.47126465689941
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Natural disasters cause devastating damage to communities and infrastructure every year. Effective disaster response is hampered by the difficulty of accessing affected areas during and after events. Remote sensing has allowed us to monitor natural disasters in a remote way. More recently there have been advances in computer vision and deep learning that help automate satellite imagery analysis, However, they remain limited by their narrow focus on specific disaster types, reliance on manual expert interpretation, and lack of datasets with sufficient temporal granularity or natural language annotations for tracking disaster progression. We present MONITRS, a novel multimodal dataset of more than 10,000 FEMA disaster events with temporal satellite imagery and natural language annotations from news articles, accompanied by geotagged locations, and question-answer pairs. We demonstrate that fine-tuning existing MLLMs on our dataset yields significant performance improvements for disaster monitoring tasks, establishing a new benchmark for machine learning-assisted disaster response systems. Code can be found at: https://github.com/ShreelekhaR/MONITRS

Related papers

• A Deep Learning framework for building damage assessment using VHR SAR and geospatial data: demonstration on the 2023 Turkiye Earthquake [1.6070833439280312]
  Building damage identification shortly after a disaster is crucial for guiding emergency response and recovery efforts.<n>We introduce a novel multimodal deep learning (DL) framework for detecting building damage using single-date very high resolution (VHR) Synthetic Aperture Radar (SAR) imagery.<n>Our method integrates SAR image patches, OpenStreetMap (OSM) building footprints, digital surface model (DSM) data, and structural and exposure attributes from the Global Earthquake Model (GEM)<n>Results highlight that incorporating geospatial features significantly enhances detection performance and generalizability to previously unseen areas.
  arXiv  Detail & Related papers  (2025-06-27T15:49:58Z)
• DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Response [20.208384252534657]
  DisasterM3 is a vision-language dataset for global-scale disaster assessment and response.<n>DisasterM3 includes 26,988 bi-temporal satellite images and 123k instruction pairs across 5 continents.<n>Based on real-world scenarios, DisasterM3 includes 9 disaster-related visual perception and reasoning tasks.
  arXiv  Detail & Related papers  (2025-05-27T12:16:07Z)
• Harnessing Large Language Models for Disaster Management: A Survey [57.00123968209682]
  Large language models (LLMs) have revolutionized scientific research with their exceptional capabilities and transformed various fields.<n>This study aims to guide the professional community in developing advanced LLMs for disaster management to enhance the resilience against natural disasters.
  arXiv  Detail & Related papers  (2025-01-12T21:00:50Z)
• CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics [49.2719253711215]
  This study introduces a novel approach to disaster text classification by enhancing a pre-trained Large Language Model (LLM)<n>Our methodology involves creating a comprehensive instruction dataset from disaster-related tweets, which is then used to fine-tune an open-source LLM.<n>This fine-tuned model can classify multiple aspects of disaster-related information simultaneously, such as the type of event, informativeness, and involvement of human aid.
  arXiv  Detail & Related papers  (2024-06-16T23:01:10Z)
• Typhoon Intensity Prediction with Vision Transformer [51.84456610977905]
  We introduce "Typhoon Intensity Transformer" (Tint) to predict typhoon intensity accurately across space and time. Tint uses self-attention mechanisms with global receptive fields per layer. Experiments on a publicly available typhoon benchmark validate the efficacy of Tint.
  arXiv  Detail & Related papers  (2023-11-28T03:11:33Z)
• CrisisMatch: Semi-Supervised Few-Shot Learning for Fine-Grained Disaster Tweet Classification [51.58605842457186]
  We present a fine-grained disaster tweet classification model under the semi-supervised, few-shot learning setting. Our model, CrisisMatch, effectively classifies tweets into fine-grained classes of interest using few labeled data and large amounts of unlabeled data.
  arXiv  Detail & Related papers  (2023-10-23T07:01:09Z)
• DisasterNets: Embedding Machine Learning in Disaster Mapping [24.385872724685655]
  DisasterNets is a framework for fast and accurate recognition of disasters using machine learning. The framework is applied to earthquake-triggered landslide mapping and large-scale flood mapping. The results demonstrate a competitive performance for high-precision, high-efficiency, and cross-scene recognition of disasters.
  arXiv  Detail & Related papers  (2023-06-16T12:50:46Z)
• Disaster Anomaly Detector via Deeper FCDDs for Explainable Initial Responses [0.0]
  In any disaster event, an initial response is the key to rescue within 72 hours and prompt recovery. Among machine learning algorithms, deep anomaly detection is effective in detecting devastation features that are different from everyday features. In this paper, we propose an anomaly detection application utilizing deeper fully convolutional data descriptions (FCDDs) We find that the deeper FCDD with a VGG16 backbone consistently outperformed other baselines CNN27, ResNet101, and Inceptionv3.
  arXiv  Detail & Related papers  (2023-06-05T00:44:39Z)
• Incidents1M: a large-scale dataset of images with natural disasters, damage, and incidents [28.16346818821349]
  Natural disasters, such as floods, tornadoes, or wildfires, are increasingly pervasive as the Earth undergoes global warming. It is difficult to predict when and where an incident will occur, so timely emergency response is critical to saving the lives of those endangered by destructive events. Social media posts can be used as a low-latency data source to understand the progression and aftermath of a disaster, yet parsing this data is tedious without automated methods. In this work, we present the Incidents1M dataset, a large-scale multi-label dataset which contains 977,088 images, with 43 incident and 49 place categories.
  arXiv  Detail & Related papers  (2022-01-11T23:03:57Z)
• Physics-informed GANs for Coastal Flood Visualization [65.54626149826066]
  We create a deep learning pipeline that generates visual satellite images of current and future coastal flooding. By evaluating the imagery relative to physics-based flood maps, we find that our proposed framework outperforms baseline models in both physical-consistency and photorealism. While this work focused on the visualization of coastal floods, we envision the creation of a global visualization of how climate change will shape our earth.
  arXiv  Detail & Related papers  (2020-10-16T02:15:34Z)
• Learning from Multimodal and Multitemporal Earth Observation Data for Building Damage Mapping [17.324397643429638]
  We have developed a global multisensor and multitemporal dataset for building damage mapping. The global dataset contains high-resolution optical imagery and high-to-moderate-resolution multiband SAR data. We defined a damage mapping framework for the semantic segmentation of damaged buildings based on a deep convolutional neural network algorithm.
  arXiv  Detail & Related papers  (2020-09-14T05:04:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.