WildFireVQA: A Large-Scale Radiometric Thermal VQA Benchmark for Aerial Wildfire Monitoring

• URL: http://arxiv.org/abs/2604.20190v1
• Date: Wed, 22 Apr 2026 05:11:02 GMT
• Title: WildFireVQA: A Large-Scale Radiometric Thermal VQA Benchmark for Aerial Wildfire Monitoring
• Abstract summary: Wildfire monitoring requires timely, actionable situational awareness from airborne platforms.<n>We introduce WildFireVQA, a benchmark for aerial wildfire monitoring that integrates RGB imagery with radiometric thermal data.<n>WildFireVQA contains 6,097 RGB-thermal samples, where each sample includes an RGB image, a color-mapped thermal visualization, and a radiometric thermal TIFF.
• Score: 7.401378781639051
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Wildfire monitoring requires timely, actionable situational awareness from airborne platforms, yet existing aerial visual question answering (VQA) benchmarks do not evaluate wildfire-specific multimodal reasoning grounded in thermal measurements. We introduce WildFireVQA, a large-scale VQA benchmark for aerial wildfire monitoring that integrates RGB imagery with radiometric thermal data. WildFireVQA contains 6,097 RGB-thermal samples, where each sample includes an RGB image, a color-mapped thermal visualization, and a radiometric thermal TIFF, and is paired with 34 questions, yielding a total of 207,298 multiple-choice questions spanning presence and detection, classification, distribution and segmentation, localization and direction, cross-modal reasoning, and flight planning for operational wildfire intelligence. To improve annotation reliability, we combine multimodal large language model (MLLM)-based answer generation with sensor-driven deterministic labeling, manual verification, and intra-frame and inter-frame consistency checks. We further establish a comprehensive evaluation protocol for representative MLLMs under RGB, Thermal, and retrieval-augmented settings using radiometric thermal statistics. Experiments show that across task categories, RGB remains the strongest modality for current models, while retrieved thermal context yields gains for stronger MLLMs, highlighting both the value of temperature-grounded reasoning and the limitations of existing MLLMs in safety-critical wildfire scenarios. The dataset and benchmark code are open-source at https://github.com/mobiiin/WildFire_VQA.

Related papers

• GBU-Palm: A Multimodal Video Dataset and Benchmark for Palm Presentation Attack Detection [73.00315875431374]
  GBU-Palm is a large-scale multimodal video dataset and benchmark containing 21,326 videos from 105 subjects and 210 palms.<n>We construct leakage-controlled protocols that separate palm identity and attack lineage and benchmark four representative video architectures.<n>Results reveal substantial architecture-dependent degradation under environmental shift and show that RGB-NIR fusion does not consistently outperform RGB-only input.
  arXiv  Detail & Related papers  (2026-08-14T15:31:48Z)
• FlameVQA: A Physically-Grounded UAV Wildfire VQA Benchmark with Radiometric Thermal Supervision [7.940539280743071]
  Wildfire monitoring from UAVs requires reliable reasoning over complex aerial scenes.<n>We introduce FlameVQA, a benchmark for UAV-based wildfire intelligence built on FLAME 3.<n>FlameVQA includes 34 multiple-choice questions per image spanning six operational capability groups.
  arXiv  Detail & Related papers  (2026-06-25T15:06:59Z)
• A Nationwide Benchmark for Wildfire Initial Attack Failure Prediction with Public Environmental Data [62.031815260604056]
  We present the first U.S. national-scale benchmark for initial attack (IA) failure prediction from environmental and contextual data available at fire discovery time.<n> WILDFIREIA aligns 38,128 naturally caused FPA-FOD wildfire events with FIRMS/VIIRS thermal detections, gridMET weather and fire-danger variables, LANDFIRE vegetation, fuel, and topography.<n>Results show that public discovery-time data provides useful but incomplete signal for IA failure prediction.
  arXiv  Detail & Related papers  (2026-06-14T01:03:13Z)
• A Large Scale Open-Source Image and Video Dataset for Robust Wildfire Detection and Classification [9.64327338554444]
  We introduce GWFP (Global Wildfire Prevention dataset), a large-scale, open-source dataset of wildfire images and videos.<n>GWFP contains geographically diverse wildfire scenes, including flames, smoke, Waterdog/Fog environmental conditions, Near Infrared (NIR) imagery, Ember, and challenging negative samples collected from real-world scenarios worldwide.
  arXiv  Detail & Related papers  (2026-06-08T21:07:53Z)
• Towards UAV Detection in the Real World: A New Multispectral Dataset UAVNet-MS and a New Method [80.50361258830928]
  UAVNet-MS is the first multispectral dataset for fine-grained small-UAV detection.<n>We propose MFDNet, a dual-stream baseline addressing array-induced parallax and spatial-spectral fusion.<n>This work provides foundational dataset, strong baseline, and benchmark for multispectral UAV monitoring research.
  arXiv  Detail & Related papers  (2026-05-20T09:49:04Z)
• Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Models [58.46663983451155]
  PixSearch is an end-to-end Segmenting Large Multimodal Model (LMM) that unifies region-level perception and retrieval-augmented reasoning.<n>During encoding, PixSearch emits search> tokens to trigger retrieval, selects query modalities (text, image, or region), and generates pixel-level masks that directly serve as visual queries.<n>On egocentric and entity-centric VQA benchmarks, PixSearch substantially improves factual consistency and generalization.
  arXiv  Detail & Related papers  (2026-01-27T00:46:08Z)
• FireSentry: A Multi-Modal Spatio-temporal Benchmark Dataset for Fine-Grained Wildfire Spread Forecasting [41.82363110982653]
  We present FireSentry, a provincial-scale multi-modal wildfire dataset characterized by sub-meter spatial and sub-second temporal resolution.<n>FireSentry provides visible and infrared video streams, in-situ environmental measurements, and manually validated fire masks.<n>Building on FireSentry, we establish a comprehensive benchmark encompassing physics-based, data-driven, and generative models.
  arXiv  Detail & Related papers  (2025-12-03T02:02:47Z)
• PyroFocus: A Deep Learning Approach to Real-Time Wildfire Detection in Multispectral Remote Sensing Imagery [0.0]
  Rapid and accurate wildfire detection is crucial for emergency response and environmental management.<n>In airborne and spaceborne missions, real-time algorithms must distinguish between no fire, active fire, and post-fire conditions.<n>We introduce PyroFocus, a two-stage pipeline that performs fire classification followed by fire radiative power (FRP) regression or segmentation to reduce inference time and computational cost for onboard deployment.
  arXiv  Detail & Related papers  (2025-12-02T21:59:45Z)
• DetectiumFire: A Comprehensive Multi-modal Dataset Bridging Vision and Language for Fire Understanding [5.257894673786823]
  We introduce DetectiumFire, a large-scale, multi-modal dataset comprising of 22.5k high-resolution fire-related images and 2.5k real-world fire-related videos.<n>The data are annotated with both traditional computer vision labels (e.g., bounding boxes) and detailed textual prompts describing the scene.<n>We validate the utility of DetectiumFire across multiple tasks, including object detection, diffusion-based image generation, and vision-language reasoning.
  arXiv  Detail & Related papers  (2025-11-04T11:33:11Z)
• Seeing Heat with Color -- RGB-Only Wildfire Temperature Inference from SAM-Guided Multimodal Distillation using Radiometric Ground Truth [5.343932820859596]
  This paper introduces SAM-TIFF, a novel framework for pixel-level wildfire temperature prediction and segmentation using RGB input only.<n>A multimodal teacher network trained on paired RGB-Thermal imagery and radiometric TIFF ground truth distills knowledge to a unimodal RGB student network, enabling thermal-sensor-free inference.<n>Our method is the first to perform per-pixel temperature regression from RGB UAV data, demonstrating strong generalization on the recent FLAME 3 dataset.
  arXiv  Detail & Related papers  (2025-05-03T00:23:11Z)
• TS-SatFire: A Multi-Task Satellite Image Time-Series Dataset for Wildfire Detection and Prediction [2.2673203312389423]
  Covering wildfire events in the contiguous U.S. from January 2017 to October 2021, the dataset includes 3552 surface reflectance images and auxiliary data, totalling 71 GB.<n>The dataset supports three tasks: active fire detection, daily burned area mapping, and wildfire progression prediction.<n>This dataset and its benchmarks provide a foundation for advancing wildfire research using deep learning.
  arXiv  Detail & Related papers  (2024-12-16T08:40:12Z)
• Multi-modal Queried Object Detection in the Wild [72.16067634379226]
  MQ-Det is an efficient architecture and pre-training strategy design for real-world object detection. It incorporates vision queries into existing language-queried-only detectors. MQ-Det's simple yet effective architecture and training strategy design is compatible with most language-queried object detectors.
  arXiv  Detail & Related papers  (2023-05-30T12:24:38Z)
• Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline [80.13652104204691]
  In this paper, we construct a large-scale benchmark with high diversity for visible-thermal UAV tracking (VTUAV) We provide a coarse-to-fine attribute annotation, where frame-level attributes are provided to exploit the potential of challenge-specific trackers. In addition, we design a new RGB-T baseline, named Hierarchical Multi-modal Fusion Tracker (HMFT), which fuses RGB-T data in various levels.
  arXiv  Detail & Related papers  (2022-04-08T15:22:33Z)
• Meta-UDA: Unsupervised Domain Adaptive Thermal Object Detection using Meta-Learning [64.92447072894055]
  Infrared (IR) cameras are robust under adverse illumination and lighting conditions. We propose an algorithm meta-learning framework to improve existing UDA methods. We produce a state-of-the-art thermal detector for the KAIST and DSIAC datasets.
  arXiv  Detail & Related papers  (2021-10-07T02:28:18Z)
• Speak2Label: Using Domain Knowledge for Creating a Large Scale Driver Gaze Zone Estimation Dataset [55.391532084304494]
  Driver Gaze in the Wild dataset contains 586 recordings, captured during different times of the day including evenings. Driver Gaze in the Wild dataset contains 338 subjects with an age range of 18-63 years.
  arXiv  Detail & Related papers  (2020-04-13T14:47:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.