Does Your Wildfire Prediction Model Actually Work, or Just Score Well?
- URL: http://arxiv.org/abs/2605.18911v1
- Date: Thu, 14 May 2026 04:28:10 GMT
- Title: Does Your Wildfire Prediction Model Actually Work, or Just Score Well?
- Abstract summary: Existing Earth foundation models (Earth FMs) are pretrained for general atmospheric and geophysical objectives rather than wildfire forecasting.<n>We introduce WILDFIRE-FM, the first foundation model pretrained specifically for wildfire prediction using weather, active-fire observations, topography, vegetation, and static environmental data.<n>We introduce a fixed-contract evaluation framework with two controlled checks: a fixed-output check for matching-rule effects and a fixed-feature check for head-selection effects.
- Score: 17.463683393779647
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: Wildfire prediction is important for early warning and resource allocation, yet existing Earth foundation models (Earth FMs) are pretrained for general atmospheric and geophysical objectives rather than wildfire forecasting. To address this gap, we introduce WILDFIRE-FM, the first foundation model pretrained specifically for wildfire prediction using weather, active-fire observations, topography, vegetation, and static environmental data. However, introducing a domain-specific backbone alone does not solve the evaluation problem: wildfire events are sparse in space and time, making transfer conclusions highly sensitive to matching rules and evaluation settings. To address this problem, we introduce a fixed-contract evaluation framework with two controlled checks: a fixed-output check for matching-rule effects and a fixed-feature check for head-selection effects. Under matched contracts, we compare WILDFIRE-FM with ten Earth-FM baselines across occupancy, spread, retrieval, and regression tasks. Our results show that wildfire transfer conclusions depend strongly on evaluation design and task formulation. We hope this framework and WILDFIRE-FM provide a foundation for future wildfire-specific Earth-FM research and benchmarking. Our code is available at https://anonymous.4open.science/r/Wildfire-fm-evaluation-contracts-5AE9/.
Related papers
- A Nationwide Benchmark for Wildfire Initial Attack Failure Prediction with Public Environmental Data [62.031815260604056]
We present the first U.S. national-scale benchmark for initial attack (IA) failure prediction from environmental and contextual data available at fire discovery time.<n> WILDFIREIA aligns 38,128 naturally caused FPA-FOD wildfire events with FIRMS/VIIRS thermal detections, gridMET weather and fire-danger variables, LANDFIRE vegetation, fuel, and topography.<n>Results show that public discovery-time data provides useful but incomplete signal for IA failure prediction.
arXiv Detail & Related papers (2026-06-14T01:03:13Z) - Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
arXiv Detail & Related papers (2026-04-20T11:40:39Z) - Target Concept Tuning Improves Extreme Weather Forecasting [51.43578341469291]
Deep learning models for meteorological forecasting often fail in rare but high-impact events such as typhoons.<n>Existing fine-tuning methods face a trade-off between overlooking these extreme events and overfitting them at the expense of overall performance.<n>We propose TaCT, an interpretable concept-gated fine-tuning framework that solves the aforementioned issue by selective model improvement.
arXiv Detail & Related papers (2026-03-17T15:34:05Z) - Predicting the Containment Time of California Wildfires Using Machine Learning [0.0]
We built machine learning models to predict the number of days it will require to fully contain a wildfire in California.<n>This study compared the performance of baseline ensemble regressor, Random Forest and XGBoost, with a Long Short-Term Memory (LSTM) neural network.
arXiv Detail & Related papers (2025-12-10T17:14:20Z) - FireScope: Wildfire Risk Prediction with a Chain-of-Thought Oracle [69.84129020970477]
Existing methods lack the causal reasoning and understanding required for reliable generalization.<n>We introduce $textbfFireScope-Bench, a dataset and benchmark that couples Sentinel-2 imagery and climate data with expert-defined risks.<n>When trained in the USA and tested in Europe, $textbfFireScope$ achieves substantial performance gains.<n>Our findings demonstrate that reasoning can ground prediction models, improving both generalization and interpretability.
arXiv Detail & Related papers (2025-11-21T11:45:22Z) - Generative Algorithms for Wildfire Progression Reconstruction from Multi-Modal Satellite Active Fire Measurements and Terrain Height [0.0]
A conditional Generative Adrial Network is trained with simulations of historic wildfires from the atmosphere-wildfire model WRF-SFIRE.<n>Fire progression is succinctly represented by fire arrival time, and measurements for training are obtained by applying an approximate observation operator to WRF-SFIRE solutions.<n>The model is trained onversas of fire arrival times, measurements, and terrain, and once trained leverages measurements of real fires and corresponding terrain data to generate samples of fire arrival times.
arXiv Detail & Related papers (2025-06-12T06:54:51Z) - Revisiting Few-Shot Object Detection with Vision-Language Models [49.79495118650838]
We revisit the task of few-shot object detection (FSOD) in the context of recent foundational vision-language models (VLMs)
We propose Foundational FSOD, a new benchmark protocol that evaluates detectors pre-trained on any external data.
We discuss our recent CVPR 2024 Foundational FSOD competition and share insights from the community.
arXiv Detail & Related papers (2023-12-22T07:42:00Z) - Generative Algorithms for Fusion of Physics-Based Wildfire Spread Models
with Satellite Data for Initializing Wildfire Forecasts [0.0]
Recent progress in using satellites to detect fire locations provides the opportunity to use measurements to improve fire spread forecasts.
This work develops a method for inferring the history of a wildfire from satellite measurements.
arXiv Detail & Related papers (2023-09-05T23:24:34Z) - Patch-level Gaze Distribution Prediction for Gaze Following [49.93340533068501]
We introduce the patch distribution prediction ( PDP) method for gaze following training.
We show that our model regularizes the MSE loss by predicting better heatmap distributions on images with larger annotation variances.
Experiments show that our model bridging the gap between the target prediction and in/out prediction subtasks, showing a significant improvement on both subtasks on public gaze following datasets.
arXiv Detail & Related papers (2022-11-20T19:25:15Z) - Multi-time Predictions of Wildfire Grid Map using Remote Sensing Local
Data [0.0]
This paper proposes a distributed learning framework that shares local data collected in ten locations in the western USA throughout local agents.
The proposed model has distinct features that address the characteristic need in prediction evaluations, including dynamic online estimation and time-series modeling.
arXiv Detail & Related papers (2022-09-15T22:34:06Z) - From Static to Dynamic Prediction: Wildfire Risk Assessment Based on
Multiple Environmental Factors [69.9674326582747]
Wildfire is one of the biggest disasters that frequently occurs on the west coast of the United States.
We propose static and dynamic prediction models to analyze and assess the areas with high wildfire risks in California.
arXiv Detail & Related papers (2021-03-14T17:56:17Z) - Uncertainty Aware Wildfire Management [6.997483623023005]
Recent wildfires in the United States have resulted in loss of life and billions of dollars.
There are limited resources to be deployed over a massive area and the spread of the fire is challenging to predict.
This paper proposes a decision-theoretic approach to combat wildfires.
arXiv Detail & Related papers (2020-10-15T17:47:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.