Deep Learning for Spatio-Temporal Fusion in Land Surface Temperature Estimation: A Comprehensive Survey, Experimental Analysis, and Future Trends

• URL: http://arxiv.org/abs/2412.16631v1
• Date: Sat, 21 Dec 2024 13:53:15 GMT
• Title: Deep Learning for Spatio-Temporal Fusion in Land Surface Temperature Estimation: A Comprehensive Survey, Experimental Analysis, and Future Trends
• Authors: Sofiane Bouaziz, Adel Hafiane, Raphael Canals, Rachid Nedjai,
• Abstract summary: Land Surface Temperature (LST) plays a critical role in understanding key environmental processes.<n>Satellite sensors often face a trade-off between spatial and temporal resolutions.<n>Spatio-Temporal Fusion (STF) has emerged as a powerful method to integrate two satellite data sources.
• Score: 3.344876133162209
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The rapid advancements in satellite remote sensing have enhanced the capability to monitor and analyze the Earth's surface. Among the many variables captured through satellite sensors, Land Surface Temperature (LST) plays a critical role in understanding key environmental processes. However, obtaining high-resolution LST data remains a challenge, as satellite sensors often face a trade-off between spatial and temporal resolutions. In response, Spatio-Temporal Fusion (STF) has emerged as a powerful method to integrate two satellite data sources, one providing high spatial but low temporal resolution, and the other offering high temporal but low spatial resolution. Although a range of STF techniques have been proposed, from traditional methods to cutting-edge deep learning (DL) models, most have focused on surface reflectance, with limited application to LST estimation. DL approaches, in particular, show promise in improving the spatial and temporal resolutions of LST by capturing complex, non-linear relationships between input and output LST data. This paper offers a comprehensive review of the latest advancements in DL-based STF techniques for LST estimation. We analyze key research developments, mathematically formulate the STF problem, and introduce a novel taxonomy for DL-based STF methods. Furthermore, we discuss the challenges faced by current methods and highlight future research directions. In addition, we present the first open-source benchmark STF dataset for LST estimation, consisting of 51 pairs of MODIS-Landsat images spanning from 2013 to 2024. To support our findings, we conduct extensive experiments on state-of-the-art methods and present both quantitative and qualitative assessments. This is the first survey paper focused on DL-based STF for LST estimation. We hope it serves as a valuable reference for researchers and paves the way for future research in this field.

Related papers

• STFM: A Spatio-Temporal Information Fusion Model Based on Phase Space Reconstruction for Sea Surface Temperature Prediction [7.925940960061756]
  This study presents a prediction framework based solely on data-driven techniques. Unlike conventional models, our method captures SST dynamics efficiently through phase space reconstruction.
  arXiv  Detail & Related papers  (2025-04-23T14:14:59Z)
• A Decade of Deep Learning for Remote Sensing Spatiotemporal Fusion: Advances, Challenges, and Opportunities [2.2311172523629637]
  Deep learning methods have revolutionized remote sensing STF. This paper comprehensively reviews DL developments in remote sensing STF over the last decade. It discusses major challenges in existing research and identifies promising future research references.
  arXiv  Detail & Related papers  (2025-04-01T15:30:48Z)
• Daily Land Surface Temperature Reconstruction in Landsat Cross-Track Areas Using Deep Ensemble Learning With Uncertainty Quantification [5.6087513714958686]
  We propose DELAG, an ensemble learning method that integrates annual temperature cycles and processes to reconstruct Landsat LST in complex urban areas. DelAG successfully reconstructed LST in New York City, London and Hong Kong from three different areas as study areas. Results demonstrate the successful reconstruction through DELAG and highlight the broader applications of LST reconstruction for estimating accurate air temperature.
  arXiv  Detail & Related papers  (2025-02-20T10:35:01Z)
• Interpreting Object-level Foundation Models via Visual Precision Search [54.575247537324344]
  We propose a Visual Precision Search method that generates accurate attribution maps with fewer regions. We show our approach enhances object-level task interpretability over SOTA for Grounding DINO and Florence-2 across various evaluation metrics. Our method can interpret failures in visual grounding and object detection tasks, surpassing existing methods across multiple evaluation metrics.
  arXiv  Detail & Related papers  (2024-11-25T08:54:54Z)
• GrokLST: Towards High-Resolution Benchmark and Toolkit for Land Surface Temperature Downscaling [28.17231566763907]
  High-resolution Surface Temperature (LST) is critical for environmental studies. Current methods often neglect spatial non-arity and lack a open-source ecosystem for deep learning methods. We propose Modality-Conditional Large Selective Network (MoCoLSK) Networks. MoCoLSK fuses multi-modal data throughmodal-conditioned projections, leading to enhanced LST prediction accuracy.
  arXiv  Detail & Related papers  (2024-09-30T00:17:00Z)
• MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling [68.69647625472464]
  Downscaling, a crucial task in meteorological forecasting, enables the reconstruction of high-resolution meteorological states for target regions. Previous downscaling methods lacked tailored designs for meteorology and encountered structural limitations. We propose a novel model called MambaDS, which enhances the utilization of multivariable correlations and topography information.
  arXiv  Detail & Related papers  (2024-08-20T13:45:49Z)
• SFANet: Spatial-Frequency Attention Network for Weather Forecasting [54.470205739015434]
  Weather forecasting plays a critical role in various sectors, driving decision-making and risk management. Traditional methods often struggle to capture the complex dynamics of meteorological systems. We propose a novel framework designed to address these challenges and enhance the accuracy of weather prediction.
  arXiv  Detail & Related papers  (2024-05-29T08:00:15Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• Learning of Sea Surface Height Interpolation from Multi-variate Simulated Satellite Observations [0.0]
  We train an Attention-Based-Decoder deep learning network (textscabed) on this data. We evaluate ABED reconstructions when trained using either supervised or unsupervised loss functions, with or without SST information. Based on real SSH observations from the Ocean Data Challenge 2021, we find that this learning strategy, combined with the use of SST, decreases the root mean squared error by 24% compared to OI.
  arXiv  Detail & Related papers  (2023-10-11T16:09:09Z)
• Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysis [70.78170766633039]
  We address the need for means of assessing MTS forecasting proposals reliably and fairly. BasicTS+ is a benchmark designed to enable fair, comprehensive, and reproducible comparison of MTS forecasting solutions. We apply BasicTS+ along with rich datasets to assess the capabilities of more than 45 MTS forecasting solutions.
  arXiv  Detail & Related papers  (2023-10-09T19:52:22Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models [53.67562579184457]
  This paper focuses on probabilistic STG forecasting, which is challenging due to the difficulty in modeling uncertainties and complex dependencies. We present the first attempt to generalize the popular denoising diffusion models to STGs, leading to a novel non-autoregressive framework called DiffSTG. Our approach combines the intrinsic-temporal learning capabilities STNNs with the uncertainty measurements of diffusion models.
  arXiv  Detail & Related papers  (2023-01-31T13:42:36Z)
• Tensor Decompositions for Hyperspectral Data Processing in Remote Sensing: A Comprehensive Review [85.36368666877412]
  hyperspectral (HS) remote sensing (RS) imaging has provided a significant amount of spatial and spectral information for the observation and analysis of the Earth's surface. The recent advancement and even revolution of the HS RS technique offer opportunities to realize the full potential of various applications. Due to the maintenance of the 3-D HS inherent structure, tensor decomposition has aroused widespread concern and research in HS data processing tasks.
  arXiv  Detail & Related papers  (2022-05-13T00:39:23Z)
• Generating gapless land surface temperature with a high spatio-temporal resolution by fusing multi-source satellite-observed and model-simulated data [7.166180462786921]
  We present an integrated temperature fusion framework for satellite-observed and LSM-simulated LST data to map gapless LST at a 60-m spatial resolution and half-hourly temporal resolution. Evaluations were implemented in an urban-dominated region (the city of Wuhan in China) and a natural-dominated region (the Heihe River Basin in China)
  arXiv  Detail & Related papers  (2021-11-29T02:28:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.