Transformer-based Diffusion models for Hydrological Time Series Probabilistic Imputation and Forecasting

• URL: http://arxiv.org/abs/2607.21200v1
• Date: Thu, 23 Jul 2026 11:19:27 GMT
• Title: Transformer-based Diffusion models for Hydrological Time Series Probabilistic Imputation and Forecasting
• Abstract summary: The modeling of hydrometeorological time series with limited observations is a key challenge in the monitoring of hydro-systems and water resources.<n>Recent advances in deep learning offer a promising direction for improving the representation and generation of complex temporal processes.<n>This study investigates the application of transformer-based diffusion models to the simulation and reconstruction of hydrological time series.
• Score: 27.151780750119556
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The modeling of hydrometeorological time series with limited observations is a key challenge in the monitoring of hydro-systems and water resources, as well as for flood or drought risk assessment. Due to the high variability of the underlying processes and the sparsity of available measurements, traditional statistical approaches often struggle to accurately represent their dynamics. In this context, recent advances in deep learning offer a promising direction for improving the representation and generation of complex temporal processes sampled at several observation sites. This study investigates the application of transformer-based diffusion models to the simulation and reconstruction of hydrological time series. The proposed framework is applied to the joint modeling of water quantity and quality at six sites spread across three adjacent headwater catchments located in North-East France on a limestone plateau covered by forests and field crops. The model is calibrated and validated using available observational data, which has been quality controlled and corrected for sensor drift and malfunction through collaborative efforts by LNE metrology expertise and Andra monthly quality control over more than 15 years. Its performance is compared with several established baseline approaches commonly used for time series modeling. Quantitative evaluation metrics are employed to assess the ability of the proposed method to reproduce key temporal characteristics of the observed signals in two settings: the imputation of incomplete time series and the forecasting of upcoming hydrological conditions. Results support the effectiveness of the transformer-based approach and highlight its capacity to capture and simulate the complex patterns present in hydrological data. In particular, the results indicate that diffusion models can efficiently sample realistic time series distributions under observation settings with variable missing data for both forecasting and imputation.

Related papers

• Multi-Source Dynamic Graph Learning for Compound-Flood Forecasting in Managed Coastal Systems [14.68802969969726]
  Compound flooding in managed coastal systems is influenced by hydrological conditions and water-management activity observed across multiple monitoring stations.<n>Current forecasting models can capture temporal dependencies with low average errors, but global error metrics may conceal poor reproduction of prolonged high-water plateaus.<n>This work proposes an anchored forecasting framework that incorporates cross-site information through state- and lead-dependent bounded residual corrections.
  arXiv  Detail & Related papers  (2026-08-03T06:48:32Z)
• Solving Inverse Problems with FLAIR [68.87167940623318]
  We present FLAIR, a training-free variational framework that leverages flow-based generative models as prior for inverse problems.<n>Results on standard imaging benchmarks demonstrate that FLAIR consistently outperforms existing diffusion- and flow-based methods in terms of reconstruction quality and sample diversity.
  arXiv  Detail & Related papers  (2025-06-03T09:29:47Z)
• Well2Flow: Reconstruction of reservoir states from sparse wells using score-based generative models [0.22499166814992438]
  This study investigates the use of score-based generative models for reservoir simulation scenarios.<n>It focuses on reconstructing spatially porous and saturation fields in saline aquifers, inferred from sparse observations at two well locations.<n>It introduces a novel methodology for incorporating physical constraints and well log guidance into generative models, significantly enhancing the accuracy and physical plausibility of the reconstructed subsurface states.
  arXiv  Detail & Related papers  (2025-04-07T20:12:19Z)
• Analyzing Spatio-Temporal Dynamics of Dissolved Oxygen for the River Thames using Superstatistical Methods and Machine Learning [0.0]
  We use superstatistical methods and machine learning to predict dissolved oxygen levels in the River Thames.<n>For long-term forecasting, the Informer model consistently delivers superior performance.
  arXiv  Detail & Related papers  (2025-01-10T16:54:52Z)
• Hierarchically Disentangled Recurrent Network for Factorizing System Dynamics of Multi-scale Systems: An application on Hydrological Systems [4.634606500665259]
  We propose a novel hierarchical recurrent neural architecture that factorizes the system dynamics at multiple temporal scales.<n> Experiments on several catchments from the National Weather Service North Central River Forecast Center show that FHNN outperforms standard baselines.<n>We show that FHNN can maintain accuracy even with limited training data through effective pre-training strategies and training global models.
  arXiv  Detail & Related papers  (2024-07-29T16:25:43Z)
• Multi-Modal Learning-based Reconstruction of High-Resolution Spatial Wind Speed Fields [46.72819846541652]
  We propose a framework based on Vari Data Assimilation and Deep Learning concepts. This framework is applied to recover rich-in-time, high-resolution information on sea surface wind speed.
  arXiv  Detail & Related papers  (2023-12-14T13:40:39Z)
• Learning from Polar Representation: An Extreme-Adaptive Model for Long-Term Time Series Forecasting [10.892801642895904]
  We propose Distance-weighted Auto-regularized Neural network (DAN), a novel extreme-adaptive model for long-range forecasting of stremflow enhanced by polar representation learning. On four real-life hydrologic streamflow datasets, we demonstrate that DAN significantly outperforms both state-of-the-art hydrologic time series prediction methods and general methods designed for long-term time series prediction.
  arXiv  Detail & Related papers  (2023-12-14T09:16:01Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• An evaluation of deep learning models for predicting water depth evolution in urban floods [59.31940764426359]
  We compare different deep learning models for prediction of water depth at high spatial resolution. Deep learning models are trained to reproduce the data simulated by the CADDIES cellular-automata flood model. Our results show that the deep learning models present in general lower errors compared to the other methods.
  arXiv  Detail & Related papers  (2023-02-20T16:08:54Z)
• TACTiS: Transformer-Attentional Copulas for Time Series [76.71406465526454]
  estimation of time-varying quantities is a fundamental component of decision making in fields such as healthcare and finance. We propose a versatile method that estimates joint distributions using an attention-based decoder. We show that our model produces state-of-the-art predictions on several real-world datasets.
  arXiv  Detail & Related papers  (2022-02-07T21:37:29Z)
• Back2Future: Leveraging Backfill Dynamics for Improving Real-time Predictions in Future [73.03458424369657]
  In real-time forecasting in public health, data collection is a non-trivial and demanding task. 'Backfill' phenomenon and its effect on model performance has been barely studied in the prior literature. We formulate a novel problem and neural framework Back2Future that aims to refine a given model's predictions in real-time.
  arXiv  Detail & Related papers  (2021-06-08T14:48:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.