Spatiotemporal System Forecasting with Irregular Time Steps via Masked Autoencoder

• URL: http://arxiv.org/abs/2603.25597v1
• Date: Thu, 26 Mar 2026 16:14:11 GMT
• Title: Spatiotemporal System Forecasting with Irregular Time Steps via Masked Autoencoder
• Abstract summary: Physics-Spatiotemporal Masked Autoencoder integrates convolutional autoencoders for spatial feature extraction with masked autoencoders optimised for irregular time series.<n>We evaluate this approach on multiple simulated datasets and real-world ocean temperature data.<n>The model shows potential for capturing complextemporal patterns without requiring domain-specific knowledge, with applications in climate modelling, fluid dynamics, ocean forecasting, environmental monitoring, and scientific computing.
• Score: 36.06018466897679
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Predicting high-dimensional dynamical systems with irregular time steps presents significant challenges for current data-driven algorithms. These irregularities arise from missing data, sparse observations, or adaptive computational techniques, reducing prediction accuracy. To address these limitations, we propose a novel method: a Physics-Spatiotemporal Masked Autoencoder. This method integrates convolutional autoencoders for spatial feature extraction with masked autoencoders optimised for irregular time series, leveraging attention mechanisms to reconstruct the entire physical sequence in a single prediction pass. The model avoids the need for data imputation while preserving physical integrity of the system. Here, 'physics' refers to high-dimensional fields generated by underlying dynamical systems, rather than the enforcement of explicit physical constraints or PDE residuals. We evaluate this approach on multiple simulated datasets and real-world ocean temperature data. The results demonstrate that our method achieves significant improvements in prediction accuracy, robustness to nonlinearities, and computational efficiency over traditional convolutional and recurrent network methods. The model shows potential for capturing complex spatiotemporal patterns without requiring domain-specific knowledge, with applications in climate modelling, fluid dynamics, ocean forecasting, environmental monitoring, and scientific computing.

Related papers

• Turning mechanistic models into forecasters by using machine learning [5.9650173644260605]
  We develop a forecasting model for complex dynamical systems using time-varying parameters.<n>Our model achieves a mean absolute error below 3% for learning a time series and below 6% for forecasting up to a month ahead.<n>Our findings demonstrate that integrating time-varying parameters into data-driven discovery of differential equations improves both modeling accuracy and forecasting performance.
  arXiv  Detail & Related papers  (2026-02-04T01:00:08Z)
• Attention-Enhanced Convolutional Autoencoder and Structured Delay Embeddings for Weather Prediction [0.5729426778193397]
  This work introduces an efficient reduced-order modeling (ROM) framework for short-range weather prediction.<n>Unlike recent AI-driven models, which require extensive computational resources, our framework prioritizes efficiency while achieving reasonable accuracy.
  arXiv  Detail & Related papers  (2025-11-16T16:53:27Z)
• Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems [49.819436680336786]
  We propose an efficient transformed Gaussian process state-space model (ETGPSSM) for scalable and flexible modeling of high-dimensional, non-stationary dynamical systems.<n>Specifically, our ETGPSSM integrates a single shared GP with input-dependent normalizing flows, yielding an expressive implicit process prior that captures complex, non-stationary transition dynamics.<n>Our ETGPSSM outperforms existing GPSSMs and neural network-based SSMs in terms of computational efficiency and accuracy.
  arXiv  Detail & Related papers  (2025-03-24T03:19:45Z)
• Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraint [12.638698799995815]
  We introduce the Dynamic System Prediction from Sparse Observations using Voronoi Tessellation (DSOVT) framework. By integrating Voronoi tessellations with deep learning models, DSOVT is adept at predicting dynamical systems with sparse, unstructured observations. Compared to purely data-driven models, our physics-based approach enables the model to learn physical laws within explicitly formulated dynamics.
  arXiv  Detail & Related papers  (2024-08-31T13:43:52Z)
• Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
  Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models. Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML) We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
  arXiv  Detail & Related papers  (2024-07-18T15:44:23Z)
• Learning Spatiotemporal Dynamical Systems from Point Process Observations [7.381752536547389]
  Current neural network-based model approaches fall short when faced with data that is collected randomly over time and space.<n>In response, we developed a new method that can effectively learn from such process observations.<n>Our model integrates techniques from neural differential equations, neural point processes, implicit neural representations and amortized variational inference.
  arXiv  Detail & Related papers  (2024-06-01T09:03:32Z)
• Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling [55.13352174687475]
  This paper proposes a physics-AI hybrid model (i.e., WeatherGFT) which generalizes weather forecasts to finer-grained temporal scales beyond training dataset.<n>Specifically, we employ a carefully designed PDE kernel to simulate physical evolution on a small time scale.<n>We also introduce a lead time-aware training framework to promote the generalization of the model at different lead times.
  arXiv  Detail & Related papers  (2024-05-22T16:21:02Z)
• Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values [67.76168547245237]
  We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies. Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-11T10:10:16Z)
• Deep Convolutional Architectures for Extrapolative Forecast in Time-dependent Flow Problems [0.0]
  Deep learning techniques are employed to model the system dynamics for advection dominated problems. These models take as input a sequence of high-fidelity vector solutions for consecutive time-steps obtained from the PDEs. Non-intrusive reduced-order modelling techniques such as deep auto-encoder networks are utilized to compress the high-fidelity snapshots.
  arXiv  Detail & Related papers  (2022-09-18T03:45:56Z)
• Convolutional generative adversarial imputation networks for spatio-temporal missing data in storm surge simulations [86.5302150777089]
  Generative Adversarial Imputation Nets (GANs) and GAN-based techniques have attracted attention as unsupervised machine learning methods. We name our proposed method as Con Conval Generative Adversarial Imputation Nets (Conv-GAIN)
  arXiv  Detail & Related papers  (2021-11-03T03:50:48Z)
• Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components [52.77024349608834]
  We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements. We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
  arXiv  Detail & Related papers  (2021-02-15T19:56:48Z)
• Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation [0.6850683267295248]
  Non-intrusive reduced-order models (ROMs) provide a low-dimensional framework for systems that may be intrinsically high-dimensional. In bypassing the utilization of an equation-based evolution, it is often seen that the interpretability of the ROM framework suffers. In this article, we propose the use of a novel latent-space algorithm based on process regression.
  arXiv  Detail & Related papers  (2020-07-23T17:56:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.