Long-Time Trajectory Approximation via SA-NODEs: Model Predictive and Floquet Strategies
- URL: http://arxiv.org/abs/2608.10738v1
- Date: Tue, 11 Aug 2026 09:55:54 GMT
- Title: Long-Time Trajectory Approximation via SA-NODEs: Model Predictive and Floquet Strategies
- Abstract summary: We study the approximation of dynamical systems by semi-autonomous neural ordinary differential equations (SA-NODEs) over long time horizons.<n>For a single network trained on the whole horizon, the available error bound deteriorates double exponentially in the horizon length.<n>We develop two training strategies that avoid this barrier, each built on a reset of the state.
- Score: 0.49655032077676126
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We study the approximation of dynamical systems by semi-autonomous neural ordinary differential equations (SA-NODEs) over long time horizons. For a single network trained on the whole horizon, the available error bound deteriorates double exponentially in the horizon length. We develop two training strategies that avoid this barrier, each built on a reset of the state. The model predictive strategy partitions the horizon adaptively and restarts every window from observed data: when training meets a prescribed tolerance on every window, the composite model meets it uniformly in time, with a parameter budget linear in the horizon for targets with a bounded, uniformly regular reachable tube. The Floquet strategy addresses autonomous targets with a stable limit cycle and uses no data at deployment: a certified contraction of the learned return map confines the error to linear growth in the number of elapsed periods. For the time-periodic architecture we deploy, the scalar certificate degenerates; we prove instead a uniform-in-time orbital guarantee whose hypotheses are measured on the trained model, and an obstruction showing that, for an exactly periodic learned field, small one-period error and a contracting stroboscopic map cannot hold at once. Numerical experiments on four benchmarks confirm the predicted error laws and measure the hypotheses of every guarantee.
Related papers
- Conflict-Predictive Variable Horizons in Multi-Drone Distributed Model Predictive Control [3.0098885383612104]
In distributed model predictive control, a fixed horizon forces a compromise: a short horizon is inexpensive but reacts late to approaching neighbors, whereas a long one anticipates conflicts at a per-step cost that grows superlinearly with its length.<n>We propose a conflict-predictive variable horizon that each drone sets locally, leaving the distributed model predictive control itself unchanged.
arXiv Detail & Related papers (2026-09-07T17:24:30Z) - Across the Loss Landscape with Progressive Growth [51.366966420881646]
We show how grow-and-optimize strategies to train toward flatter regions by viewing growth as progressive relaxation.<n>We empirically validate these predictions in controlled toy basins and in a realistic ResNet/CI-100 setting.<n>Although progressive subspace growth reliably produces flatter solutions, curvature reductions do not universally translate into improved test performance, highlighting subtleties in the flatness-generalization connection.
arXiv Detail & Related papers (2026-08-25T13:50:48Z) - LC-GRPO: Bridging Train-Inference Gap for Flow-Based GRPO with Langevin Correction [59.32834240526981]
Flow-based generative models are typically sampled by solving a deterministic ordinary differential equation (ODE)<n>Existing GRPO methods for flow models replace the Euler-time ODE with aotropic differential equation (SDE) during training.<n>We introduce LC-GRPO, a flow-based GRPO framework with Langevin correction targeting the marginal distribution at the resulting timestep.
arXiv Detail & Related papers (2026-08-06T04:47:57Z) - Stability Annealing Selects the Implicit Bias of Smoothed Sign Descent: A Rate-Indexed Barrier Path on Separable Data [3.7437735326653883]
This paper studies the rate-controlled middle case for full-batch linear classification on separable data.<n>For memoryless stability-annealed smoothed-sign descent with weighted exponential loss, we prove that the normalized iterates converge to the minimizer of a convex Burg-type barrier over a margin slice.
arXiv Detail & Related papers (2026-07-07T08:55:35Z) - Online Distributional Prediction via Latent Cluster Geometry Under Drift and Corruption [14.35871574542677]
We study online distributional prediction under drift and adversarial corruption.<n>A Gibbs quasi-posterior over these configurations yields an online predictor by posterior averaging.<n>We evaluate performance by cumulative Wasserstein-1 regret against the time-varying true law.
arXiv Detail & Related papers (2026-06-17T07:41:41Z) - ForcingDAS: Unified and Robust Data Assimilation via Diffusion Forcing [24.41363445015799]
We introduce ForcingDAS, a unified and robust data assimilation framework.<n>ForcingDAS learns a joint-trajectory prior instead of frame-to-frame transitions.<n>We evaluate ForcingDAS on 2D Navier-Stokes vorticity, precipitation nowcasting, and global atmospheric state estimation.
arXiv Detail & Related papers (2026-05-14T02:34:33Z) - Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling [18.081497075992406]
Multi-agent trajectory modeling traditionally focuses on forecasting, often neglecting more general tasks like trajectory completion.<n>We introduce U2Diffine, a unified diffusion model built to perform trajectory completion while simultaneously offering state-wise heteroscedastic uncertainty estimates.<n>Our method outperforms state-of-the-art solutions in both trajectory completion and forecasting across four challenging sports datasets.
arXiv Detail & Related papers (2026-05-11T15:26:14Z) - A Finite-Iteration Theory for Asynchronous Categorical Distributional Temporal-Difference Learning [9.562123195246393]
We bridge the gap between finite-iteration theory and the categorical recursions most closely aligned with practical distributional temporal-difference implementations.<n>After suitable embeddings, both algorithms take the form of asynchronous single-state-approximations that contract in a statewise supremum norm.<n>This permits finite-iteration guarantees in discounted problems under both i.i.d. and Markovian state sampling, and in undiscounted fixed-horizon problems under i.i.d. episodic sampling.
arXiv Detail & Related papers (2026-05-07T19:07:00Z) - Towards Scaling Law Analysis For Spatiotemporal Weather Data [50.25336689856158]
We extend neural scaling analysis for autoregressive weather forecasting from single-step training loss to long rollouts and per-channel metrics.<n>We find strong cross-channel and cross-horizon heterogeneity: pooled scaling can look favorable while many channels degrade at late leads.<n>We discuss implications for weighted objectives, horizon-aware curricula, and resource allocation across outputs.
arXiv Detail & Related papers (2026-04-06T18:14:53Z) - Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting [79.37674445572462]
Time series forecasting (TSF) remains a challenging problem due to the intricate entanglement of intraperiod-fluctuations and interperiod-trends.<n>Treating reshaped tensors as static images results in a topological mismatch.<n> relying on uniform fixed-size representations allocates modeling capacity inefficiently.<n>TimeGS is a novel framework that fundamentally shifts the forecasting paradigm from regression to 2D generative rendering.
arXiv Detail & Related papers (2026-02-10T14:13:36Z) - Temporal Difference Flows [82.24174052059352]
Geometric Horizon Models (GHMs) offer a compelling alternative by directly making predictions of future states.<n>Existing methods are negatively affected by bootstrapping predictions at train time and struggle to generate high-quality predictions at long horizons.<n>This paper introduces Temporal Difference Flows (TD-Flow), which leverages the structure of a novel Bellman equation on probability paths alongside flow-matching techniques to learn accurate GHMs at over 5x the horizon length of prior methods.
arXiv Detail & Related papers (2025-03-12T20:30:07Z) - DispFormer: A Pretrained Transformer Incorporating Physical Constraints for Dispersion Curve Inversion [56.64622091009756]
This study introduces DispFormer, a transformer-based neural network for $v_s$ profile inversion from Rayleigh-wave phase and group dispersion curves.<n>DispFormer processes dispersion data independently at each period, allowing it to handle varying lengths without requiring network modifications or strict alignment between training and testing datasets.
arXiv Detail & Related papers (2025-01-08T09:08:24Z) - Intersection of Parallels as an Early Stopping Criterion [64.8387564654474]
We propose a method to spot an early stopping point in the training iterations without the need for a validation set.
For a wide range of learning rates, our method, called Cosine-Distance Criterion (CDC), leads to better generalization on average than all the methods that we compare against.
arXiv Detail & Related papers (2022-08-19T19:42:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.