Watch your neighbors: Training statistically accurate chaotic systems with local phase space information
- URL: http://arxiv.org/abs/2605.14405v1
- Date: Thu, 14 May 2026 05:45:41 GMT
- Title: Watch your neighbors: Training statistically accurate chaotic systems with local phase space information
- Abstract summary: Chaotic systems pose fundamental challenges for data-driven dynamics discovery.<n>We propose a new framework by training surrogate dynamics models with accurate Jacobians and long-term statistical properties.<n>Our method significantly improves Jacobian accuracy while remaining competitive with state-of-the-art statistically accurate dynamics learning methods.
- Score: 1.6003479913250966
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Chaotic systems pose fundamental challenges for data-driven dynamics discovery, as small modeling errors lead to exponentially growing trajectory discrepancies. Since exact long-term prediction is unattainable, it is natural to ask what a good surrogate model for chaotic dynamics is. Prior work has largely focused either on reproducing the Jacobian of the underlying dynamics, which governs local expansion and contraction rates, or on training surrogate models that reproduce the ground-truth dynamics' long-term statistical behavior. In this work, we propose a new framework that aims to bridge these two paradigms by training surrogate dynamics models with accurate Jacobians and long-term statistical properties. Our method constructs a local covering of a chaotic attractor in phase space and analyzes the expansion and contraction of these coverings under the dynamics. The surrogate model is trained by minimizing the maximum mean discrepancy between the pushforward distributions of the coverings under the surrogate and ground-truth dynamics. Experiments show that our method significantly improves Jacobian accuracy while remaining competitive with state-of-the-art statistically accurate dynamics learning methods. Our code is fully available at https://anonymous.4open.science/r/neighborwatch.
Related papers
- Symbolic Neural ODEs: Learning interpretable models from time-series data [0.0]
We present a machine learning framework for identifying sparse, interpretable models of dynamical systems from time-series data.<n>Our approach parameterizes the underlying vector field using a neural architecture and trains it by minimizing a multi-step prediction loss over a finite horizon.<n>We show that multi-step training yields models with accurate short-term dynamics and strong agreement in long-time statistical properties.
arXiv Detail & Related papers (2026-08-22T21:31:07Z) - Continuous Data Assimilation with Learned Surrogate Dynamics [1.461685903055768]
In many applications, the state dynamics are unknown or prohibitively expensive to simulate at the required resolution, leading to model error.<n>Motivated by this challenge and the increasing adoption of machine learning surrogates in data assimilation, this paper develops a unified finite-dimensional analysis of nudging algorithms that employ learned surrogate models of the dynamics.
arXiv Detail & Related papers (2026-05-30T02:15:51Z) - A Knowledge-Informed Pretrained Model for Causal Discovery [61.8885572392623]
Causal discovery has been widely studied, yet many existing methods rely on strong assumptions or fall into two extremes.<n>We propose a knowledge-informed pretrained model for causal discovery that integrates weak prior knowledge as a principled middle ground.<n>Our model adopts a dual source encoder-decoder architecture to process observational data in a knowledge-informed way.
arXiv Detail & Related papers (2026-03-21T14:59:41Z) - Is memory all you need? Data-driven Mori-Zwanzig modeling of Lagrangian particle dynamics in turbulent flows [38.33325744358047]
We show how one can learn a surrogate dynamical system that is able to evolve a turbulent Lagrangian trajectory in a way that is point-wise accurate for short-time predictions.<n>This opens up a range of new applications, for example, for the control of active Lagrangian agents in turbulence.
arXiv Detail & Related papers (2025-07-21T20:50:55Z) - Consistent World Models via Foresight Diffusion [56.45012929930605]
We argue that a key bottleneck in learning consistent diffusion-based world models lies in the suboptimal predictive ability.<n>We propose Foresight Diffusion (ForeDiff), a diffusion-based world modeling framework that enhances consistency by decoupling condition understanding from target denoising.
arXiv Detail & Related papers (2025-05-22T10:01:59Z) - Dynamical Diffusion: Learning Temporal Dynamics with Diffusion Models [71.63194926457119]
We introduce Dynamical Diffusion (DyDiff), a theoretically sound framework that incorporates temporally aware forward and reverse processes.<n>Experiments across scientifictemporal forecasting, video prediction, and time series forecasting demonstrate that Dynamical Diffusion consistently improves performance in temporal predictive tasks.
arXiv Detail & Related papers (2025-03-02T16:10:32Z) - When predict can also explain: few-shot prediction to select better neural latents [2.8933605229876664]
One widely-used method, $textitco-smoothing$, involves jointly estimating latent variables and predicting observations along held-out channels.<n>We show that models with high co-smoothing can have arbitrary extraneous dynamics in their latent representations.<n>By cross-decoding the latent variables of all model pairs with high co-smoothing, we identify models with minimal extraneous dynamics.
arXiv Detail & Related papers (2024-05-23T10:48:30Z) - Latent Traversals in Generative Models as Potential Flows [113.4232528843775]
We propose to model latent structures with a learned dynamic potential landscape.
Inspired by physics, optimal transport, and neuroscience, these potential landscapes are learned as physically realistic partial differential equations.
Our method achieves both more qualitatively and quantitatively disentangled trajectories than state-of-the-art baselines.
arXiv Detail & Related papers (2023-04-25T15:53:45Z) - Stabilizing Machine Learning Prediction of Dynamics: Noise and
Noise-inspired Regularization [58.720142291102135]
Recent has shown that machine learning (ML) models can be trained to accurately forecast the dynamics of chaotic dynamical systems.
In the absence of mitigating techniques, this technique can result in artificially rapid error growth, leading to inaccurate predictions and/or climate instability.
We introduce Linearized Multi-Noise Training (LMNT), a regularization technique that deterministically approximates the effect of many small, independent noise realizations added to the model input during training.
arXiv Detail & Related papers (2022-11-09T23:40:52Z) - Physics-aware, probabilistic model order reduction with guaranteed
stability [0.0]
We propose a generative framework for learning an effective, lower-dimensional, coarse-grained dynamical model.
We demonstrate its efficacy and accuracy in multiscale physical systems of particle dynamics.
arXiv Detail & Related papers (2021-01-14T19:16:51Z) - Training Generative Adversarial Networks by Solving Ordinary
Differential Equations [54.23691425062034]
We study the continuous-time dynamics induced by GAN training.
From this perspective, we hypothesise that instabilities in training GANs arise from the integration error.
We experimentally verify that well-known ODE solvers (such as Runge-Kutta) can stabilise training.
arXiv Detail & Related papers (2020-10-28T15:23:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.