Time Without Timesteps: Simulating Coupled Dynamical Systems via Self-Consistency
- URL: http://arxiv.org/abs/2609.03358v1
- Date: Thu, 03 Sep 2026 04:32:23 GMT
- Title: Time Without Timesteps: Simulating Coupled Dynamical Systems via Self-Consistency
- Abstract summary: We explore a different formulation for coupled systems.<n>For each subsystem type we train a neural surrogate mapping a full driving trajectory and initial condition directly to a full output trajectory.<n>Following classical waveform relaxation, coupled systems are assembled by enforcing self-consistency among these trajectories.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Numerical simulation of dynamical systems is usually organized as a causal march through time: each state is computed from the previous one. We explore a different formulation for coupled systems. For each subsystem type we train a neural surrogate mapping a full driving trajectory and initial condition directly to a full output trajectory; following classical waveform relaxation, coupled systems are assembled by enforcing self-consistency among these trajectories: simulation becomes a fixed-point problem over complete trajectories rather than a stepwise rollout. On coupled van der Pol oscillators and Hodgkin-Huxley neuron networks, sequential depth becomes the number of solver iterations: 4-10 Newton iterations where the reference integrator takes 1500 steps. The gradient likewise loses its time recursion: it becomes a linear system solved by GMRES at memory independent of solver depth. A single scalar measured from the learned operator, the spectral radius of its Jacobian, predicts in advance where the coupled solve will converge; past that boundary, unrolled backpropagation diverges and a Neumann adjoint fails, while the implicit gradient remains correct to 0.04%. We report where the approach succeeds and where surrogate error degrades it.
Related papers
- Differentiate the Solver, Not the Equation: Reverse-Sweep Adjoints for Block Implicit Simulation [28.75201832533547]
Differentiable simulation is a key component in learning, control, and inverse problems.<n>We propose solver-level differentiation, which differentiates the executed solver itself.<n>This work highlights solver structure as a practical organizing principle for efficient differentiable simulation.
arXiv Detail & Related papers (2026-08-09T08:03:02Z) - Closed-Form Spectral Regularization for Multi-Task Model Merging [96.82449201305234]
Model merging combines several independently fine-tuned experts into a single multi-task model without any training data.<n>State-of-the-art merging methods formulate merging as a layer-wise interference problem.<n>We propose SWUDI, a closed-form method that combines a soft exponential filter, which matches the gradient-flow trajectory of iterative descent.
arXiv Detail & Related papers (2026-06-05T14:00:47Z) - Controlling Transient Amplification Improves Long-horizon Rollouts [33.85418321772749]
We identify transient perturbations around rollout trajectories as a mechanism driving rollout error.<n>We propose commutativity regularization: a combination of two penalties designed to reduce the normality defect of individual Jacobians.<n>We show that the method improves FourNet climate forecasts on ERA5 without using any new data.
arXiv Detail & Related papers (2026-05-09T10:10:30Z) - Learned Lagrangian Models of PDEs via Euler-Lagrange Residual Minimization [6.069579199180933]
We present the first method to directly use a learned continuous Lagrangian to forecast the dynamics of systems governed by partial differential equations.<n>We develop an optimization-based integrator that minimizes the squared Euler-Lagrange residual.<n>We validate our approach on a learned representation of a double pendulum, a one-dimensional wave equation, and a two-dimensional wave equation.
arXiv Detail & Related papers (2026-05-08T02:43:11Z) - Disordered Dynamics in High Dimensions: Connections to Random Matrices and Machine Learning [52.26396748560348]
We provide an overview of high dimensional dynamical systems driven by random matrices.<n>We focus on applications to simple models of learning and generalization in machine learning theory.
arXiv Detail & Related papers (2026-01-03T00:12:32Z) - Continuous-Time Homeostatic Dynamics for Reentrant Inference Models [0.0]
We formulate the Fast-Weights Homeostatic Reentry Network as a continuous-time neural-ODE system.<n>The dynamics admit bounded attractors governed by an energy functional, yielding a ring-like manifold.<n>Unlike continuous-time recurrent neural networks or liquid neural networks, FHRN achieves stability through population-level gain modulation rather than fixed recurrence or neuron-local time adaptation.
arXiv Detail & Related papers (2025-12-04T07:33:13Z) - INC: An Indirect Neural Corrector for Auto-Regressive Hybrid PDE Solvers [61.84396402100827]
We propose the Indirect Neural Corrector ($mathrmINC$), which integrates learned corrections into the governing equations.<n>$mathrmINC$ reduces the error amplification on the order of $t-1 + L$, where $t$ is the timestep and $L$ the Lipschitz constant.<n>We test $mathrmINC$ in extensive benchmarks, covering numerous differentiable solvers, neural backbones, and test cases ranging from a 1D chaotic system to 3D turbulence.
arXiv Detail & Related papers (2025-11-16T20:14:28Z) - A deep solver for backward stochastic Volterra integral equations [41.99844472131922]
We present the first deep-learning solver for backward Volterra integral equations (BSVIEs) and their fully-coupled forward-backward variants.<n>The method trains a neural network to approximate the two solution fields in a single stage, avoiding the use of nested time cycles that limit classical algorithms.
arXiv Detail & Related papers (2025-05-23T18:41:54Z) - Losing momentum in continuous-time stochastic optimisation [42.617042045455506]
momentum-based optimisation algorithms have become particularly widespread.
In this work, we analyse a continuous-time model for gradient descent with momentum.
We also train a convolutional neural network in an image classification problem.
arXiv Detail & Related papers (2022-09-08T10:46:05Z) - Semi-supervised Learning of Partial Differential Operators and Dynamical
Flows [68.77595310155365]
We present a novel method that combines a hyper-network solver with a Fourier Neural Operator architecture.
We test our method on various time evolution PDEs, including nonlinear fluid flows in one, two, and three spatial dimensions.
The results show that the new method improves the learning accuracy at the time point of supervision point, and is able to interpolate and the solutions to any intermediate time.
arXiv Detail & Related papers (2022-07-28T19:59:14Z) - On optimization of coherent and incoherent controls for two-level
quantum systems [77.34726150561087]
This article considers some control problems for closed and open two-level quantum systems.
The closed system's dynamics is governed by the Schr"odinger equation with coherent control.
The open system's dynamics is governed by the Gorini-Kossakowski-Sudarshan-Lindblad master equation.
arXiv Detail & Related papers (2022-05-05T09:08:03Z) - Deep Learning Approximation of Diffeomorphisms via Linear-Control
Systems [91.3755431537592]
We consider a control system of the form $dot x = sum_i=1lF_i(x)u_i$, with linear dependence in the controls.
We use the corresponding flow to approximate the action of a diffeomorphism on a compact ensemble of points.
arXiv Detail & Related papers (2021-10-24T08:57:46Z) - DiffPD: Differentiable Projective Dynamics with Contact [65.88720481593118]
We present DiffPD, an efficient differentiable soft-body simulator with implicit time integration.
We evaluate the performance of DiffPD and observe a speedup of 4-19 times compared to the standard Newton's method in various applications.
arXiv Detail & Related papers (2021-01-15T00:13:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.