Learning Stochastic Hamiltonian Systems via Stochastic Generating Function Neural Network

• URL: http://arxiv.org/abs/2507.14467v1
• Date: Sat, 19 Jul 2025 03:59:04 GMT
• Title: Learning Stochastic Hamiltonian Systems via Stochastic Generating Function Neural Network
• Authors: Chen Chen, Lijin Wang, Yanzhao Cao, Xupeng Cheng,
• Abstract summary: We propose a novel neural network model for learning Hamiltonian systems (SHSs) from observational data, termed the generating function network (SGFNN)<n>SGFNN preserves the symplectic structure of the underlying Hamiltonian system and produces symplectic predictions.<n>Compared with the benchmark neural flow map learning (sFML) neural network, our SGFNN model exhibits higher accuracy across various prediction metrics.
• Score: 4.43407215715316
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper we propose a novel neural network model for learning stochastic Hamiltonian systems (SHSs) from observational data, termed the stochastic generating function neural network (SGFNN). SGFNN preserves symplectic structure of the underlying stochastic Hamiltonian system and produces symplectic predictions. Our model utilizes the autoencoder framework to identify the randomness of the latent system by the encoder network, and detects the stochastic generating function of the system through the decoder network based on the random variables extracted from the encoder. Symplectic predictions can then be generated by the stochastic generating function. Numerical experiments are performed on several stochastic Hamiltonian systems, varying from additive to multiplicative, and from separable to non-separable SHSs with single or multiple noises. Compared with the benchmark stochastic flow map learning (sFML) neural network, our SGFNN model exhibits higher accuracy across various prediction metrics, especially in long-term predictions, with the property of maintaining the symplectic structure of the underlying SHSs.

Related papers

• A Novel Framework for Learning Stochastic Representations for Sequence Generation and Recognition [0.0]
  The ability to generate and recognize sequential data is fundamental for autonomous systems operating in dynamic environments.<n>We propose a novel Recurrent Network with Parametric Biases (RNNPB)<n>Our approach provides a framework for modeling temporal patterns and advances the development of robust and systems in artificial intelligence and robotics.
  arXiv  Detail & Related papers  (2024-12-30T07:27:50Z)
• Reproduction of AdEx dynamics on neuromorphic hardware through data embedding and simulation-based inference [0.8437187555622164]
  We use an autoencoder to automatically extract relevant features from the membrane trace of a complex neuron model.<n>We then leverage sequential neural posterior estimation to approximate the posterior distribution of neuron parameters.<n>This suggests that the combination of an autoencoder with the SNPE algorithm is a promising optimization method for complex systems.
  arXiv  Detail & Related papers  (2024-12-03T13:19:21Z)
• Enhancing lattice kinetic schemes for fluid dynamics with Lattice-Equivariant Neural Networks [79.16635054977068]
  We present a new class of equivariant neural networks, dubbed Lattice-Equivariant Neural Networks (LENNs) Our approach develops within a recently introduced framework aimed at learning neural network-based surrogate models Lattice Boltzmann collision operators. Our work opens towards practical utilization of machine learning-augmented Lattice Boltzmann CFD in real-world simulations.
  arXiv  Detail & Related papers  (2024-05-22T17:23:15Z)
• Modeling Unknown Stochastic Dynamical System via Autoencoder [3.5489676012585236]
  We present a numerical method to learn an accurate predictive model for an unknown dynamical system from its trajectory data.<n>It employs the idea of autoencoder to identify the unobserved latent random variables.<n>It is also applicable to systems driven by non-Gaussian noises.
  arXiv  Detail & Related papers  (2023-12-15T18:19:22Z)
• How neural networks learn to classify chaotic time series [77.34726150561087]
  We study the inner workings of neural networks trained to classify regular-versus-chaotic time series. We find that the relation between input periodicity and activation periodicity is key for the performance of LKCNN models.
  arXiv  Detail & Related papers  (2023-06-04T08:53:27Z)
• Capturing dynamical correlations using implicit neural representations [85.66456606776552]
  We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data. In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
  arXiv  Detail & Related papers  (2023-04-08T07:55:36Z)
• Permutation Equivariant Neural Functionals [92.0667671999604]
  This work studies the design of neural networks that can process the weights or gradients of other neural networks. We focus on the permutation symmetries that arise in the weights of deep feedforward networks because hidden layer neurons have no inherent order. In our experiments, we find that permutation equivariant neural functionals are effective on a diverse set of tasks.
  arXiv  Detail & Related papers  (2023-02-27T18:52:38Z)
• Learning Stochastic Dynamics with Statistics-Informed Neural Network [0.4297070083645049]
  We introduce a machine-learning framework named statistics-informed neural network (SINN) for learning dynamics from data. We devise mechanisms for training the neural network model to reproduce the correct emphstatistical behavior of a target process. We show that the obtained reduced-order model can be trained on temporally coarse-grained data and hence is well suited for rare-event simulations.
  arXiv  Detail & Related papers  (2022-02-24T18:21:01Z)
• Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systems [12.319812075685956]
  We combine the advances in both deep generative models and state space model (SSM) to come up with a novel, data-driven deep probabilistic sequence model. Specially, we follow the popular encoder-decoder generative structure to build the recurrent neural networks (RNN) assisted variational sequence model. In order to alleviate the issue of inconsistency between training and predicting, we (i) propose using a hybrid output as input at next time step, which brings training and predicting into alignment.
  arXiv  Detail & Related papers  (2021-06-03T23:41:11Z)
• Connecting Weighted Automata, Tensor Networks and Recurrent Neural Networks through Spectral Learning [58.14930566993063]
  We present connections between three models used in different research fields: weighted finite automata(WFA) from formal languages and linguistics, recurrent neural networks used in machine learning, and tensor networks. We introduce the first provable learning algorithm for linear 2-RNN defined over sequences of continuous vectors input.
  arXiv  Detail & Related papers  (2020-10-19T15:28:00Z)
• Stochastic Markov Gradient Descent and Training Low-Bit Neural Networks [77.34726150561087]
  We introduce Gradient Markov Descent (SMGD), a discrete optimization method applicable to training quantized neural networks. We provide theoretical guarantees of algorithm performance as well as encouraging numerical results.
  arXiv  Detail & Related papers  (2020-08-25T15:48:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.