Predicting the Energy Landscape of Stochastic Dynamical System via Physics-informed Self-supervised Learning

• URL: http://arxiv.org/abs/2502.16828v1
• Date: Mon, 24 Feb 2025 04:26:26 GMT
• Title: Predicting the Energy Landscape of Stochastic Dynamical System via Physics-informed Self-supervised Learning
• Authors: Ruikun Li, Huandong Wang, Qingmin Liao, Yong Li,
• Abstract summary: Energy landscapes play a crucial role in shaping dynamics of many real-world complex systems.<n>We propose a physics-informed self-supervised learning method to learn the energy landscape from the evolution trajectories of the system.
• Score: 27.544116710935278
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Energy landscapes play a crucial role in shaping dynamics of many real-world complex systems. System evolution is often modeled as particles moving on a landscape under the combined effect of energy-driven drift and noise-induced diffusion, where the energy governs the long-term motion of the particles. Estimating the energy landscape of a system has been a longstanding interdisciplinary challenge, hindered by the high operational costs or the difficulty of obtaining supervisory signals. Therefore, the question of how to infer the energy landscape in the absence of true energy values is critical. In this paper, we propose a physics-informed self-supervised learning method to learn the energy landscape from the evolution trajectories of the system. It first maps the system state from the observation space to a discrete landscape space by an adaptive codebook, and then explicitly integrates energy into the graph neural Fokker-Planck equation, enabling the joint learning of energy estimation and evolution prediction. Experimental results across interdisciplinary systems demonstrate that our estimated energy has a correlation coefficient above 0.9 with the ground truth, and evolution prediction accuracy exceeds the baseline by an average of 17.65\%. The code is available at github.com/tsinghua-fib-lab/PESLA.

Related papers

• Energy Loss Functions for Physical Systems [16.10782090682612]
  We propose a framework to leverage physical information directly into the loss function for prediction and generative modeling tasks.<n>We demonstrate our approach on molecular generation and spin ground-state prediction and report significant improvements over baselines.
  arXiv  Detail & Related papers  (2025-11-03T21:58:36Z)
• Learning with springs and sticks [6.765839157891597]
  We study a simple dynamical system composed of springs and sticks capable of arbitrarily approximating any continuous function.<n>We apply the proposed simulation system to regression tasks and show that its performance is comparable to that of multi-layer perceptrons.<n>We empirically find a emphthermodynamic learning barrier for the system caused by the fluctuations of the environment.
  arXiv  Detail & Related papers  (2025-08-26T13:26:26Z)
• The Work Capacity of Channels with Memory: Maximum Extractable Work in Percept-Action Loops [0.5999777817331317]
  We analyze the thermodynamics of information processing in percept-action loops. We introduce the concept of work capacity -- the maximum rate at which an agent can expect to extract work from its environment.
  arXiv  Detail & Related papers  (2025-04-08T16:54:20Z)
• Pioneer: Physics-informed Riemannian Graph ODE for Entropy-increasing Dynamics [61.70424540412608]
  We present a physics-informed graph ODE for a wide range of entropy-increasing dynamic systems.<n>We report the provable entropy non-decreasing of our formulation, obeying the physics laws.<n> Empirical results show the superiority of Pioneer on real datasets.
  arXiv  Detail & Related papers  (2025-02-05T14:54:30Z)
• Learning System Dynamics without Forgetting [60.08612207170659]
  Predicting trajectories of systems with unknown dynamics is crucial in various research fields, including physics and biology. We present a novel framework of Mode-switching Graph ODE (MS-GODE), which can continually learn varying dynamics. We construct a novel benchmark of biological dynamic systems, featuring diverse systems with disparate dynamics.
  arXiv  Detail & Related papers  (2024-06-30T14:55:18Z)
• Learning Iterative Reasoning through Energy Diffusion [90.24765095498392]
  We introduce iterative reasoning through energy diffusion (IRED), a novel framework for learning to reason for a variety of tasks. IRED learns energy functions to represent the constraints between input conditions and desired outputs. We show IRED outperforms existing methods in continuous-space reasoning, discrete-space reasoning, and planning tasks.
  arXiv  Detail & Related papers  (2024-06-17T03:36:47Z)
• TANGO: Time-Reversal Latent GraphODE for Multi-Agent Dynamical Systems [43.39754726042369]
  We propose a simple-yet-effective self-supervised regularization term as a soft constraint that aligns the forward and backward trajectories predicted by a continuous graph neural network-based ordinary differential equation (GraphODE) It effectively imposes time-reversal symmetry to enable more accurate model predictions across a wider range of dynamical systems under classical mechanics. Experimental results on a variety of physical systems demonstrate the effectiveness of our proposed method.
  arXiv  Detail & Related papers  (2023-10-10T08:52:16Z)
• Energy Transformer [64.22957136952725]
  Our work combines aspects of three promising paradigms in machine learning, namely, attention mechanism, energy-based models, and associative memory. We propose a novel architecture, called the Energy Transformer (or ET for short), that uses a sequence of attention layers that are purposely designed to minimize a specifically engineered energy function.
  arXiv  Detail & Related papers  (2023-02-14T18:51:22Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• The problem of engines in statistical physics [62.997667081978825]
  Engines are open systems that can generate work cyclically, at the expense of an external disequilibrium. Recent advances in the theory of open quantum systems point to a more realistic description of autonomous engines. We show how the external loading force and the thermal noise may be incorporated into the relevant equations of motion.
  arXiv  Detail & Related papers  (2021-08-17T03:59:09Z)
• Forced Variational Integrator Networks for Prediction and Control of Mechanical Systems [7.538482310185133]
  We show that forced variational integrator networks (FVIN) architecture allows us to accurately account for energy dissipation and external forcing. This can result in highly-data efficient model-based control and can predict on real non-conservative systems.
  arXiv  Detail & Related papers  (2021-06-05T21:39:09Z)
• Wave Propagation of Visual Stimuli in Focus of Attention [77.4747032928547]
  Fast reactions to changes in the surrounding visual environment require efficient attention mechanisms to reallocate computational resources to most relevant locations in the visual field. We present a biologically-plausible model of focus of attention that exhibits effectiveness and efficiency exhibited by foveated animals.
  arXiv  Detail & Related papers  (2020-06-19T09:33:21Z)
• Dissipative SymODEN: Encoding Hamiltonian Dynamics with Dissipation and Control into Deep Learning [9.811643357656196]
  We introduce Dissipative SymODEN, a deep learning architecture which can infer the dynamics of a physical system with dissipation from observed state trajectories. Dissipative SymODEN encodes the port-Hamiltonian dynamics with energy dissipation and external input into the design of its graph and learns the dynamics in a structured way.
  arXiv  Detail & Related papers  (2020-02-20T16:44:10Z)
• Scale bridging materials physics: Active learning workflows and integrable deep neural networks for free energy function representations in alloys [0.0]
  In mechano-chemically interacting materials systems, even consideration of only compositions, order parameters and strains can render the free energy to be reasonably high-dimensional. In proposing the free energy as a paradigm for scale bridging, we have previously exploited neural networks for their representation of such high-dimensional functions. We have developed an integrable deep neural network (IDNN) that can be trained to free energy derivative data obtained from atomic scale models and statistical mechanics, then analytically integrated to recover a free energy density function.
  arXiv  Detail & Related papers  (2020-01-30T03:59:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.