Emergence of Nonequilibrium Latent Cycles in Unsupervised Generative Modeling

• URL: http://arxiv.org/abs/2512.11415v1
• Date: Fri, 12 Dec 2025 09:48:08 GMT
• Title: Emergence of Nonequilibrium Latent Cycles in Unsupervised Generative Modeling
• Authors: Marco Baiesi, Alberto Rosso,
• Abstract summary: We show that nonequilibrium dynamics can play a constructive role in unsupervised machine learning by inducing the spontaneous emergence of latent-state cycles.<n>We introduce a model in which visible and hidden variables interact through two independently parametrized transition matrices.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We show that nonequilibrium dynamics can play a constructive role in unsupervised machine learning by inducing the spontaneous emergence of latent-state cycles. We introduce a model in which visible and hidden variables interact through two independently parametrized transition matrices, defining a Markov chain whose steady state is intrinsically out of equilibrium. Likelihood maximization drives this system toward nonequilibrium steady states with finite entropy production, reduced self-transition probabilities, and persistent probability currents in the latent space. These cycles are not imposed by the architecture but arise from training, and models that develop them avoid the low-log-likelihood regime associated with nearly reversible dynamics while more faithfully reproducing the empirical distribution of data classes. Compared with equilibrium approaches such as restricted Boltzmann machines, our model breaks the detailed balance between the forward and backward conditional transitions and relies on a log-likelihood gradient that depends explicitly on the last two steps of the Markov chain. Hence, this exploration of the interface between nonequilibrium statistical physics and modern machine learning suggests that introducing irreversibility into latent-variable models can enhance generative performance.

Related papers

• KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra [65.11254608352982]
  We introduce a generator-based neural Koopman framework that models dynamics through a structured, state-dependent representation of Koopman generators.<n>By exploiting the intrinsic Cartesian decomposition into skew-adjoint and self-adjoint components, KoopGen separates conservative transport from irreversible dissipation.
  arXiv  Detail & Related papers  (2026-02-15T06:32:23Z)
• On Forgetting and Stability of Score-based Generative models [6.259598237089842]
  Understanding the stability and long-time behavior of generative models is a fundamental problem in modern machine learning.<n>This paper provides quantitative bounds on the sampling error of score-based generative models by leveraging stability and forgetting properties of the Markov chain associated with the reverse-time dynamics.
  arXiv  Detail & Related papers  (2026-01-29T15:37:50Z)
• Identifiable learning of dissipative dynamics [25.409059056398124]
  We introduce I-OnsagerNet, a neural framework that learns dissipative dynamics directly from trajectories.<n>I-OnsagerNet extends the Onsager principle to guarantee that the learned potential is obtained from the stationary density.<n>Our approach enables us to calculate the entropy production and to quantify irreversibility, offering a principled way to detect and quantify deviations from equilibrium.
  arXiv  Detail & Related papers  (2025-10-28T07:57:14Z)
• Drift No More? Context Equilibria in Multi-Turn LLM Interactions [58.69551510148673]
  contexts drift is the gradual divergence of a model's outputs from goal-consistent behavior across turns.<n>Unlike single-turn errors, drift unfolds temporally and is poorly captured by static evaluation metrics.<n>We show that multi-turn drift can be understood as a controllable equilibrium phenomenon rather than as inevitable decay.
  arXiv  Detail & Related papers  (2025-10-09T04:48:49Z)
• Critical dynamics and superconducting state preparation in the quenched Kitaev chain with pairing imbalance [0.0]
  The balance of the pairing term plays a crucial role in the emergence of topological superconductivity in the p-wave spinless Kitaev chain.<n>We investigate the effects of non-Hermitian pairing terms on both equilibrium and nonequilibrium phenomena in the Kitaev chain.
  arXiv  Detail & Related papers  (2025-09-25T20:28:58Z)
• Generative System Dynamics in Recurrent Neural Networks [56.958984970518564]
  We investigate the continuous time dynamics of Recurrent Neural Networks (RNNs)<n>We show that skew-symmetric weight matrices are fundamental to enable stable limit cycles in both linear and nonlinear configurations.<n> Numerical simulations showcase how nonlinear activation functions not only maintain limit cycles, but also enhance the numerical stability of the system integration process.
  arXiv  Detail & Related papers  (2025-04-16T10:39:43Z)
• Probing non-equilibrium dissipative phase transitions with trapped-ion quantum simulators [0.5356944479760104]
  Open quantum many-body systems with controllable dissipation can exhibit novel features in their dynamics and steady states. We show that strong signatures of this dissipative phase transition and its non-equilibrium properties can be observed with a small system size. Dissipation engineered in this way may allow the simulation of more general types of driven-dissipative systems.
  arXiv  Detail & Related papers  (2023-11-10T17:31:00Z)
• The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability [6.4322891559626125]
  We show that generative diffusion models undergo second-order phase transitions corresponding to universality breaking phenomena. We argue that the critical instability that arises from the phase transitions lies at the heart of their generative capabilities.
  arXiv  Detail & Related papers  (2023-10-26T15:15:01Z)
• Sufficient condition for gapless spin-boson Lindbladians, and its connection to dissipative time-crystals [64.76138964691705]
  We discuss a sufficient condition for gapless excitations in the Lindbladian master equation for collective spin-boson systems. We argue that gapless modes can lead to persistent dynamics in the spin observables with the possible formation of dissipative time-crystals.
  arXiv  Detail & Related papers  (2022-09-26T18:34:59Z)
• Non-equilibrium non-Markovian steady-states in open quantum many-body systems: Persistent oscillations in Heisenberg quantum spin chains [68.8204255655161]
  We investigate the effect of a non-Markovian, structured reservoir on an open Heisenberg spin chain. We establish a coherent self-feedback mechanism as the reservoir couples frequency-dependent to the spin chain.
  arXiv  Detail & Related papers  (2020-06-05T09:16:28Z)
• Deep Variational Luenberger-type Observer for Stochastic Video Prediction [46.82873654555665]
  We study the problem of video prediction by combining interpretability of state space models and representation of deep neural networks. Our model builds upon an variational encoder which transforms the input video into a latent feature space and a Luenberger-type observer which captures the dynamic evolution of the latent features.
  arXiv  Detail & Related papers  (2020-02-12T06:59:04Z)
• Distributing entanglement with separable states: assessment of encoding and decoding imperfections [55.41644538483948]
  Entanglement can be distributed using a carrier which is always separable from the rest of the systems involved. We consider the effect of incoherent dynamics acting alongside imperfect unitary interactions. We show that entanglement gain is possible even with substantial unitary errors.
  arXiv  Detail & Related papers  (2020-02-11T15:25:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.