Critically-Damped Higher-Order Langevin Dynamics

• URL: http://arxiv.org/abs/2506.21741v1
• Date: Thu, 26 Jun 2025 19:50:53 GMT
• Title: Critically-Damped Higher-Order Langevin Dynamics
• Authors: Benjamin Sterling, Chad Gueli, Mónica F. Bugallo,
• Abstract summary: Critical damping has been successfully introduced in Critically-Damped Langevin Dynamics (CLD) and Critically-Damped Third-Order Langevin Dynamics (TOLD++)<n>The proposed line of work generalizes Higher-Order Langevin Dynamics (HOLD), a recent state-of-the-art diffusion method, by introducing the concept of critical damping from systems analysis.
• Score: 6.259381563339797
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Denoising Diffusion Probabilistic Models represent an entirely new class of generative AI methods that have yet to be fully explored. Critical damping has been successfully introduced in Critically-Damped Langevin Dynamics (CLD) and Critically-Damped Third-Order Langevin Dynamics (TOLD++), but has not yet been applied to dynamics of arbitrary order. The proposed line of work generalizes Higher-Order Langevin Dynamics (HOLD), a recent state-of-the-art diffusion method, by introducing the concept of critical damping from systems analysis.

Related papers

• Langevin Flows for Modeling Neural Latent Dynamics [81.81271685018284]
  We introduce LangevinFlow, a sequential Variational Auto-Encoder where the time evolution of latent variables is governed by the underdamped Langevin equation.<n>Our approach incorporates physical priors -- such as inertia, damping, a learned potential function, and forces -- to represent both autonomous and non-autonomous processes in neural systems.<n>Our method outperforms state-of-the-art baselines on synthetic neural populations generated by a Lorenz attractor.
  arXiv  Detail & Related papers  (2025-07-15T17:57:48Z)
• Advanced long-term earth system forecasting by learning the small-scale nature [74.19833913539053]
  We present Triton, an AI framework designed to address this fundamental challenge.<n>Inspired by increasing grids to explicitly resolve small scales in numerical models, Triton employs a hierarchical architecture processing information across multiple resolutions to mitigate spectral bias.<n>We demonstrate Triton's superior performance on challenging forecast tasks, achieving stable year-long global temperature forecasts, skillful Kuroshio eddy predictions till 120 days, and high-fidelity turbulence simulations.
  arXiv  Detail & Related papers  (2025-05-26T02:49:00Z)
• Generative emulation of chaotic dynamics with coherent prior [0.129182926254119]
  We present an efficient generative framework for dynamics emulation, unifying principles of turbulence with diffusion-based modeling: Cohesion.<n>Specifically, our method estimates large-scale coherent structure of the underlying dynamics as guidance during the denoising process.<n>Cohesion superior long-range forecasting skill can efficiently generate physically-consistent simulations, even in the presence of partially-observed guidance.
  arXiv  Detail & Related papers  (2025-04-19T11:14:40Z)
• Critically Damped Third-Order Langevin Dynamics [0.0]
  This work describes a novel improvement to Third- Order Langevin Dynamics (TOLD) It is carried out by critically damping the TOLD forward transition matrix similarly to Dockhorn's Critically-Damped Langevin Dynamics (CLD)
  arXiv  Detail & Related papers  (2024-09-12T01:59:58Z)
• Unfolding Time: Generative Modeling for Turbulent Flows in 4D [49.843505326598596]
  This work introduces a 4D generative diffusion model and a physics-informed guidance technique that enables the generation of realistic sequences of flow states. Our findings indicate that the proposed method can successfully sample entire subsequences from the turbulent manifold. This advancement opens doors for the application of generative modeling in analyzing the temporal evolution of turbulent flows.
  arXiv  Detail & Related papers  (2024-06-17T10:21:01Z)
• Convergence of mean-field Langevin dynamics: Time and space discretization, stochastic gradient, and variance reduction [49.66486092259376]
  The mean-field Langevin dynamics (MFLD) is a nonlinear generalization of the Langevin dynamics that incorporates a distribution-dependent drift. Recent works have shown that MFLD globally minimizes an entropy-regularized convex functional in the space of measures. We provide a framework to prove a uniform-in-time propagation of chaos for MFLD that takes into account the errors due to finite-particle approximation, time-discretization, and gradient approximation.
  arXiv  Detail & Related papers  (2023-06-12T16:28:11Z)
• Convex Analysis of the Mean Field Langevin Dynamics [49.66486092259375]
  convergence rate analysis of the mean field Langevin dynamics is presented. $p_q$ associated with the dynamics allows us to develop a convergence theory parallel to classical results in convex optimization.
  arXiv  Detail & Related papers  (2022-01-25T17:13:56Z)
• Neural Ordinary Differential Equations for Data-Driven Reduced Order Modeling of Environmental Hydrodynamics [4.547988283172179]
  We explore the use of Neural Ordinary Differential Equations for fluid flow simulation. Test problems we consider include incompressible flow around a cylinder and real-world applications of shallow water hydrodynamics in riverine and estuarine systems. Our findings indicate that Neural ODEs provide an elegant framework for stable and accurate evolution of latent-space dynamics with a promising potential of extrapolatory predictions.
  arXiv  Detail & Related papers  (2021-04-22T19:20:47Z)
• Fast Mixing of Multi-Scale Langevin Dynamics under the Manifold Hypothesis [85.65870661645823]
  We show how the Langevin dimension algorithm allows for the considerable reduction of time depending on the (much) smaller data. Second, the high of the sampling space significantly hurts the performance of Langevin Dynamics.
  arXiv  Detail & Related papers  (2020-06-19T14:52:40Z)
• Non-Convex Optimization via Non-Reversible Stochastic Gradient Langevin Dynamics [27.097121544378528]
  Gradient Langevin Dynamics (SGLD) is a powerful algorithm for optimizing a non- objective gradient. NSGLD is based on discretization of the non-reversible diffusion.
  arXiv  Detail & Related papers  (2020-04-06T17:11:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.