Temperature-Annealed Boltzmann Generators

• URL: http://arxiv.org/abs/2501.19077v2
• Date: Tue, 17 Jun 2025 08:15:54 GMT
• Title: Temperature-Annealed Boltzmann Generators
• Authors: Henrik Schopmans, Pascal Friederich,
• Abstract summary: Training a normalizing flow with the reverse Kullback-Leibler divergence at high temperatures is possible without mode collapse.<n>We introduce a reweighting-based training objective to anneal the distribution to lower target temperatures.<n>For the largest system, our approach is the only method that accurately resolves the metastable states of the system.
• Score: 0.6906005491572401
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Efficient sampling of unnormalized probability densities such as the Boltzmann distribution of molecular systems is a longstanding challenge. Next to conventional approaches like molecular dynamics or Markov chain Monte Carlo, variational approaches, such as training normalizing flows with the reverse Kullback-Leibler divergence, have been introduced. However, such methods are prone to mode collapse and often do not learn to sample the full configurational space. Here, we present temperature-annealed Boltzmann generators (TA-BG) to address this challenge. First, we demonstrate that training a normalizing flow with the reverse Kullback-Leibler divergence at high temperatures is possible without mode collapse. Furthermore, we introduce a reweighting-based training objective to anneal the distribution to lower target temperatures. We apply this methodology to three molecular systems of increasing complexity and, compared to the baseline, achieve better results in almost all metrics while requiring up to three times fewer target energy evaluations. For the largest system, our approach is the only method that accurately resolves the metastable states of the system.

Related papers

• FALCON: Few-step Accurate Likelihoods for Continuous Flows [78.37361800856583]
  We propose Few-step Accurate Likelihoods for Continuous Flows (FALCON), which allows for few-step sampling with a likelihood accurate enough for importance sampling applications.<n>We show FALCON outperforms state-of-the-art normalizing flow models for molecular Boltzmann sampling and is two orders of magnitude faster than the equivalently performing CNF model.
  arXiv  Detail & Related papers  (2025-12-10T18:47:25Z)
• Digitized Counterdiabatic Quantum Sampling [29.85893589594055]
  We propose a hybrid quantum-classical algorithm for efficient sampling from energy-based models, such as low-temperature Boltzmann distributions.<n>We show that classical sampling algorithms, including Metropolis-Hastings and the state-of-the-art low-temperature technique parallel tempering, require up to three orders of magnitude more samples to match the quality of DCQS.
  arXiv  Detail & Related papers  (2025-10-30T17:32:49Z)
• Learning Boltzmann Generators via Constrained Mass Transport [26.687838638430595]
  We introduce Constrained Mass Transport (CMT), a variational framework that generates intermediate distributions under constraints on both the KL divergence and the entropy decay between successive steps.<n>CMT consistently surpasses state-of-the-art variational methods, achieving more than 2.5x higher effective sample size while avoiding mode collapse.
  arXiv  Detail & Related papers  (2025-10-21T09:34:01Z)
• Amortized Sampling with Transferable Normalizing Flows [65.48838168417564]
  Prose is a transferable normalizing flow trained on a corpus of peptide molecular dynamics trajectories up to 8 residues in length.<n>We show that Prose is a proposal for a variety of sampling algorithms, finding a simple importance sampling-based finetuning procedure to achieve superior performance.<n>We open-source the Prose dataset to further stimulate research into amortized sampling methods and finetuning objectives.
  arXiv  Detail & Related papers  (2025-08-25T16:28:18Z)
• BoltzNCE: Learning Likelihoods for Boltzmann Generation with Stochastic Interpolants and Noise Contrastive Estimation [1.2874523233023452]
  Efficient sampling from the Boltzmann distribution is a key challenge for modeling complex physical systems such as molecules.<n>We train an energy-based model (EBM) to approximate likelihoods using both noise contrastive estimation (NCE) and score matching.<n>Our approach also exhibits effective transfer learning, generalizing to new systems at inference time and achieving at least a $6times$ speedup over standard MD.
  arXiv  Detail & Related papers  (2025-07-01T15:18:28Z)
• Progressive Inference-Time Annealing of Diffusion Models for Sampling from Boltzmann Densities [85.83359661628575]
  We propose Progressive Inference-Time Annealing (PITA) to learn diffusion-based samplers.<n>PITA combines two complementary techniques: Annealing of the Boltzmann distribution and Diffusion smoothing.<n>It enables equilibrium sampling of N-body particle systems, Alanine Dipeptide, and tripeptides in Cartesian coordinates.
  arXiv  Detail & Related papers  (2025-06-19T17:14:22Z)
• Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts [64.34482582690927]
  We provide an efficient and principled method for sampling from a sequence of annealed, geometric-averaged, or product distributions derived from pretrained score-based models. We propose Sequential Monte Carlo (SMC) resampling algorithms that leverage inference-time scaling to improve sampling quality.
  arXiv  Detail & Related papers  (2025-03-04T17:46:51Z)
• Scalable Equilibrium Sampling with Sequential Boltzmann Generators [60.00515282300297]
  We extend the Boltzmann generator framework and introduce Sequential Boltzmann generators with two key improvements. The first is a highly efficient non-equivariant Transformer-based normalizing flow operating directly on all-atom Cartesian coordinates. We demonstrate the first equilibrium sampling in Cartesian coordinates of tri, tetra, and hexapeptides that were so far intractable for prior Boltzmann generators.
  arXiv  Detail & Related papers  (2025-02-25T18:59:13Z)
• Squeezed Thermal Reservoir Engineering via Linear Interactions [0.16574413179773761]
  We present a versatile method for creating a squeezed thermal reservoir for quantum systems. By coupling the system to a lossy mode within a normal thermal environment, we can emulate the effect of a squeezed reservoir.
  arXiv  Detail & Related papers  (2024-08-28T18:00:01Z)
• Iterated Denoising Energy Matching for Sampling from Boltzmann Densities [109.23137009609519]
  Iterated Denoising Energy Matching (iDEM) iDEM alternates between (I) sampling regions of high model density from a diffusion-based sampler and (II) using these samples in our matching objective. We show that the proposed approach achieves state-of-the-art performance on all metrics and trains $2-5times$ faster.
  arXiv  Detail & Related papers  (2024-02-09T01:11:23Z)
• Conditional Normalizing Flows for Active Learning of Coarse-Grained Molecular Representations [0.6906005491572401]
  generative machine learning methods such as normalizing flows have been used to learn the Boltzmann distribution directly, without samples. In this work, we address this challenge by separating the problem into two levels, the fine-grained and coarse-grained degrees of freedom. To explore the configurational space, we employ coarse-grained simulations with active learning which allows us to update the flow and make all-atom potential energy evaluations only when necessary.
  arXiv  Detail & Related papers  (2024-02-02T07:44:26Z)
• Entropy production in the mesoscopic-leads formulation of quantum thermodynamics [0.0]
  entropy production of systems strongly coupled to thermal baths is a core problem of quantum thermodynamics and mesoscopic physics. Recently, the mesoscopic leads approach has emerged as a powerful method for studying such quantum systems strongly coupled to multiple thermal baths. We show numerically, that a system coupled to a single bath exhibits a thermal fixed point at the level of the embedding.
  arXiv  Detail & Related papers  (2023-12-19T19:00:04Z)
• Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes [57.396578974401734]
  We introduce a principled framework for building a generative diffusion process on general manifold. Instead of following the denoising approach of previous diffusion models, we construct a diffusion process using a mixture of bridge processes. We develop a geometric understanding of the mixture process, deriving the drift as a weighted mean of tangent directions to the data points.
  arXiv  Detail & Related papers  (2023-10-11T06:04:40Z)
• Unbiasing time-dependent Variational Monte Carlo by projected quantum evolution [44.99833362998488]
  We analyze the accuracy and sample complexity of variational Monte Carlo approaches to simulate quantum systems classically. We prove that the most used scheme, the time-dependent Variational Monte Carlo (tVMC), is affected by a systematic statistical bias. We show that a different scheme based on the solution of an optimization problem at each time step is free from such problems.
  arXiv  Detail & Related papers  (2023-05-23T17:38:10Z)
• GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation [102.85440102147267]
  We propose a novel generative model named GeoDiff for molecular conformation prediction. We show that GeoDiff is superior or comparable to existing state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-03-06T09:47:01Z)
• Particle Dynamics for Learning EBMs [83.59335980576637]
  Energy-based modeling is a promising approach to unsupervised learning, which yields many downstream applications from a single model. The main difficulty in learning energy-based models with the "contrastive approaches" is the generation of samples from the current energy function at each iteration. This paper proposes an alternative approach to getting these samples and avoiding crude MCMC sampling from the current model.
  arXiv  Detail & Related papers  (2021-11-26T23:41:07Z)
• Entropy Production and the Role of Correlations in Quantum Brownian Motion [77.34726150561087]
  We perform a study on quantum entropy production, different kinds of correlations, and their interplay in the driven Caldeira-Leggett model of quantum Brownian motion.
  arXiv  Detail & Related papers  (2021-08-05T13:11:05Z)
• Thermal rectification through a nonlinear quantum resonator [0.0]
  We identify necessary conditions to observe thermal rectification in a low-dimensional quantum system. We show how the Lamb shift can be exploited to enhance rectification. We find that the strong coupling regime allows us to violate the bounds derived in the weak-coupling regime.
  arXiv  Detail & Related papers  (2021-01-26T11:55:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.