Transition Path Sampling with Improved Off-Policy Training of Diffusion Path Samplers

• URL: http://arxiv.org/abs/2405.19961v5
• Date: Sat, 25 Jan 2025 08:33:55 GMT
• Title: Transition Path Sampling with Improved Off-Policy Training of Diffusion Path Samplers
• Authors: Kiyoung Seong, Seonghyun Park, Seonghwan Kim, Woo Youn Kim, Sungsoo Ahn,
• Abstract summary: We introduce a novel approach that trains diffusion path samplers (DPS) to address the transition path sampling problem. We reformulate the problem as an amortized sampling from the transition path distribution by minimizing the log-variance divergence between the path distribution induced by DPS and the transition path distribution. We extensively evaluate our approach, termed TPS-DPS, on a synthetic system, small peptide, and challenging fast-folding proteins, demonstrating that it produces more realistic and diverse transition pathways than existing baselines.
• Score: 10.210248065533133
• License:
• Abstract: Understanding transition pathways between two meta-stable states of a molecular system is crucial to advance drug discovery and material design. However, unbiased molecular dynamics (MD) simulations are computationally infeasible because of the high energy barriers that separate these states. Although recent machine learning techniques are proposed to sample rare events, they are often limited to simple systems and rely on collective variables (CVs) derived from costly domain expertise. In this paper, we introduce a novel approach that trains diffusion path samplers (DPS) to address the transition path sampling (TPS) problem without requiring CVs. We reformulate the problem as an amortized sampling from the transition path distribution by minimizing the log-variance divergence between the path distribution induced by DPS and the transition path distribution. Based on the log-variance divergence, we propose learnable control variates to reduce the variance of gradient estimators and the off-policy training objective with replay buffers and simulated annealing techniques to improve sample efficiency and diversity. We also propose a scale-based equivariant parameterization of the bias forces to ensure scalability for large systems. We extensively evaluate our approach, termed TPS-DPS, on a synthetic system, small peptide, and challenging fast-folding proteins, demonstrating that it produces more realistic and diverse transition pathways than existing baselines.

Related papers

• Variational Schrödinger Momentum Diffusion [15.074672636555755]
  We introduce variational Schr"odinger momentum diffusion (VSMD) to eliminate the dependence on simulated forward trajectories. Our approach scales effectively to real-world data, achieving competitive results in time series and image generation.
  arXiv  Detail & Related papers  (2025-01-28T03:19:58Z)
• Sequential Controlled Langevin Diffusions [80.93988625183485]
  Two popular methods are (1) Sequential Monte Carlo (SMC), where the transport is performed through successive densities via prescribed Markov chains and resampling steps, and (2) recently developed diffusion-based sampling methods, where a learned dynamical transport is used. We present a principled framework for combining SMC with diffusion-based samplers by viewing both methods in continuous time and considering measures on path space. This culminates in the new Sequential Controlled Langevin Diffusion (SCLD) sampling method, which is able to utilize the benefits of both methods and reaches improved performance on multiple benchmark problems, in many cases using only 10% of the training budget of previous diffusion-
  arXiv  Detail & Related papers  (2024-12-10T00:47:10Z)
• Amortized Posterior Sampling with Diffusion Prior Distillation [55.03585818289934]
  We propose a variational inference approach to sample from the posterior distribution for solving inverse problems. We show that our method is applicable to standard signals in Euclidean space, as well as signals on manifold.
  arXiv  Detail & Related papers  (2024-07-25T09:53:12Z)
• Dynamical Measure Transport and Neural PDE Solvers for Sampling [77.38204731939273]
  We tackle the task of sampling from a probability density as transporting a tractable density function to the target. We employ physics-informed neural networks (PINNs) to approximate the respective partial differential equations (PDEs) solutions. PINNs allow for simulation- and discretization-free optimization and can be trained very efficiently.
  arXiv  Detail & Related papers  (2024-07-10T17:39:50Z)
• Diffusion Methods for Generating Transition Paths [6.222135766747873]
  In this work, we seek to simulate rare transitions between metastable states using score-based generative models. We develop two novel methods for path generation in this paper: a chain-based approach and a midpoint-based approach. Numerical results of generated transition paths for the M"uller potential and for Alanine dipeptide demonstrate the effectiveness of these approaches in both the data-rich and data-scarce regimes.
  arXiv  Detail & Related papers  (2023-09-19T03:03:03Z)
• Efficient Multimodal Sampling via Tempered Distribution Flow [11.36635610546803]
  We develop a new type of transport-based sampling method called TemperFlow. Various experiments demonstrate the superior performance of this novel sampler compared to traditional methods. We show its applications in modern deep learning tasks such as image generation.
  arXiv  Detail & Related papers  (2023-04-08T06:40:06Z)
• Enhanced Sampling of Configuration and Path Space in a Generalized Ensemble by Shooting Point Exchange [71.49868712710743]
  We propose a new approach to simulate rare events caused by transitions between long-lived states. The scheme substantially enhances the efficiency of the transition path sampling simulations. It yields information on thermodynamics, kinetics and reaction coordinates of molecular processes without distorting their dynamics.
  arXiv  Detail & Related papers  (2023-02-17T08:41:31Z)
• Conditioning Normalizing Flows for Rare Event Sampling [61.005334495264194]
  We propose a transition path sampling scheme based on neural-network generated configurations. We show that this approach enables the resolution of both the thermodynamics and kinetics of the transition region.
  arXiv  Detail & Related papers  (2022-07-29T07:56:10Z)
• Stochastic Optimal Control for Collective Variable Free Sampling of Molecular Transition Paths [60.254555533113674]
  We consider the problem of sampling transition paths between two given metastable states of a molecular system. We propose a machine learning method for sampling said transitions.
  arXiv  Detail & Related papers  (2022-06-27T14:01:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.