Stochastic Control Policies for Robust Molecular Transition Path Sampling

• URL: http://arxiv.org/abs/2608.13800v1
• Date: Thu, 13 Aug 2026 22:07:59 GMT
• Title: Stochastic Control Policies for Robust Molecular Transition Path Sampling
• Abstract summary: Transition path sampling (TPS) aims to efficiently generate rare molecular transition trajectories between metastable states.<n>We develop two proposal policies: FS-TPS, which directly parameterizes a state-dependent distribution over the control policy output, and LaS-TPS, which decodes it into structured, cross-atom-correlated force variation.<n>We conduct extensive multi-seed experiments on three biomolecular systems of increasing size: alanine dipeptide, chignolin, and BBL, a fast-folding protein.
• Score: 10.14347730979027
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Transition path sampling (TPS) aims to efficiently generate rare molecular transition trajectories between metastable states and is essential for understanding biomolecular mechanisms. Beyond traditional molecular dynamics (MD)-based sampling, machine learning has become central to state-of-the-art TPS. One major class of methods learns control forces during explicit MD rollouts. By preserving the underlying molecular dynamics, these methods tend to produce more physically plausible trajectories than endpoint-conditioned generators that construct paths directly. However, rollout-based control methods have been reported to exhibit unstable and strongly seed-dependent performance. We recast rollout-based control as learning a path-space proposal distribution and investigate stochasticity placement as a design choice for improving exploration and optimization robustness. We develop two stochastic policies: FS-TPS, which directly parameterizes a state-dependent Gaussian distribution over the control policy output, and LaS-TPS, which samples a compact latent control variable and decodes it into structured, cross-atom-correlated force variation. We conduct extensive multi-seed experiments on three biomolecular systems of increasing size: alanine dipeptide, chignolin, and BBL, a fast-folding protein. Stochastic policies consistently improve transition success and path quality over deterministic-policy baselines while substantially reducing sensitivity to random initialization.

Related papers

• From Noise to Control: Parameterized Diffusion Policies [54.941343992110426]
  We propose a framework for learning diffusion policies conditioned on continuous parameters embedded in a learned behavior manifold.<n>Our approach enables smooth distances between known strategies and efficient adaptation to novel constraints without updating policy weights.
  arXiv  Detail & Related papers  (2026-05-29T20:21:50Z)
• Iterative Refinement of Flow Policies in Probability Space for Online Reinforcement Learning [56.47948583452555]
  We introduce the Stepwise Flow Policy (SWFP) framework, founded on the key insight that discretizing the flow matching inference process via a fixed-step Euler scheme aligns it with the variational Jordan-Kinderlehrer-Otto principle from optimal transport.<n>SWFP decomposes the global flow into a sequence of small, incremental transformations between proximate distributions.<n>This decomposition yields an efficient algorithm that fine-tunes pre-trained flows via a cascade of small flow blocks, offering significant advantages.
  arXiv  Detail & Related papers  (2025-10-17T07:43:51Z)
• Follow the MEP: Scalable Neural Representations for Minimum-Energy Path Discovery in Molecular Systems [6.257560917160816]
  We present a method that reformulates MEP discovery as a fast and scalable neural optimization problem.<n>We demonstrate this approach on two proteins, including an explicitly hydrated BPTI system with more than 3,500 atoms.
  arXiv  Detail & Related papers  (2025-04-23T03:02:29Z)
• Conditional Synthesis of 3D Molecules with Time Correction Sampler [58.0834973489875]
  Time-Aware Conditional Synthesis (TACS) is a novel approach to conditional generation on diffusion models. It integrates adaptively controlled plug-and-play "online" guidance into a diffusion model, driving samples toward the desired properties.
  arXiv  Detail & Related papers  (2024-11-01T12:59:25Z)
• Transition Path Sampling with Improved Off-Policy Training of Diffusion Path Samplers [10.210248065533133]
  We introduce a novel approach that trains diffusion path samplers (DPS) to address the transition path sampling problem.<n>We reformulate the problem as an amortized sampling from the transition path distribution by minimizing the log-variance divergence between the path distribution induced by DPS and the transition path distribution.<n>We extensively evaluate our approach, termed TPS-DPS, on a synthetic system, small peptide, and challenging fast-folding proteins, demonstrating that it produces more realistic and diverse transition pathways than existing baselines.
  arXiv  Detail & Related papers  (2024-05-30T11:32:42Z)
• Molecule Design by Latent Prompt Transformer [76.2112075557233]
  This work explores the challenging problem of molecule design by framing it as a conditional generative modeling task. We propose a novel generative model comprising three components: (1) a latent vector with a learnable prior distribution; (2) a molecule generation model based on a causal Transformer, which uses the latent vector as a prompt; and (3) a property prediction model that predicts a molecule's target properties and/or constraint values using the latent prompt.
  arXiv  Detail & Related papers  (2024-02-27T03:33:23Z)
• Augmenting Control over Exploration Space in Molecular Dynamics Simulators to Streamline De Novo Analysis through Generative Control Policies [0.0]
  This study introduces the P5 model - a foundational method that utilizes reinforcement learning (RL) to augment control, effectiveness, and scalability in molecular dynamics simulations (MD) Our innovative strategy optimize the sampling of target polymer chain conformations, marking an efficiency improvement of over 37.1%.
  arXiv  Detail & Related papers  (2023-06-26T13:54:52Z)
• Stochastic Optimal Control for Collective Variable Free Sampling of Molecular Transition Paths [60.254555533113674]
  We consider the problem of sampling transition paths between two given metastable states of a molecular system. We propose a machine learning method for sampling said transitions.
  arXiv  Detail & Related papers  (2022-06-27T14:01:06Z)
• Generative methods for sampling transition paths in molecular dynamics [0.0]
  Simulating transition paths linking one metastable state to another one is difficult by direct numerical methods. We explore two approaches to more efficiently generate transition paths: sampling methods based on generative models such as variational autoencoders, and importance sampling methods based on reinforcement learning.
  arXiv  Detail & Related papers  (2022-05-05T17:50:10Z)
• Evolutionary Stochastic Policy Distillation [139.54121001226451]
  We propose a new method called Evolutionary Policy Distillation (ESPD) to solve GCRS tasks. ESPD enables a target policy to learn from a series of its variants through the technique of policy distillation (PD) The experiments based on the MuJoCo control suite show the high learning efficiency of the proposed method.
  arXiv  Detail & Related papers  (2020-04-27T16:19:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.