Conditioning Normalizing Flows for Rare Event Sampling
- URL: http://arxiv.org/abs/2207.14530v2
- Date: Fri, 19 May 2023 13:24:55 GMT
- Title: Conditioning Normalizing Flows for Rare Event Sampling
- Authors: Sebastian Falkner, Alessandro Coretti, Salvatore Romano, Phillip
Geissler, Christoph Dellago
- Abstract summary: We propose a transition path sampling scheme based on neural-network generated configurations.
We show that this approach enables the resolution of both the thermodynamics and kinetics of the transition region.
- Score: 61.005334495264194
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Understanding the dynamics of complex molecular processes is often linked to
the study of infrequent transitions between long-lived stable states. The
standard approach to the sampling of such rare events is to generate an
ensemble of transition paths using a random walk in trajectory space. This,
however, comes with the drawback of strong correlations between subsequently
sampled paths and with an intrinsic difficulty in parallelizing the sampling
process. We propose a transition path sampling scheme based on neural-network
generated configurations. These are obtained employing normalizing flows, a
neural network class able to generate statistically independent samples from a
given distribution. With this approach, not only are correlations between
visited paths removed, but the sampling process becomes easily parallelizable.
Moreover, by conditioning the normalizing flow, the sampling of configurations
can be steered towards regions of interest. We show that this approach enables
the resolution of both the thermodynamics and kinetics of the transition
region.
Related papers
- Harmonic Path Integral Diffusion [0.4527270266697462]
We present a novel approach for sampling from a continuous multivariate probability distribution, which may either be explicitly known (up to a normalization factor) or represented via empirical samples.
Our method constructs a time-dependent bridge from a delta function centered at the origin of the state space at $t=0$, transforming it into the target distribution at $t=1$.
We contrast these algorithms with other sampling methods, particularly simulated and path integral sampling, highlighting their advantages in terms of analytical control, accuracy, and computational efficiency.
arXiv Detail & Related papers (2024-09-23T16:20:21Z) - On the Trajectory Regularity of ODE-based Diffusion Sampling [79.17334230868693]
Diffusion-based generative models use differential equations to establish a smooth connection between a complex data distribution and a tractable prior distribution.
In this paper, we identify several intriguing trajectory properties in the ODE-based sampling process of diffusion models.
arXiv Detail & Related papers (2024-05-18T15:59:41Z) - Stable generative modeling using Schrödinger bridges [0.22499166814992438]
We propose a generative model combining Schr"odinger bridges and Langevin dynamics.
Our framework can be naturally extended to generate conditional samples and to Bayesian inference problems.
arXiv Detail & Related papers (2024-01-09T06:15:45Z) - Diffusion Generative Flow Samplers: Improving learning signals through
partial trajectory optimization [87.21285093582446]
Diffusion Generative Flow Samplers (DGFS) is a sampling-based framework where the learning process can be tractably broken down into short partial trajectory segments.
Our method takes inspiration from the theory developed for generative flow networks (GFlowNets)
arXiv Detail & Related papers (2023-10-04T09:39:05Z) - Adaptive Annealed Importance Sampling with Constant Rate Progress [68.8204255655161]
Annealed Importance Sampling (AIS) synthesizes weighted samples from an intractable distribution.
We propose the Constant Rate AIS algorithm and its efficient implementation for $alpha$-divergences.
arXiv Detail & Related papers (2023-06-27T08:15:28Z) - Detecting and Mitigating Mode-Collapse for Flow-based Sampling of
Lattice Field Theories [6.222204646855336]
We study the consequences of mode-collapse of normalizing flows in the context of lattice field theory.
We propose a metric to quantify the degree of mode-collapse and derive a bound on the resulting bias.
arXiv Detail & Related papers (2023-02-27T19:00:22Z) - Enhanced Sampling of Configuration and Path Space in a Generalized
Ensemble by Shooting Point Exchange [71.49868712710743]
We propose a new approach to simulate rare events caused by transitions between long-lived states.
The scheme substantially enhances the efficiency of the transition path sampling simulations.
It yields information on thermodynamics, kinetics and reaction coordinates of molecular processes without distorting their dynamics.
arXiv Detail & Related papers (2023-02-17T08:41:31Z) - Sampling in Combinatorial Spaces with SurVAE Flow Augmented MCMC [83.48593305367523]
Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sampling from complex continuous distributions.
We introduce a new approach based on augmenting Monte Carlo methods with SurVAE Flows to sample from discrete distributions.
We demonstrate the efficacy of our algorithm on a range of examples from statistics, computational physics and machine learning, and observe improvements compared to alternative algorithms.
arXiv Detail & Related papers (2021-02-04T02:21:08Z) - Towards Recurrent Autoregressive Flow Models [39.25035894474609]
We present Recurrent Autoregressive Flows as a method toward general process modeling with normalizing flows.
The proposed method defines a conditional distribution for each variable in a sequential process by conditioning the parameters of a normalizing flow with recurrent neural connections.
We demonstrate the effectiveness of this class of models through a series of experiments in which models are trained on three complex processes.
arXiv Detail & Related papers (2020-06-17T18:38:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.