Free Energy Evaluation Using Marginalized Annealed Importance Sampling
- URL: http://arxiv.org/abs/2204.03784v1
- Date: Fri, 8 Apr 2022 00:19:39 GMT
- Title: Free Energy Evaluation Using Marginalized Annealed Importance Sampling
- Authors: Muneki Yasuda and Chako Takahashi
- Abstract summary: The evaluation of the free energy of a model is considered to be a significant issue in various fields of physics and machine learning.
The exact free energy evaluation is computationally infeasible because it includes an intractable partition function.
This study proposes a new AIS-based approach, referred to as marginalized AIS (mAIS)
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The evaluation of the free energy of a stochastic model is considered to be a
significant issue in various fields of physics and machine learning. However,
the exact free energy evaluation is computationally infeasible because it
includes an intractable partition function. Annealed importance sampling (AIS)
is a type of importance sampling based on the Markov chain Monte Carlo method,
which is similar to a simulated annealing, and can effectively approximate the
free energy. This study proposes a new AIS-based approach, referred to as
marginalized AIS (mAIS). The statistical efficiency of mAIS is investigated in
detail based on a theoretical and numerical perspectives. Based on the
investigation, it has been proved that mAIS is more effective than AIS under a
certain condition.
Related papers
- Iterated Denoising Energy Matching for Sampling from Boltzmann Densities [109.23137009609519]
Iterated Denoising Energy Matching (iDEM)
iDEM alternates between (I) sampling regions of high model density from a diffusion-based sampler and (II) using these samples in our matching objective.
We show that the proposed approach achieves state-of-the-art performance on all metrics and trains $2-5times$ faster.
arXiv Detail & Related papers (2024-02-09T01:11:23Z) - Energy Discrepancies: A Score-Independent Loss for Energy-Based Models [20.250792836049882]
We propose a novel loss function called Energy Discrepancy (ED) which does not rely on the computation of scores or expensive Markov chain Monte Carlo.
We show that ED approaches the explicit score matching and negative log-likelihood loss under different limits, effectively interpolating between both.
arXiv Detail & Related papers (2023-07-12T19:51:49Z) - Glocal Energy-based Learning for Few-Shot Open-Set Recognition [57.84234213466372]
Few-shot open-set recognition (FSOR) is a challenging task of great practical value.
We propose a novel energy-based hybrid model for FSOR.
Experiments on three standard FSOR datasets show the superior performance of our model.
arXiv Detail & Related papers (2023-04-24T07:06:50Z) - Sampling with Mollified Interaction Energy Descent [57.00583139477843]
We present a new optimization-based method for sampling called mollified interaction energy descent (MIED)
MIED minimizes a new class of energies on probability measures called mollified interaction energies (MIEs)
We show experimentally that for unconstrained sampling problems our algorithm performs on par with existing particle-based algorithms like SVGD.
arXiv Detail & Related papers (2022-10-24T16:54:18Z) - Statistical quality assessment of Ising-based annealer outputs [0.0]
We introduce a statistical test of the quality of Ising-based annealers' output based on the data only.
We express the ground-state energy and temperature as a function of cumulants up to the third order.
The approach provides an easily implementable method for the primary validation of Ising-based annealers' output.
arXiv Detail & Related papers (2021-12-07T09:53:28Z) - Leveraging Global Parameters for Flow-based Neural Posterior Estimation [90.21090932619695]
Inferring the parameters of a model based on experimental observations is central to the scientific method.
A particularly challenging setting is when the model is strongly indeterminate, i.e., when distinct sets of parameters yield identical observations.
We present a method for cracking such indeterminacy by exploiting additional information conveyed by an auxiliary set of observations sharing global parameters.
arXiv Detail & Related papers (2021-02-12T12:23:13Z) - Spatial Monte Carlo Integration with Annealed Importance Sampling [0.45687771576879593]
A new method is proposed to evaluate the expectations on Ising models combining AIS and SMCI.
The proposed method performs efficiently in both high- and low-temperature regions.
arXiv Detail & Related papers (2020-12-21T09:26:40Z) - Understanding Negative Sampling in Graph Representation Learning [87.35038268508414]
We show that negative sampling is as important as positive sampling in determining the optimization objective and the resulted variance.
We propose Metropolis-Hastings (MCNS) to approximate the positive distribution with self-contrast approximation and accelerate negative sampling by Metropolis-Hastings.
We evaluate our method on 5 datasets that cover extensive downstream graph learning tasks, including link prediction, node classification and personalized recommendation.
arXiv Detail & Related papers (2020-05-20T06:25:21Z) - Computing Absolute Free Energy with Deep Generative Models [2.610895122644814]
We introduce a general framework for calculating the absolute free energy of a state.
A key step of the calculation is the definition of a reference state with tractable deep generative models.
The free energy for the state of interest can then be determined as the difference from the reference.
arXiv Detail & Related papers (2020-05-01T22:19:31Z) - Targeted free energy estimation via learned mappings [66.20146549150475]
Free energy perturbation (FEP) was proposed by Zwanzig more than six decades ago as a method to estimate free energy differences.
FEP suffers from a severe limitation: the requirement of sufficient overlap between distributions.
One strategy to mitigate this problem, called Targeted Free Energy Perturbation, uses a high-dimensional mapping in configuration space to increase overlap.
arXiv Detail & Related papers (2020-02-12T11:10:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.