A Variational Approach to Parameter Estimation for Characterizing 2-D
Cluster Variation Method Topographies
- URL: http://arxiv.org/abs/2209.04087v1
- Date: Fri, 9 Sep 2022 02:10:59 GMT
- Title: A Variational Approach to Parameter Estimation for Characterizing 2-D
Cluster Variation Method Topographies
- Authors: Alianna J. Maren
- Abstract summary: 2-D cluster variation method (CVM) provides a theoretical framework for associating a set of configuration variables with only two parameters.
Method is illustrated using four patterns derived from three different naturally-occurring black-and-white topographies.
We achieve expected results, that is, as the patterns progress from having relatively low numbers of like-near-like nodes to increasing like-near-like masses, the h-values for each corresponding free energy-minimized model also increase.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: One of the biggest challenges in characterizing 2-D topographies is
succinctly communicating the dominant nature of local configurations. In a 2-D
grid composed of bistate units, this could be expressed as finding the
characteristic configuration variables such as nearest-neighbor pairs and
triplet combinations. The 2-D cluster variation method (CVM) provides a
theoretical framework for associating a set of configuration variables with
only two parameters, for a system that is at free energy equilibrium. This work
presents a method for determining which of many possible two-parameter sets
provides the ``most suitable'' match for a given 2-D topography, drawing from
methods used for variational inference.
This particular work focuses exclusively on topographies for which the
activation enthalpy parameter (epsilon_0) is zero, so that the distribution
between two states is equiprobable. This condition is used since, when the two
states are equiprobable, there is an analytic solution giving the configuration
variable values as functions of the h-value, where we define h in terms of the
interaction enthalpy parameter (epsilon_1) as h = exp(2*epsilon_1). This allows
the computationally-achieved configuration variable values to be compared with
the analytically-predicted values for a given h-value.
The method is illustrated using four patterns derived from three different
naturally-occurring black-and-white topographies, where each pattern meets the
equiprobability criterion.
We achieve expected results, that is, as the patterns progress from having
relatively low numbers of like-near-like nodes to increasing like-near-like
masses, the h-values for each corresponding free energy-minimized model also
increase. Further, the corresponding configuration variable values for the
(free energy-minimized) model patterns are in approximate alignment with the
analytically-predicted values.
Related papers
- Analysis of Hessian Scaling for Local and Global Costs in Variational Quantum Algorithm [0.42970700836450487]
We quantify the entrywise resolvability of the Hessian for Variational Quantum Algorithms.<n>We show two distinct scaling regimes that govern the sample complexity required to resolve Hessian entries against shot noise.
arXiv Detail & Related papers (2026-01-31T15:49:23Z) - Convergence Dynamics of Over-Parameterized Score Matching for a Single Gaussian [48.340460104014]
We study gradient descent for training models to learn a single Gaussian distribution.<n>We prove a global convergence result for gradient descent under multiple regimes.<n>This is the first work to establish global convergence guarantees for Gaussian mixtures with at least three components under the score matching framework.
arXiv Detail & Related papers (2025-11-27T03:41:48Z) - Wasserstein Regression as a Variational Approximation of Probabilistic Trajectories through the Bernstein Basis [41.99844472131922]
Existing approaches often ignore the geometry of the probability space or are computationally expensive.<n>A new method is proposed that combines the parameterization of probability trajectories using a Bernstein basis and the minimization of the Wasserstein distance between distributions.<n>The developed approach combines geometric accuracy, computational practicality, and interpretability.
arXiv Detail & Related papers (2025-10-30T15:36:39Z) - Equivariant Eikonal Neural Networks: Grid-Free, Scalable Travel-Time Prediction on Homogeneous Spaces [42.33765011920294]
We introduce a novel framework that integrates Equivariant Neural Fields (ENFs) with Neural Eikonal solvers.<n>Our approach employs a single neural field where a unified shared backbone is conditioned on signal-specific latent variables.<n>We validate our approach through applications in seismic travel-time modeling of 2D, 3D, and spherical benchmark datasets.
arXiv Detail & Related papers (2025-05-21T21:29:18Z) - Variable Substitution and Bilinear Programming for Aligning Partially Overlapping Point Sets [48.1015832267945]
This research presents a method to meet requirements through the minimization objective function of the RPM algorithm.
A branch-and-bound (BnB) algorithm is devised, which solely branches over the parameters, thereby boosting convergence rate.
Empirical evaluations demonstrate better robustness of the proposed methodology against non-rigid deformation, positional noise, and outliers, when compared with prevailing state-of-the-art transformations.
arXiv Detail & Related papers (2024-05-14T13:28:57Z) - Generating Graphs via Spectral Diffusion [48.70458395826864]
We present GGSD, a novel graph generative model based on 1) the spectral decomposition of the graph Laplacian matrix and 2) a diffusion process.<n>An extensive set of experiments on both synthetic and real-world graphs demonstrates the strengths of our model against state-of-the-art alternatives.
arXiv Detail & Related papers (2024-02-29T09:26:46Z) - Robust scalable initialization for Bayesian variational inference with
multi-modal Laplace approximations [0.0]
Variational mixtures with full-covariance structures suffer from a quadratic growth due to variational parameters with the number of parameters.
We propose a method for constructing an initial Gaussian model approximation that can be used to warm-start variational inference.
arXiv Detail & Related papers (2023-07-12T19:30:04Z) - Variational Equations-of-States for Interacting Quantum Hamiltonians [0.0]
We present variational equations of state (VES) for pure states of an interacting quantum Hamiltonian.
VES can be expressed in terms of the variation of the density operators or static correlation functions.
We present three nontrivial applications of the VES.
arXiv Detail & Related papers (2023-07-03T07:51:15Z) - A Model for Multi-View Residual Covariances based on Perspective
Deformation [88.21738020902411]
We derive a model for the covariance of the visual residuals in multi-view SfM, odometry and SLAM setups.
We validate our model with synthetic and real data and integrate it into photometric and feature-based Bundle Adjustment.
arXiv Detail & Related papers (2022-02-01T21:21:56Z) - Learning Equivariant Energy Based Models with Equivariant Stein
Variational Gradient Descent [80.73580820014242]
We focus on the problem of efficient sampling and learning of probability densities by incorporating symmetries in probabilistic models.
We first introduce Equivariant Stein Variational Gradient Descent algorithm -- an equivariant sampling method based on Stein's identity for sampling from densities with symmetries.
We propose new ways of improving and scaling up training of energy based models.
arXiv Detail & Related papers (2021-06-15T01:35:17Z) - Parameter Inference with Bifurcation Diagrams [1.0312968200748118]
We propose a gradient-based approach for inferring the parameters of differential equations that produce a user-specified bifurcation diagram.
The cost function contains a supervised error term that is minimal when the model bifurcations match the specified targets and an unsupervised bifurcation measure.
We demonstrate parameter inference with minimal models which explore the space of saddle-node and pitchfork diagrams and the genetic toggle switch from synthetic biology.
arXiv Detail & Related papers (2021-06-08T10:39:19Z) - EiGLasso for Scalable Sparse Kronecker-Sum Inverse Covariance Estimation [1.370633147306388]
We introduce EiGLasso, a highly scalable method for sparse Kronecker-sum inverse covariance estimation.
We show that EiGLasso achieves two to three orders-of-magnitude speed-up compared to the existing methods.
arXiv Detail & Related papers (2021-05-20T16:22:50Z) - Optimal oracle inequalities for solving projected fixed-point equations [53.31620399640334]
We study methods that use a collection of random observations to compute approximate solutions by searching over a known low-dimensional subspace of the Hilbert space.
We show how our results precisely characterize the error of a class of temporal difference learning methods for the policy evaluation problem with linear function approximation.
arXiv Detail & Related papers (2020-12-09T20:19:32Z) - DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic
Convolution [136.7261709896713]
We propose a data-driven approach that generates the appropriate convolution kernels to apply in response to the nature of the instances.
The proposed method achieves promising results on both ScanetNetV2 and S3DIS.
It also improves inference speed by more than 25% over the current state-of-the-art.
arXiv Detail & Related papers (2020-11-26T14:56:57Z) - An Embedded Model Estimator for Non-Stationary Random Functions using
Multiple Secondary Variables [0.0]
This paper introduces the method and shows that it has consistency results that are similar in nature to those applying to geostatistical modelling and to Quantile Random Forests.
The algorithm works by estimating a conditional distribution for the target variable at each target location.
arXiv Detail & Related papers (2020-11-09T00:14:24Z) - Probabilistic Circuits for Variational Inference in Discrete Graphical
Models [101.28528515775842]
Inference in discrete graphical models with variational methods is difficult.
Many sampling-based methods have been proposed for estimating Evidence Lower Bound (ELBO)
We propose a new approach that leverages the tractability of probabilistic circuit models, such as Sum Product Networks (SPN)
We show that selective-SPNs are suitable as an expressive variational distribution, and prove that when the log-density of the target model is aweighted the corresponding ELBO can be computed analytically.
arXiv Detail & Related papers (2020-10-22T05:04:38Z) - Fast and Robust Comparison of Probability Measures in Heterogeneous
Spaces [62.35667646858558]
We introduce the Anchor Energy (AE) and Anchor Wasserstein (AW) distances, which are respectively the energy and Wasserstein distances instantiated on such representations.
Our main contribution is to propose a sweep line algorithm to compute AE emphexactly in log-quadratic time, where a naive implementation would be cubic.
We show that AE and AW perform well in various experimental settings at a fraction of the computational cost of popular GW approximations.
arXiv Detail & Related papers (2020-02-05T03:09:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.