Eryn : A multi-purpose sampler for Bayesian inference
- URL: http://arxiv.org/abs/2303.02164v1
- Date: Fri, 3 Mar 2023 12:45:03 GMT
- Title: Eryn : A multi-purpose sampler for Bayesian inference
- Authors: Nikolaos Karnesis, Michael L. Katz, Natalia Korsakova, Jonathan R.
Gair, Nikolaos Stergioulas
- Abstract summary: tt Eryn is a user-friendly and multipurpose toolbox for Bayesian inference.
In this paper, we describe this sampler package and illustrate its capabilities on a variety of use cases.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In recent years, methods for Bayesian inference have been widely used in many
different problems in physics where detection and characterization are
necessary. Data analysis in gravitational-wave astronomy is a prime example of
such a case. Bayesian inference has been very successful because this technique
provides a representation of the parameters as a posterior probability
distribution, with uncertainties informed by the precision of the experimental
measurements. During the last couple of decades, many specific advances have
been proposed and employed in order to solve a large variety of different
problems. In this work, we present a Markov Chain Monte Carlo (MCMC) algorithm
that integrates many of those concepts into a single MCMC package. For this
purpose, we have built {\tt Eryn}, a user-friendly and multipurpose toolbox for
Bayesian inference, which can be utilized for solving parameter estimation and
model selection problems, ranging from simple inference questions, to those
with large-scale model variation requiring trans-dimensional MCMC methods, like
the LISA global fit problem. In this paper, we describe this sampler package
and illustrate its capabilities on a variety of use cases.
Related papers
- Going NUTS with ADVI: Exploring various Bayesian Inference techniques with Facebook Prophet [0.0]
We present our PyMC-based implementation and analyze in detail the implementation of different Bayesian inference techniques.<n>We consider full MCMC techniques, MAP estimation and Variational inference techniques on a time-series forecasting problem.
arXiv Detail & Related papers (2026-01-27T23:27:16Z) - A multi-dimensional quantum estimation and model learning framework based on variational Bayesian inference [3.7127285734321203]
We present a joint model selection and parameter estimation algorithm that is fast and operable on a large number of model parameters.<n>The algorithm is based on variational Bayesian inference (VBI), which approximates the target posterior distribution.<n>We show how a regularizing prior can be used to select between competing models, each comprising a different number of parameters.
arXiv Detail & Related papers (2025-07-30T22:18:27Z) - A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications [0.0]
We review and compare a wide range of Markov Chain Monte Carlo (MCMC) and nested sampling techniques.
We show that several examples widely thought to be most easily solved using nested sampling approaches can in fact be more efficiently solved using modern MCMC algorithms.
arXiv Detail & Related papers (2024-09-27T05:57:48Z) - Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods [59.779795063072655]
Chain-of-Thought (CoT) prompting and its variants have gained popularity as effective methods for solving multi-step reasoning problems.
We analyze CoT prompting from a statistical estimation perspective, providing a comprehensive characterization of its sample complexity.
arXiv Detail & Related papers (2024-08-25T04:07:18Z) - von Mises Quasi-Processes for Bayesian Circular Regression [57.88921637944379]
We explore a family of expressive and interpretable distributions over circle-valued random functions.
The resulting probability model has connections with continuous spin models in statistical physics.
For posterior inference, we introduce a new Stratonovich-like augmentation that lends itself to fast Markov Chain Monte Carlo sampling.
arXiv Detail & Related papers (2024-06-19T01:57:21Z) - Bayesian Nonparametrics: An Alternative to Deep Learning [0.5801621787540265]
This survey aims to delve into the significance of Bayesian nonparametrics, particularly in addressing complex challenges across various domains such as statistics, computer science, and electrical engineering.
We uncover the versatility and efficacy of Bayesian nonparametric methodologies, paving the way for innovative solutions to intricate challenges across diverse disciplines.
arXiv Detail & Related papers (2024-03-29T17:32:42Z) - Variational Inference for GARCH-family Models [84.84082555964086]
Variational Inference is a robust approach for Bayesian inference in machine learning models.
We show that Variational Inference is an attractive, remarkably well-calibrated, and competitive method for Bayesian learning.
arXiv Detail & Related papers (2023-10-05T10:21:31Z) - Bayesian calibration of differentiable agent-based models [3.629865579485447]
We discuss how generalised variational inference procedures may be employed to provide misspecification-robust Bayesian parameter inferences.
We demonstrate with experiments on a differentiable ABM of the COVID-19 pandemic that our approach can result in accurate inferences.
arXiv Detail & Related papers (2023-05-24T16:52:32Z) - Robust probabilistic inference via a constrained transport metric [8.85031165304586]
We offer a novel alternative by constructing an exponentially tilted empirical likelihood carefully designed to concentrate near a parametric family of distributions.
The proposed approach finds applications in a wide variety of robust inference problems, where we intend to perform inference on the parameters associated with the centering distribution.
We demonstrate superior performance of our methodology when compared against state-of-the-art robust Bayesian inference methods.
arXiv Detail & Related papers (2023-03-17T16:10:06Z) - A Variational Inference Approach to Inverse Problems with Gamma
Hyperpriors [60.489902135153415]
This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors.
The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement.
arXiv Detail & Related papers (2021-11-26T06:33:29Z) - Contributions to Large Scale Bayesian Inference and Adversarial Machine
Learning [0.0]
The rampant adoption of ML methodologies has revealed that models are usually adopted to make decisions without taking into account the uncertainties in their predictions.
We believe that developing ML systems that take into predictive account uncertainties and are robust against adversarial examples is a must for real-world tasks.
arXiv Detail & Related papers (2021-09-25T23:02:47Z) - Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian
Nonparametrics [85.31247588089686]
We show that variational Bayesian methods can yield sensitivities with respect to parametric and nonparametric aspects of Bayesian models.
We provide both theoretical and empirical support for our variational approach to Bayesian sensitivity analysis.
arXiv Detail & Related papers (2021-07-08T03:40:18Z) - Stein Variational Model Predictive Control [130.60527864489168]
Decision making under uncertainty is critical to real-world, autonomous systems.
Model Predictive Control (MPC) methods have demonstrated favorable performance in practice, but remain limited when dealing with complex distributions.
We show that this framework leads to successful planning in challenging, non optimal control problems.
arXiv Detail & Related papers (2020-11-15T22:36:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.