Likelihoods and Parameter Priors for Bayesian Networks
- URL: http://arxiv.org/abs/2105.06241v1
- Date: Thu, 13 May 2021 12:45:44 GMT
- Title: Likelihoods and Parameter Priors for Bayesian Networks
- Authors: David Heckerman and Dan Geiger
- Abstract summary: We introduce several assumptions that permit the construction of likelihoods and parameter priors for a large number of Bayesian-network structures.
We present a method for directly computing the marginal likelihood of a random sample with no missing observations.
- Score: 7.005458308454871
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We develop simple methods for constructing likelihoods and parameter priors
for learning about the parameters and structure of a Bayesian network. In
particular, we introduce several assumptions that permit the construction of
likelihoods and parameter priors for a large number of Bayesian-network
structures from a small set of assessments. The most notable assumption is that
of likelihood equivalence, which says that data can not help to discriminate
network structures that encode the same assertions of conditional independence.
We describe the constructions that follow from these assumptions, and also
present a method for directly computing the marginal likelihood of a random
sample with no missing observations. Also, we show how these assumptions lead
to a general framework for characterizing parameter priors of multivariate
distributions.
Related papers
- Model-free Estimation of Latent Structure via Multiscale Nonparametric Maximum Likelihood [13.175343048302697]
We propose a model-free approach for estimating such latent structures whenever they are present, without assuming they exist a priori.
As an application, we design a clustering algorithm based on the proposed procedure and demonstrate its effectiveness in capturing a wide range of latent structures.
arXiv Detail & Related papers (2024-10-29T17:11:33Z) - A Note on Bayesian Networks with Latent Root Variables [56.86503578982023]
We show that the marginal distribution over the remaining, manifest, variables also factorises as a Bayesian network, which we call empirical.
A dataset of observations of the manifest variables allows us to quantify the parameters of the empirical Bayesian net.
arXiv Detail & Related papers (2024-02-26T23:53:34Z) - Likelihood Ratio Confidence Sets for Sequential Decision Making [51.66638486226482]
We revisit the likelihood-based inference principle and propose to use likelihood ratios to construct valid confidence sequences.
Our method is especially suitable for problems with well-specified likelihoods.
We show how to provably choose the best sequence of estimators and shed light on connections to online convex optimization.
arXiv Detail & Related papers (2023-11-08T00:10:21Z) - Joint Bayesian Inference of Graphical Structure and Parameters with a
Single Generative Flow Network [59.79008107609297]
We propose in this paper to approximate the joint posterior over the structure of a Bayesian Network.
We use a single GFlowNet whose sampling policy follows a two-phase process.
Since the parameters are included in the posterior distribution, this leaves more flexibility for the local probability models.
arXiv Detail & Related papers (2023-05-30T19:16:44Z) - Bayesian Hierarchical Models for Counterfactual Estimation [12.159830463756341]
We propose a probabilistic paradigm to estimate a diverse set of counterfactuals.
We treat the perturbations as random variables endowed with prior distribution functions.
A gradient based sampler with superior convergence characteristics efficiently computes the posterior samples.
arXiv Detail & Related papers (2023-01-21T00:21:11Z) - Continuous and Distribution-free Probabilistic Wind Power Forecasting: A
Conditional Normalizing Flow Approach [1.684864188596015]
We present a data-driven approach for probabilistic wind power forecasting based on conditional normalizing flow (CNF)
In contrast with the existing, this approach is distribution-free (as for non-parametric and quantile-based approaches) and can directly yield continuous probability densities.
arXiv Detail & Related papers (2022-06-06T08:48:58Z) - Wrapped Distributions on homogeneous Riemannian manifolds [58.720142291102135]
Control over distributions' properties, such as parameters, symmetry and modality yield a family of flexible distributions.
We empirically validate our approach by utilizing our proposed distributions within a variational autoencoder and a latent space network model.
arXiv Detail & Related papers (2022-04-20T21:25:21Z) - Structural Causal Models Are (Solvable by) Credal Networks [70.45873402967297]
Causal inferences can be obtained by standard algorithms for the updating of credal nets.
This contribution should be regarded as a systematic approach to represent structural causal models by credal networks.
Experiments show that approximate algorithms for credal networks can immediately be used to do causal inference in real-size problems.
arXiv Detail & Related papers (2020-08-02T11:19:36Z) - Nonparametric Score Estimators [49.42469547970041]
Estimating the score from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models.
We provide a unifying view of these estimators under the framework of regularized nonparametric regression.
We propose score estimators based on iterative regularization that enjoy computational benefits from curl-free kernels and fast convergence.
arXiv Detail & Related papers (2020-05-20T15:01:03Z) - Bayesian stochastic blockmodeling [0.0]
This chapter provides a self-contained introduction to the use of Bayesian inference to extract large-scale modular structures from network data.
We focus on nonparametric formulations that allow their inference in a manner that prevents overfitting, and enables model selection.
We show how inferring the blockmodel can be used to predict missing and spurious links, and shed light on the fundamental limitations of the detectability of modular structures in networks.
arXiv Detail & Related papers (2017-05-29T14:53:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.