Parametric information geometry with the package Geomstats
- URL: http://arxiv.org/abs/2211.11643v1
- Date: Mon, 21 Nov 2022 16:56:45 GMT
- Title: Parametric information geometry with the package Geomstats
- Authors: Alice Le Brigant, Jules Deschamps, Antoine Collas, Nina Miolane
- Abstract summary: We introduce the information geometry module of the Python package Geomstats.
The module gives the Fisher-Rao Riemannian geometry of any parametric family of distributions of interest.
Importantly, such capabilities open the door to statistics and machine learning on probability distributions.
- Score: 4.205692673448206
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We introduce the information geometry module of the Python package Geomstats.
The module first implements Fisher-Rao Riemannian manifolds of widely used
parametric families of probability distributions, such as normal, gamma, beta,
Dirichlet distributions, and more. The module further gives the Fisher-Rao
Riemannian geometry of any parametric family of distributions of interest,
given a parameterized probability density function as input. The implemented
Riemannian geometry tools allow users to compare, average, interpolate between
distributions inside a given family. Importantly, such capabilities open the
door to statistics and machine learning on probability distributions. We
present the object-oriented implementation of the module along with
illustrative examples and show how it can be used to perform learning on
manifolds of parametric probability distributions.
Related papers
- Wasserstein Flow Matching: Generative modeling over families of distributions [13.620905707751747]
We show how to perform generative modeling over Gaussian distributions, where we generate representations of granular cell states from single-cell genomics data.
We also show that WFM can learn flows between high-dimensional and variable sized point-clouds and synthesize cellular microenvironments from spatial transcriptomics datasets.
arXiv Detail & Related papers (2024-11-01T15:55:07Z) - von Mises Quasi-Processes for Bayesian Circular Regression [57.88921637944379]
We explore a family of expressive and interpretable distributions over circle-valued random functions.
The resulting probability model has connections with continuous spin models in statistical physics.
For posterior inference, we introduce a new Stratonovich-like augmentation that lends itself to fast Markov Chain Monte Carlo sampling.
arXiv Detail & Related papers (2024-06-19T01:57:21Z) - On the Properties and Estimation of Pointwise Mutual Information Profiles [49.877314063833296]
The pointwise mutual information profile, or simply profile, is the distribution of pointwise mutual information for a given pair of random variables.
We introduce a novel family of distributions, Bend and Mix Models, for which the profile can be accurately estimated using Monte Carlo methods.
arXiv Detail & Related papers (2023-10-16T10:02:24Z) - The Fisher-Rao geometry of CES distributions [50.50897590847961]
The Fisher-Rao information geometry allows for leveraging tools from differential geometry.
We will present some practical uses of these geometric tools in the framework of elliptical distributions.
arXiv Detail & Related papers (2023-10-02T09:23:32Z) - Characteristic Function of the Tsallis $q$-Gaussian and Its Applications
in Measurement and Metrology [0.0]
The Tsallis $q$-Gaussian distribution is a powerful generalization of the standard Gaussian distribution.
This paper presents the characteristic function of a linear combination of independent $q$-Gaussian random variables.
It provides an alternative computational procedure to the Monte Carlo method for uncertainty analysis.
arXiv Detail & Related papers (2023-03-15T13:42:35Z) - Wrapped Distributions on homogeneous Riemannian manifolds [58.720142291102135]
Control over distributions' properties, such as parameters, symmetry and modality yield a family of flexible distributions.
We empirically validate our approach by utilizing our proposed distributions within a variational autoencoder and a latent space network model.
arXiv Detail & Related papers (2022-04-20T21:25:21Z) - Bayesian Quadrature on Riemannian Data Manifolds [79.71142807798284]
A principled way to model nonlinear geometric structure inherent in data is provided.
However, these operations are typically computationally demanding.
In particular, we focus on Bayesian quadrature (BQ) to numerically compute integrals over normal laws.
We show that by leveraging both prior knowledge and an active exploration scheme, BQ significantly reduces the number of required evaluations.
arXiv Detail & Related papers (2021-02-12T17:38:04Z) - Geomstats: A Python Package for Riemannian Geometry in Machine Learning [5.449970675406181]
We introduce Geomstats, an open-source Python toolbox for computations and statistics on nonlinear equations.
We provide object-oriented and extensively unit-tested implementations.
We show that Geomstats provides reliable building blocks to foster research in differential geometry and statistics.
The source code is freely available under the MIT license at urlgeomstats.ai.
arXiv Detail & Related papers (2020-04-07T20:41:50Z) - Generalized Sliced Distances for Probability Distributions [47.543990188697734]
We introduce a broad family of probability metrics, coined as Generalized Sliced Probability Metrics (GSPMs)
GSPMs are rooted in the generalized Radon transform and come with a unique geometric interpretation.
We consider GSPM-based gradient flows for generative modeling applications and show that under mild assumptions, the gradient flow converges to the global optimum.
arXiv Detail & Related papers (2020-02-28T04:18:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.