Learning with symmetric positive definite matrices via generalized Bures-Wasserstein geometry

• URL: http://arxiv.org/abs/2110.10464v2
• Date: Thu, 8 Jun 2023 22:27:24 GMT
• Title: Learning with symmetric positive definite matrices via generalized Bures-Wasserstein geometry
• Authors: Andi Han, Bamdev Mishra, Pratik Jawanpuria, Junbin Gao
• Abstract summary: We propose a novel generalization of the Bures-Wasserstein geometry, which we call the GBW geometry. We provide a rigorous treatment to study various differential geometric notions on the proposed novel generalized geometry. We also present experiments that illustrate the efficacy of the proposed GBW geometry over the BW geometry.
• Score: 40.23168342389821
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Learning with symmetric positive definite (SPD) matrices has many applications in machine learning. Consequently, understanding the Riemannian geometry of SPD matrices has attracted much attention lately. A particular Riemannian geometry of interest is the recently proposed Bures-Wasserstein (BW) geometry which builds on the Wasserstein distance between the Gaussian densities. In this paper, we propose a novel generalization of the BW geometry, which we call the GBW geometry. The proposed generalization is parameterized by a symmetric positive definite matrix $\mathbf{M}$ such that when $\mathbf{M} = \mathbf{I}$, we recover the BW geometry. We provide a rigorous treatment to study various differential geometric notions on the proposed novel generalized geometry which makes it amenable to various machine learning applications. We also present experiments that illustrate the efficacy of the proposed GBW geometry over the BW geometry.

Related papers

• RMLR: Extending Multinomial Logistic Regression into General Geometries [64.16104856124029]
  Our framework only requires minimal geometric properties, thus exhibiting broad applicability. We develop five families of SPD MLRs under five types of power-deformed metrics. On rotation matrices we propose Lie MLR based on the popular bi-invariant metric.
  arXiv  Detail & Related papers  (2024-09-28T18:38:21Z)
• The Fisher-Rao geometry of CES distributions [50.50897590847961]
  The Fisher-Rao information geometry allows for leveraging tools from differential geometry. We will present some practical uses of these geometric tools in the framework of elliptical distributions.
  arXiv  Detail & Related papers  (2023-10-02T09:23:32Z)
• Differential geometry with extreme eigenvalues in the positive semidefinite cone [1.9116784879310025]
  We present a route to a scalable geometric framework for the analysis and processing of SPD-valued data based on the efficient of extreme generalized eigenvalues. We define a novel iterative mean of SPD matrices based on this geometry and prove its existence and uniqueness for a given finite collection of points.
  arXiv  Detail & Related papers  (2023-04-14T18:37:49Z)
• Geometric Clifford Algebra Networks [53.456211342585824]
  We propose Geometric Clifford Algebra Networks (GCANs) for modeling dynamical systems. GCANs are based on symmetry group transformations using geometric (Clifford) algebras.
  arXiv  Detail & Related papers  (2023-02-13T18:48:33Z)
• Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principles [55.41644538483948]
  We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the transformations symmetry and the corresponding generators. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.
  arXiv  Detail & Related papers  (2023-01-13T16:25:25Z)
• Non-linear Embeddings in Hilbert Simplex Geometry [9.4599552597135]
  A key technique of machine learning and computer vision is to embed discrete weighted graphs into continuous spaces for further downstream processing. In this paper, we consider Hilbert geometry for the standard simplex which is isometric to a vector space equipped with the variation polytope norm. Our findings demonstrate that Hilbert simplex geometry is competitive to alternative geometries such as the Poincar'e hyperbolic ball or the Euclidean geometry for embedding tasks while being fast and numerically robust.
  arXiv  Detail & Related papers  (2022-03-22T03:13:39Z)
• On Geometric Connections of Embedded and Quotient Geometries in Riemannian Fixed-rank Matrix Optimization [5.876141028192136]
  This paper proposes a general procedure for establishing the geometric landscape connections of a Riemannian optimization problem under the embedded and quotient geometries. We observe an algorithmic connection between two geometries with some specific Riemannian metrics in fixed-rank matrix optimization. Results provide a few new theoretical insights to unanswered questions in the literature.
  arXiv  Detail & Related papers  (2021-10-23T03:13:56Z)
• On Riemannian Optimization over Positive Definite Matrices with the Bures-Wasserstein Geometry [45.1944007785671]
  We comparatively analyze the Bures-Wasserstein (BW) geometry with the popular Affine-Invariant (AI) geometry. We build on an observation that the BW metric has a linear dependence on SPD matrices in contrast to the quadratic dependence of the AI metric. We show that the BW geometry has a non-negative curvature, which further improves convergence rates of algorithms over the non-positively curved AI geometry.
  arXiv  Detail & Related papers  (2021-06-01T07:39:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.