Differential geometry with extreme eigenvalues in the positive semidefinite cone

• URL: http://arxiv.org/abs/2304.07347v2
• Date: Thu, 8 Feb 2024 12:29:42 GMT
• Title: Differential geometry with extreme eigenvalues in the positive semidefinite cone
• Authors: Cyrus Mostajeran, Natha\"el Da Costa, Graham Van Goffrier, Rodolphe Sepulchre
• Abstract summary: We present a route to a scalable geometric framework for the analysis and processing of SPD-valued data based on the efficient of extreme generalized eigenvalues. We define a novel iterative mean of SPD matrices based on this geometry and prove its existence and uniqueness for a given finite collection of points.
• Score: 1.9116784879310025
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Differential geometric approaches to the analysis and processing of data in the form of symmetric positive definite (SPD) matrices have had notable successful applications to numerous fields including computer vision, medical imaging, and machine learning. The dominant geometric paradigm for such applications has consisted of a few Riemannian geometries associated with spectral computations that are costly at high scale and in high dimensions. We present a route to a scalable geometric framework for the analysis and processing of SPD-valued data based on the efficient computation of extreme generalized eigenvalues through the Hilbert and Thompson geometries of the semidefinite cone. We explore a particular geodesic space structure based on Thompson geometry in detail and establish several properties associated with this structure. Furthermore, we define a novel iterative mean of SPD matrices based on this geometry and prove its existence and uniqueness for a given finite collection of points. Finally, we state and prove a number of desirable properties that are satisfied by this mean.

Related papers

• Quantum geometry in many-body systems with precursors of criticality [0.0]
  We analyze the geometry of the ground-state manifold in parameter-dependent many-body systems with quantum phase transitions (QPTs) We elucidate the role of diabolic points in the formation of first-order QPTs, showing that these isolated geometric singularities represent seeds generating irregular behavior of geodesics in finite systems.
  arXiv  Detail & Related papers  (2024-11-06T15:06:05Z)
• RMLR: Extending Multinomial Logistic Regression into General Geometries [64.16104856124029]
  Our framework only requires minimal geometric properties, thus exhibiting broad applicability. We develop five families of SPD MLRs under five types of power-deformed metrics. On rotation matrices we propose Lie MLR based on the popular bi-invariant metric.
  arXiv  Detail & Related papers  (2024-09-28T18:38:21Z)
• Geometry of Lightning Self-Attention: Identifiability and Dimension [2.9816332334719773]
  We study the identifiability of deep attention by providing a description of the generic fibers of the parametrization for an arbitrary number of layers. For a single-layer model, we characterize the singular and boundary points. Finally, we formulate a conjectural extension of our results to normalized self-attention networks, prove it for a single layer, and numerically verify it in the deep case.
  arXiv  Detail & Related papers  (2024-08-30T12:00:36Z)
• Geometric statistics with subspace structure preservation for SPD matrices [1.749935196721634]
  We present a framework for the processing of SPD-valued data that preserves subspace structures. This is achieved through the use of the Thompson geometry of the semidefinite cone.
  arXiv  Detail & Related papers  (2024-07-02T22:22:36Z)
• Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Images [56.86175251327466]
  We introduce a novel approach to learn geometries such as depth and surface normal from images while incorporating geometric context. Our approach extracts geometric context that encodes the geometric variations present in the input image and correlates depth estimation with geometric constraints. Our method unifies depth and surface normal estimations within a cohesive framework, which enables the generation of high-quality 3D geometry from images.
  arXiv  Detail & Related papers  (2024-02-08T17:57:59Z)
• A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems [87.30652640973317]
  Recent advances in computational modelling of atomic systems represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. Geometric Graph Neural Networks have emerged as the preferred machine learning architecture powering applications ranging from protein structure prediction to molecular simulations and material generation. This paper provides a comprehensive and self-contained overview of the field of Geometric GNNs for 3D atomic systems.
  arXiv  Detail & Related papers  (2023-12-12T18:44:19Z)
• The Fisher-Rao geometry of CES distributions [50.50897590847961]
  The Fisher-Rao information geometry allows for leveraging tools from differential geometry. We will present some practical uses of these geometric tools in the framework of elliptical distributions.
  arXiv  Detail & Related papers  (2023-10-02T09:23:32Z)
• Parametrizing Product Shape Manifolds by Composite Networks [5.772786223242281]
  We show that it is possible to learn an efficient neural network approximation for shape spaces with a special product structure. Our proposed architecture leverages this structure by separately learning approximations for the low-dimensional factors and a subsequent combination.
  arXiv  Detail & Related papers  (2023-02-28T15:31:23Z)
• A singular Riemannian geometry approach to Deep Neural Networks I. Theoretical foundations [77.86290991564829]
  Deep Neural Networks are widely used for solving complex problems in several scientific areas, such as speech recognition, machine translation, image analysis. We study a particular sequence of maps between manifold, with the last manifold of the sequence equipped with a Riemannian metric. We investigate the theoretical properties of the maps of such sequence, eventually we focus on the case of maps between implementing neural networks of practical interest.
  arXiv  Detail & Related papers  (2021-12-17T11:43:30Z)
• On Riemannian Optimization over Positive Definite Matrices with the Bures-Wasserstein Geometry [45.1944007785671]
  We comparatively analyze the Bures-Wasserstein (BW) geometry with the popular Affine-Invariant (AI) geometry. We build on an observation that the BW metric has a linear dependence on SPD matrices in contrast to the quadratic dependence of the AI metric. We show that the BW geometry has a non-negative curvature, which further improves convergence rates of algorithms over the non-positively curved AI geometry.
  arXiv  Detail & Related papers  (2021-06-01T07:39:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.