Riemannian Networks over Full-Rank Correlation Matrices
- URL: http://arxiv.org/abs/2605.19073v1
- Date: Mon, 18 May 2026 19:54:55 GMT
- Title: Riemannian Networks over Full-Rank Correlation Matrices
- Abstract summary: Full-rank correlation matrices are a normalized alternative to the Symmetric Positive Definite (SPD) manifold.<n>We extend basic layers, including Multinomial Logistic Regression (MLR), Fully Connected (FC) and convolutional layers, to these geometries.<n>We also present methods for accurate backpropagation for two correlation geometries.
- Score: 102.84784139051526
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Representations on the Symmetric Positive Definite (SPD) manifold have garnered significant attention across different applications. In contrast, the manifold of full-rank correlation matrices, a normalized alternative to SPD matrices, remains largely underexplored. This paper introduces Riemannian networks over the correlation manifold, leveraging five recently developed correlation geometries. We systematically extend basic layers, including Multinomial Logistic Regression (MLR), Fully Connected (FC), and convolutional layers, to these geometries. Besides, we present methods for accurate backpropagation for two correlation geometries. Experiments comparing our approach against existing SPD and Grassmannian networks demonstrate its effectiveness.
Related papers
- RMLR: Extending Multinomial Logistic Regression into General Geometries [64.16104856124029]
Our framework only requires minimal geometric properties, thus exhibiting broad applicability.
We develop five families of SPD MLRs under five types of power-deformed metrics.
On rotation matrices we propose Lie MLR based on the popular bi-invariant metric.
arXiv Detail & Related papers (2024-09-28T18:38:21Z) - Understanding Matrix Function Normalizations in Covariance Pooling through the Lens of Riemannian Geometry [63.694184882697435]
Global Covariance Pooling (GCP) has been demonstrated to improve the performance of Deep Neural Networks (DNNs) by exploiting second-order statistics of high-level representations.<n>This paper provides a comprehensive and unified understanding of the matrix logarithm and power from a Riemannian geometry perspective.
arXiv Detail & Related papers (2024-07-15T07:11:44Z) - Riemannian Self-Attention Mechanism for SPD Networks [34.794770395408335]
An SPD manifold self-attention mechanism (SMSA) is proposed in this paper.
An SMSA-based geometric learning module (SMSA-GL) is designed for the sake of improving the discrimination of structured representations.
arXiv Detail & Related papers (2023-11-28T12:34:46Z) - Riemannian Multinomial Logistics Regression for SPD Neural Networks [60.11063972538648]
We propose a new type of deep neural network for Symmetric Positive Definite (SPD) matrices.
Our framework offers a novel intrinsic explanation for the most popular LogEig classifier in existing SPD networks.
The effectiveness of our method is demonstrated in three applications: radar recognition, human action recognition, and electroencephalography (EEG) classification.
arXiv Detail & Related papers (2023-05-18T20:12:22Z) - Adaptive Log-Euclidean Metrics for SPD Matrix Learning [73.12655932115881]
We propose Adaptive Log-Euclidean Metrics (ALEMs), which extend the widely used Log-Euclidean Metric (LEM)
The experimental and theoretical results demonstrate the merit of the proposed metrics in improving the performance of SPD neural networks.
arXiv Detail & Related papers (2023-03-26T18:31:52Z) - Fusion of Physiological and Behavioural Signals on SPD Manifolds with
Application to Stress and Pain Detection [1.9844265130823329]
multimodal stress/pain recognition approaches generally extract features from different modalities independently.
This paper proposes a novel geometric framework for multimodal stress/pain detection utilizing Symmetric Positive Definite (SPD) matrices.
arXiv Detail & Related papers (2022-07-17T16:54:24Z) - Deep Optimal Transport for Domain Adaptation on SPD Manifolds [9.552869120136005]
We introduce a new geometric deep learning framework that combines optimal transport theory with the geometry of SPD manifold.<n>Our approach aligns data distributions while respecting the manifold structure, effectively reducing both marginal and conditional discrepancies.<n>We validate our method on three cross-session brain computer interface datasets, KU, BNCI2014001, and BNCI2015001.
arXiv Detail & Related papers (2022-01-15T03:13:02Z) - Joint Network Topology Inference via Structured Fusion Regularization [70.30364652829164]
Joint network topology inference represents a canonical problem of learning multiple graph Laplacian matrices from heterogeneous graph signals.
We propose a general graph estimator based on a novel structured fusion regularization.
We show that the proposed graph estimator enjoys both high computational efficiency and rigorous theoretical guarantee.
arXiv Detail & Related papers (2021-03-05T04:42:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.