Shape Operator PCA: Curvature-Aware Projections for Geometric Machine Learning
- URL: http://arxiv.org/abs/2608.15313v1
- Date: Sat, 15 Aug 2026 16:37:47 GMT
- Title: Shape Operator PCA: Curvature-Aware Projections for Geometric Machine Learning
- Abstract summary: SHOPCA (Shape Operator-based Principal Component Analysis) is a novel method for unsupervised metric learning and dimensionality reduction.<n>We evaluate SHOPCA on more than 50 real-world benchmark datasets.
- Score: 52.452902154360565
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we propose SHOPCA (Shape Operator-based Principal Component Analysis), a novel method for unsupervised metric learning and dimensionality reduction that incorporates differential geometric information into the covariance structure of classical PCA. SHOPCA regularizes the global covariance matrix using the mean shape operator, defined as the average of the absolute local shape operators estimated from the data manifold, steering principal components toward directions of both maximum variance and informative curvature. A single trace-normalized mixing coefficient $α$ controls the regularization, recovering standard PCA at $α= 0$ and a curvature-driven embedding as $α\to \infty$. We further introduce a fully unsupervised criterion for selecting $α$ based on the spectral eigengap of the regularized covariance matrix, maximizing the relative separation between the top-$d$ and remaining eigenvalues without using class labels. We evaluate SHOPCA on more than 50 real-world benchmark datasets, comparing it with PCA, ISOMAP, and UMAP using Adjusted Rand Index (ARI), Normalized Mutual Information (NMI), Fowlkes-Mallows index (FM), and V-measure. Results show that SHOPCA consistently improves clustering quality over PCA across a broad range of datasets and surpasses UMAP on small-sample settings, where iterative neighborhood-based manifold estimation can degrade. SHOPCA is computationally tractable, parameter-efficient, and applicable to domains requiring fully unsupervised, geometry-aware dimensionality reduction.
Related papers
- Active Learning with Low-Rank Structure for Data Selection [85.43185363043362]
We introduce a new data selection framework based on low-rank approximation and residual-based sampling.<n>We show that it is possible to select a weighted subset of $tildeOleft(k + frac1varepsilon2right)$ data points whose average loss approximates the average loss over the full dataset.
arXiv Detail & Related papers (2026-06-14T22:29:59Z) - Efficient Mean Curvature Computation on High-Dimensional Data Manifolds [52.452902154360565]
Estimating local mean curvature at each point of a high-dimensional dataset is a key ingredient of machine learning algorithms.<n>This paper introduces two complementary contributions that together reduce this cost by several orders of magnitude.<n> Experiments on real-world datasets confirm speedups of 50 to 300 times relative to the original implementation.
arXiv Detail & Related papers (2026-06-04T16:04:31Z) - BOOOM: Loss-Function-Agnostic Black-Box Optimization over Orthonormal Manifolds for Machine Learning and Statistical Inference [0.0]
We present a systematic exploration of.<n>the set of $p.<n>orthonormal column-orthonormal escape through a.<n>novel applied to data data.<n>problems.<n>We show a diagonal optimization framework showing a.<n>strong, low-rank decomposition, independent decomposition analysis,.<n>and global convergence in under conditions.
arXiv Detail & Related papers (2026-04-23T19:32:27Z) - Curvature-Aware PCA with Geodesic Tangent Space Aggregation for Semi-Supervised Learning [52.452902154360565]
GTSA-PCA is a geometric extension of Principal Component Analysis.<n>It integrates curvature awareness and geodesic consistency within a unified spectral framework.<n>Our results position GTSA-PCA as a principled bridge between statistical and geometric approaches to dimensionality reduction.
arXiv Detail & Related papers (2026-04-20T20:36:36Z) - The $φ$-PCA Framework: A Unified and Efficiency-Preserving Approach with Robust Variants [0.0]
We introduce the $phi$-PCA framework which provides a unified formulation of robust and distributed PCA.<n>We show that the partition-aggregation principle underlying $phi$-PCA offers a general strategy for developing robust and efficiency-preserving methodologies.
arXiv Detail & Related papers (2025-10-15T05:21:11Z) - sparseGeoHOPCA: A Geometric Solution to Sparse Higher-Order PCA Without Covariance Estimation [8.802387139798808]
We propose a novel framework for high-order principal component analysis (SHOPCA) that introduces a perspective to tensor-dependent decomposition.<n>We show that sparseGeoHOP supports in high-dimensional image settings and on ImageNet.
arXiv Detail & Related papers (2025-06-10T10:30:48Z) - PAID: Pairwise Angular-Invariant Decomposition for Continual Test-Time Adaptation [70.98107766265636]
This paper takes the geometric attributes of pre-trained weights as a starting point, systematically analyzing three key components: magnitude, absolute angle, and pairwise angular structure.<n>We find that the pairwise angular structure remains stable across diverse corrupted domains and encodes domain-invariant semantic information, suggesting it should be preserved during adaptation.
arXiv Detail & Related papers (2025-06-03T05:18:15Z) - Fair PCA, One Component at a Time [2.5056643038238504]
The Min-Max Fair PCA problem seeks a low-rank representation of multi-group data that is as balanced as possible across groups.<n>Existing approaches to this problem return a rank-$d$ fair subspace, but lack the fundamental containment property of standard PCA.<n>We define fair principal components as directions that minimize the maximum group-wise reconstruction error.<n>This approach preserves the containment property of standard PCA, and reduces to standard pca for data with a single group.
arXiv Detail & Related papers (2025-03-27T14:47:27Z) - Sparse PCA with Oracle Property [115.72363972222622]
We propose a family of estimators based on the semidefinite relaxation of sparse PCA with novel regularizations.
We prove that, another estimator within the family achieves a sharper statistical rate of convergence than the standard semidefinite relaxation of sparse PCA.
arXiv Detail & Related papers (2023-12-28T02:52:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.