Group-Aware Matrix Estimation and Latent Subspace Recovery
- URL: http://arxiv.org/abs/2605.20559v1
- Date: Tue, 19 May 2026 23:22:32 GMT
- Title: Group-Aware Matrix Estimation and Latent Subspace Recovery
- Abstract summary: Group-Aware Matrix Estimation (GAME) is a convex estimator for overlapping subgroup-wise low-rank matrix estimation.<n>We show how GAME is most beneficial in structured missingness regimes, where subgroup-aware regularization improves reconstruction accuracy and latent subspace fidelity.
- Score: 4.619828919345115
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Modern matrix completion problems often involve heterogeneous data whose rows simultaneously belong to many meta-categories, such as demographic and age groups in recommendation systems, or region and recording session labels in neural electrophysiological experiments. Standard low-rank estimators impose a single global latent geometry, which can recover average structure but may smooth away subgroup-specific variation, especially when observations are unevenly distributed across groups. We introduce Group-Aware Matrix Estimation (GAME), a convex estimator for overlapping subgroup-wise low-rank matrix estimation. GAME regularizes category-specific submatrices through overlapping nuclear-norm penalties, allowing related groups to borrow information while preserving local latent structure in a shared coordinate system. We provide finite-sample guarantees for both reconstruction error and subgroup-specific subspace recovery, showing how performance depends on sampling density, subgroup rank, and overlap structure. Experiments on synthetic, recommendation, ecological, and neuroscience datasets show that GAME is most beneficial in structured missingness regimes, where subgroup-aware regularization improves both reconstruction accuracy and latent subspace fidelity. Across these benchmarks, GAME is competitive or best among global low-rank, side-information, and modern imputation baselines, with the largest gains when subgroups exhibit distinct low-rank structure.
Related papers
- NVE: A Separability and Coverage-Aware Internal Validation Metric for Biclustering [2.8272286359224563]
Biclustering aims to discover coherent submatrices by grouping rows and columns of a data matrix simultaneously.<n>Existing internal biclustering measures such as Mean Squared Residue (MSR) and Virtual Error (VE) mainly evaluate within-bicluster coherence.<n>This paper investigates Normalised Virtual Error (NVE), an internal validation metric that extends VE using a super-bicluster normalization strategy.
arXiv Detail & Related papers (2026-08-29T04:35:30Z) - Imputation Meets Clustering: Exploiting Latent Subgroup Structure for Missing Data Recovery [52.29866804948133]
We propose CAGI (Cluster-Aware Generative Imputation), a framework that reformulates clustering and imputation as a mutually reinforcing co-optimization process.<n>Experiments on 14 benchmark datasets with 15 representative baselines demonstrate the superiority of CAGI.
arXiv Detail & Related papers (2026-07-08T02:50:02Z) - Rank-Aware Hyperbolic Alignment for Vision-Language Dataset Distillation [54.74045834035952]
Vision-language dataset distillation (VLDD) compresses a large image-text paired dataset into a small set of synthetic pairs.<n>We propose a rank-aware hyperbolic alignment (RAHA) that combines hierarchical geometry with explicit alignment-capacity control.<n>RAHA demonstrates competitive cross-modal retrieval and improved transfer indicators under fixed budgets.
arXiv Detail & Related papers (2026-06-28T15:41:31Z) - Rank-Constrained Deep Matrix Completion for Group Recommendation [0.0]
Group Rank-Constrained Deep Matrix Completion (Group RC-DMC) is a novel framework that extends RC-DMC by integrating group-level representation learning via a Set-Transformer aggregator.<n>Unlike most existing group recommender systems, Group RC-DMC unifies explicit low-rank regularization, linear encoder-decoder architectures, and attention-based nonlinear group modeling.<n> Experimental results on the MovieLens and Goodbooks datasets demonstrate that Group RC-DMC achieves superior reconstruction accuracy, measured by lower group RMSE.
arXiv Detail & Related papers (2026-06-01T09:09:46Z) - Sparse Network Inference under Imperfect Detection and its Application to Ecological Networks [2.7065664375961274]
We propose a framework for structured sparse non-negative low-rank factorization with detection estimation.<n>We develop an ADMM-based algorithm with scale-aware and similarity-aware factors and establish its feasibility.<n>Experiments on synthetic and real-world ecological clusters demonstrate improved recovery of latent structure and similarity/connectivity.
arXiv Detail & Related papers (2026-04-20T20:41:23Z) - Weight-Informed Self-Explaining Clustering for Mixed-Type Tabular Data [63.62853416081748]
WISE is a framework that unifies representation, feature weighting, clustering, and interpretation.<n>It produces faithful, human-interpretable explanations grounded in the same primitives that drive clustering.
arXiv Detail & Related papers (2026-04-07T13:18:31Z) - Simultaneous Heterogeneity and Reduced-rank Learning for Multivariate Response Regression [6.086398194493261]
In this paper, we propose a joint heterogeneity and reduced-rank learning framework to simultaneously identify the subgroup structure.<n>In particular, our approach uses rank-constrained pairwise fusion penalization and conducts the subgroup analysis without requiring prior knowledge regarding the individual subgroup.<n>The effectiveness of the proposed approach is demonstrated through simulation studies and a real data application.
arXiv Detail & Related papers (2025-12-06T17:59:39Z) - HeteroJIVE: Joint Subspace Estimation for Heterogeneous Multi-View Data [7.187267927910277]
We propose HeteroJIVE, a weighted two-stage spectral algorithm tailored to statistical heterogeneity.<n>In this paper, we demonstrate that our algorithm achieves the $O(K-1/2)$ rate without the need for iterative refinement.<n>Extensive simulations corroborate our theoretical findings, and an application to TCGA-BRCA multi-omics data validates the superiority of HeteroJIVE.
arXiv Detail & Related papers (2025-12-02T15:28:07Z) - How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance [64.1656365676171]
Group imbalance has been a known problem in empirical risk minimization.
This paper quantifies the impact of individual groups on the sample complexity, the convergence rate, and the average and group-level testing performance.
arXiv Detail & Related papers (2024-03-12T04:38:05Z) - A structured regression approach for evaluating model performance across intersectional subgroups [53.91682617836498]
Disaggregated evaluation is a central task in AI fairness assessment, where the goal is to measure an AI system's performance across different subgroups.
We introduce a structured regression approach to disaggregated evaluation that we demonstrate can yield reliable system performance estimates even for very small subgroups.
arXiv Detail & Related papers (2024-01-26T14:21:45Z) - Semi-Supervised Subspace Clustering via Tensor Low-Rank Representation [64.49871502193477]
We propose a novel semi-supervised subspace clustering method, which is able to simultaneously augment the initial supervisory information and construct a discriminative affinity matrix.
Comprehensive experimental results on six commonly-used benchmark datasets demonstrate the superiority of our method over state-of-the-art methods.
arXiv Detail & Related papers (2022-05-21T01:47:17Z) - Joint estimation of multiple Granger causal networks: Inference of
group-level brain connectivity [8.122270502556374]
This paper considers joint learning of multiple Granger graphical models to discover underlying differential Granger causality structures across multiple time series.
Our methods were also applied to available resting-state fMRI time series from the ADHD-200 data sets to learn the differences of causality mechanisms.
arXiv Detail & Related papers (2021-05-15T10:29:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.