Nonlinear Data Integration via Kernel Methods for Data Collaboration Analysis

• URL: http://arxiv.org/abs/2605.27219v1
• Date: Tue, 26 May 2026 16:07:32 GMT
• Title: Nonlinear Data Integration via Kernel Methods for Data Collaboration Analysis
• Abstract summary: Data collaboration analysis transforms each dataset into privacy-preserving intermediate representations via party-specific obfuscation functions.<n>Many existing DC analysis methods rely on linear transformations for data obfuscation and integration.<n>We introduce graph regularization and a centering constraint so that the target representation can capture geometric and target-variable information useful for downstream analysis.
• Score: 6.276434238908262
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Collaborative analysis of decentralized confidential datasets is important, but direct sharing of original datasets is often restricted by privacy and institutional constraints. Data collaboration (DC) analysis transforms each dataset into privacy-preserving intermediate representations via party-specific obfuscation functions and integrates them into common collaboration representations using an anchor dataset. However, many existing DC analysis methods rely on linear transformations for data obfuscation and integration, which may increase reconstruction risk. Although nonlinear dimensionality reduction can mitigate this risk, conventional linear integration methods cannot accurately align intermediate representations produced by nonlinear transformations. Moreover, existing integration methods mainly minimize discrepancies among parties and do not explicitly incorporate geometric or target-variable information useful for downstream analysis. To overcome these limitations, we first formulate linear kernel integration (LKI) as a linear integration method and then kernelize it to obtain nonlinear kernel integration (NKI). NKI admits a globally optimal solution via kernel ridge regression and an eigenvalue problem. We also introduce graph regularization and a centering constraint so that the target representation can capture geometric and target-variable information useful for downstream analysis. Experiments on image classification tasks demonstrate that NKI improves classification accuracy over existing linear integration methods under nonlinear dimensionality reduction, with further gains from target-variable-aware graph regularization and centering. The results also show that dimensionality reduction choices substantially affect both classification accuracy and reconstruction risk.

Related papers

• Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDE [51.736723807086385]
  We introduce Intrinsic Greens Learning (IGL), a framework that models a target function on a manifold as the solution to a linear PDE.<n>Rather than approximating the target directly, IGL learns a source and integrates it against a low-dimensional coordinate chart on the manifold.
  arXiv  Detail & Related papers  (2026-07-08T06:08:17Z)
• Generalization in Nonlinear Least Squares via Learned Feature Geometry [15.966075413898336]
  We study the generalization of ridge-regularized nonlinear least-squares models via on-average algorithmic stability.<n>We deriving error bounds for local minimizers in terms of a data-dependent effective dimension that reflects the geometry of the gradient model.
  arXiv  Detail & Related papers  (2026-06-07T19:33:36Z)
• A Mean Curvature Approach to Boundary Detection: Geometric Insights for Unsupervised Learning [52.452902154360565]
  We introduce Mean Curvature Boundary Points (MCBP), a novel geometric framework grounded in Geometric Machine Learning.<n>MCBP explicitly models the intrinsic curvature of the data manifold and computes pointwise mean curvature without requiring principled manifold parametrization.<n>Experiments on synthetic and real-world datasets demonstrate that MCBP consistently improves clustering performance.
  arXiv  Detail & Related papers  (2026-05-05T20:19:09Z)
• Generalization Bound of Gradient Flow through Training Trajectory and Data-dependent Kernel [55.82768375605861]
  We establish a generalization bound for gradient flow that aligns with the classical Rademacher complexity for kernel methods.<n>Unlike static kernels such as NTK, the LPK captures the entire training trajectory, adapting to both data and optimization dynamics.
  arXiv  Detail & Related papers  (2025-06-12T23:17:09Z)
• Outlier-aware Tensor Robust Principal Component Analysis with Self-guided Data Augmentation [21.981038455329013]
  We propose a self-guided data augmentation approach that employs adaptive weighting to suppress outlier influence.<n>We show the improvements in both accuracy and computational efficiency compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-04-25T13:03:35Z)
• An Incremental Non-Linear Manifold Approximation Method [0.0]
  This research develops an incremental non-linear dimension reduction method using the Geometric Multi-Resolution Analysis (GMRA) framework for streaming data.<n>The proposed method enables real-time data analysis and visualization by incrementally updating the cluster map, basis PCA vectors, and wavelet coefficients.
  arXiv  Detail & Related papers  (2025-04-12T03:54:05Z)
• Nonlinear Multiple Response Regression and Learning of Latent Spaces [2.6113259186042876]
  We introduce a unified method capable of learning latent spaces in both unsupervised and supervised settings.<n>Unlike other neural network methods that operate as "black boxes", our approach not only offers better interpretability but also reduces computational complexity.
  arXiv  Detail & Related papers  (2025-03-27T15:28:06Z)
• Adversarial Dependence Minimization [78.36795688238155]
  This work provides a differentiable and scalable algorithm for dependence minimization that goes beyond linear pairwise decorrelation.<n>We demonstrate its utility in three applications: extending PCA to nonlinear decorrelation, improving the generalization of image classification methods, and preventing dimensional collapse in self-supervised representation learning.
  arXiv  Detail & Related papers  (2025-02-05T14:43:40Z)
• Data Collaboration Analysis with Orthonormal Basis Selection and Alignment [2.928964540437144]
  Data Collaboration (DC) enables multiple parties to jointly train a model without exposing their private datasets.<n>Existing theory asserts that any target basis spanning the same subspace as the secret bases should suffice.<n>We introduce Orthonormal Data Collaboration (ODC), a novel DC framework that explicitly enforces orthonormality constraints on both the secret and target bases.
  arXiv  Detail & Related papers  (2024-03-05T08:52:16Z)
• Learning Linear Causal Representations from Interventions under General Nonlinear Mixing [52.66151568785088]
  We prove strong identifiability results given unknown single-node interventions without access to the intervention targets. This is the first instance of causal identifiability from non-paired interventions for deep neural network embeddings.
  arXiv  Detail & Related papers  (2023-06-04T02:32:12Z)
• Graph Embedding with Data Uncertainty [113.39838145450007]
  spectral-based subspace learning is a common data preprocessing step in many machine learning pipelines. Most subspace learning methods do not take into consideration possible measurement inaccuracies or artifacts that can lead to data with high uncertainty.
  arXiv  Detail & Related papers  (2020-09-01T15:08:23Z)
• Linear Tensor Projection Revealing Nonlinearity [0.294944680995069]
  Dimensionality reduction is an effective method for learning high-dimensional data. We propose a method that searches for a subspace that maximizes the prediction accuracy while retaining as much of the original data information as possible.
  arXiv  Detail & Related papers  (2020-07-08T06:10:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.