Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDE
- URL: http://arxiv.org/abs/2607.07034v1
- Date: Wed, 08 Jul 2026 06:08:17 GMT
- Title: Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDE
- Abstract summary: We introduce Intrinsic Greens Learning (IGL), a framework that models a target function on a manifold as the solution to a linear PDE.<n>Rather than approximating the target directly, IGL learns a source and integrates it against a low-dimensional coordinate chart on the manifold.
- Score: 51.736723807086385
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We introduce Intrinsic Green's Learning (IGL), a framework that models a target function on a manifold as the solution to a linear PDE whose source term is learned from data. Rather than approximating the target directly, IGL learns a source and integrates it against a Green's kernel. An encoder discovers a low-dimensional coordinate chart on the manifold where both the source and the kernel decompose as low-rank tensors, collapsing a high-dimensional integral into independent one-dimensional integrals with cost linear in the intrinsic dimension. A two-stage algorithm separates coordinate discovery from source fitting, a near-convex linear solve, preventing the dimensional collapse of joint training. Learnable gates on each coordinate automatically discover the intrinsic dimension of the manifold. We validate IGL on synthetic manifolds and on MNIST, where it simultaneously achieves near-optimal classification and automatic recovery of the intrinsic dimension.
Related papers
- Constructing VAE Latent Spaces with Prescribed Topology [5.207307163958805]
Variational autoencoders learn low-dimensional latent representations of high-dimensional data.<n>Topology-aware models outperform the Gaussian baseline at all practically relevant regularization strengths.
arXiv Detail & Related papers (2026-06-05T08:59:55Z) - Nonlinear Data Integration via Kernel Methods for Data Collaboration Analysis [6.276434238908262]
Data collaboration analysis transforms each dataset into privacy-preserving intermediate representations via party-specific obfuscation functions.<n>Many existing DC analysis methods rely on linear transformations for data obfuscation and integration.<n>We introduce graph regularization and a centering constraint so that the target representation can capture geometric and target-variable information useful for downstream analysis.
arXiv Detail & Related papers (2026-05-26T16:07:32Z) - Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations [0.0]
HIN-LRI is a hybrid framework that augments a classical numerical solver with a neural operator trained to correct the solver's structured truncation error.<n>A lightweight neural network, operating on a low-dimensional latent manifold, learns the residual defect that analytical methods cannot close.<n>Experiments show that HIN-LRI improves accuracy over analytical, splitting methods, and neural PDE surrogates, with stable spatial refinement, effective out-of-distribution transfer, and modest online overhead.
arXiv Detail & Related papers (2026-05-06T12:50:36Z) - Optimal Transportation and Alignment Between Gaussian Measures [80.4634530260329]
Optimal transport (OT) and Gromov-Wasserstein (GW) alignment provide interpretable geometric frameworks for datasets.<n>Because these frameworks are computationally expensive, large-scale applications often rely on closed-form solutions for Gaussian distributions under quadratic cost.<n>This work provides a comprehensive treatment of Gaussian, quadratic cost OT and inner product GW (IGW) alignment, closing several gaps in the literature to broaden applicability.
arXiv Detail & Related papers (2025-12-03T09:01:48Z) - Proper Latent Decomposition [4.266376725904727]
We compute a reduced set of intrinsic coordinates (latent space) to accurately describe a flow with fewer degrees of freedom than the numerical discretization.<n>With this proposed numerical framework, we propose an algorithm to perform PLD on the manifold.<n>This work opens opportunities for analyzing autoencoders and latent spaces, nonlinear reduced-order modeling and scientific insights into the structure of high-dimensional data.
arXiv Detail & Related papers (2024-12-01T12:19:08Z) - Solving High-Dimensional PDEs with Latent Spectral Models [74.1011309005488]
We present Latent Spectral Models (LSM) toward an efficient and precise solver for high-dimensional PDEs.
Inspired by classical spectral methods in numerical analysis, we design a neural spectral block to solve PDEs in the latent space.
LSM achieves consistent state-of-the-art and yields a relative gain of 11.5% averaged on seven benchmarks.
arXiv Detail & Related papers (2023-01-30T04:58:40Z) - Cogradient Descent for Dependable Learning [64.02052988844301]
We propose a dependable learning based on Cogradient Descent (CoGD) algorithm to address the bilinear optimization problem.
CoGD is introduced to solve bilinear problems when one variable is with sparsity constraint.
It can also be used to decompose the association of features and weights, which further generalizes our method to better train convolutional neural networks (CNNs)
arXiv Detail & Related papers (2021-06-20T04:28:20Z) - Manifold Learning via Manifold Deflation [105.7418091051558]
dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data.
Many popular methods can fail dramatically, even on simple two-dimensional Manifolds.
This paper presents an embedding method for a novel, incremental tangent space estimator that incorporates global structure as coordinates.
Empirically, we show our algorithm recovers novel and interesting embeddings on real-world and synthetic datasets.
arXiv Detail & Related papers (2020-07-07T10:04:28Z) - Explicit Gradient Learning [28.844181847562695]
Black-Box Optimization (BBO) methods can find optimal systems with no analytical representation.
EGL trains a NN to estimate the objective gradient directly.
arXiv Detail & Related papers (2020-06-09T08:56:24Z) - Learning Bijective Feature Maps for Linear ICA [73.85904548374575]
We show that existing probabilistic deep generative models (DGMs) which are tailor-made for image data, underperform on non-linear ICA tasks.
To address this, we propose a DGM which combines bijective feature maps with a linear ICA model to learn interpretable latent structures for high-dimensional data.
We create models that converge quickly, are easy to train, and achieve better unsupervised latent factor discovery than flow-based models, linear ICA, and Variational Autoencoders on images.
arXiv Detail & Related papers (2020-02-18T17:58:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.