Distance Profile Embedding for Independence and Conditional Independence Testing of Random Objects
- URL: http://arxiv.org/abs/2607.28981v1
- Date: Fri, 31 Jul 2026 03:12:47 GMT
- Title: Distance Profile Embedding for Independence and Conditional Independence Testing of Random Objects
- Abstract summary: Testing independence or conditional independence is fundamental to statistical inference, yet existing methods face a difficult trade-off between geometric flexibility and theoretical tractability.<n>We introduce the Distance Profile Embedding (DPE), a novel representation that maps random objects from general metric spaces into a space of square-integrable functions.<n>We develop a unified framework for marginal and conditional independence testing of random objects that enjoys a rigorous theory for both size and power.
- Score: 8.679002268074683
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Testing independence or conditional independence is fundamental to statistical inference, yet existing methods for non-Euclidean random objects often face a difficult trade-off between geometric flexibility and theoretical tractability. We introduce the Distance Profile Embedding (DPE), a novel representation that maps random objects from general metric spaces into a Hilbert space of square-integrable functions. We prove that this mapping is injective and preserves full distributional information without requiring isometric Hilbert embeddings or one-to-one correspondence conditions. Leveraging the DPE, we develop a unified framework for marginal and conditional independence testing of random objects that enjoys a rigorous asymptotic theory for both size and power. Notably, our framework is the first in the literature to accommodate object-valued conditioning variables when testing conditional independence, overcoming the Euclidean or Hilbertian constraints of existing methodologies. We facilitate the calculation of analytic $p$-values using closed-form asymptotic null distributions, which avoids the computational burden of permutation tests common in existing metric-based methods. The numerical properties of our methods are demonstrated through both simulations and two real-world applications involving gut microbiome compositions and global human mortality distributions, respectively.
Related papers
- Marginal Coordinate Test for Fréchet Regression with Random Objects [15.929485404318557]
We develop a test for regression with Euclidean predictors and a random-object response in a separable metric space.<n>We establish a weighted centered chi-square null limit, wild bootstrap validity, and consistency against fixed detectable alternatives.<n>For simultaneous inference, truncated p-to-e calibration combined with e-BH provides false discovery rate control under general dependence.
arXiv Detail & Related papers (2026-08-31T11:48:12Z) - Active Timepoint Selection for Learning Measure-Valued Trajectories [55.49809248697036]
Inferring continuous probability paths from snapshots is a fundamental challenge in domains like single-cell biology.<n>We introduce a framework which extends active experimentation to the space of sparse measures.<n>This yields an acquisition policy that iteratively selects measurement times to minimize uncertainty.
arXiv Detail & Related papers (2026-05-28T22:22:35Z) - Controlling False Discovery in Arbitrarily Structured Hypothesis Spaces via Reproducing Kernels [47.16593717985932]
We introduce a framework that unifies continuous domains, graphs, and hierarchies under a single algorithm through kernel choice alone.<n>We provide two decision rules which we prove to control the False Discovery Rate (FDR)<n>We validate our method on two sources: spatial locations derived from high-dimensional real-world datasets, and a differential gene expression task utilizing protein-protein interaction graphs.
arXiv Detail & Related papers (2026-05-17T17:42:56Z) - Random-Effects Algorithm for Random Objects in Metric Spaces [0.0]
We propose a nonlinear Fréchet-based algorithm for random-effects modeling of arbitrary random objects defined on a metric space.<n>We show that, although our method is developed beyond Hilbert spaces, it can outperform existing Hilbert space-based methods.
arXiv Detail & Related papers (2026-05-04T15:05:43Z) - A Sample Efficient Conditional Independence Test in the Presence of Discretization [54.047334792855345]
Conditional Independence (CI) tests directly to discretized data can lead to incorrect conclusions.<n>Recent advancements have sought to infer the correct CI relationship between the latent variables through binarizing observed data.<n>Motivated by this, this paper introduces a sample-efficient CI test that does not rely on the binarization process.
arXiv Detail & Related papers (2025-06-10T12:41:26Z) - From Conditional to Unconditional Independence: Testing Conditional Independence via Transport Maps [9.039406432084578]
Testing conditional independence between two random vectors given a third is a fundamental and challenging problem in statistics.<n>We propose a novel method for testing conditional independence by transforming it to an unconditional independence test problem.
arXiv Detail & Related papers (2025-04-13T13:38:25Z) - A Unified Theory of Stochastic Proximal Point Methods without Smoothness [52.30944052987393]
Proximal point methods have attracted considerable interest owing to their numerical stability and robustness against imperfect tuning.
This paper presents a comprehensive analysis of a broad range of variations of the proximal point method (SPPM)
arXiv Detail & Related papers (2024-05-24T21:09:19Z) - Conditional Independence Testing via Latent Representation Learning [2.566492438263125]
LCIT (Latent representation based Conditional Independence Test) is a novel non-parametric method for conditional independence testing based on representation learning.
Our main contribution involves proposing a generative framework in which to test for the independence between X and Y given Z.
arXiv Detail & Related papers (2022-09-04T07:16:03Z) - Nonparametric Conditional Local Independence Testing [69.31200003384122]
Conditional local independence is an independence relation among continuous time processes.
No nonparametric test of conditional local independence has been available.
We propose such a nonparametric test based on double machine learning.
arXiv Detail & Related papers (2022-03-25T10:31:02Z) - Random Forest Weighted Local Fréchet Regression with Random Objects [18.128663071848923]
We propose a novel random forest weighted local Fr'echet regression paradigm.<n>Our first method uses these weights as the local average to solve the conditional Fr'echet mean.<n>Second method performs local linear Fr'echet regression, both significantly improving existing Fr'echet regression methods.
arXiv Detail & Related papers (2022-02-10T09:10:59Z) - Generalized Sliced Distances for Probability Distributions [47.543990188697734]
We introduce a broad family of probability metrics, coined as Generalized Sliced Probability Metrics (GSPMs)
GSPMs are rooted in the generalized Radon transform and come with a unique geometric interpretation.
We consider GSPM-based gradient flows for generative modeling applications and show that under mild assumptions, the gradient flow converges to the global optimum.
arXiv Detail & Related papers (2020-02-28T04:18:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.