proxymate: Diagnosis and Adjustment of Proxy Estimates for Reliable Inference

• URL: http://arxiv.org/abs/2607.24401v1
• Date: Mon, 27 Jul 2026 13:19:03 GMT
• Title: proxymate: Diagnosis and Adjustment of Proxy Estimates for Reliable Inference
• Abstract summary: We present proxymate, a framework and open-source Python package for proxy validation and adjustment.<n> proxymate organizes into four levels: The Representativity Level (population validity), the Unit Level (measurement quality), the Estimate Level (decision validity) and the Domain Level (cross-domain transportability)
• Score: 39.481881531386
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Proxy outcomes (such as short-term behavioral signals, model predictions, or surrogate endpoints) are frequently used in place of primary outcomes that are too slow to mature, rare, or challenging to measure directly. But valid inference on a proxy does not guarantee valid inference on the primary estimate as proxy-based estimates can be systematically biased in ways that are difficult to predict, leading to improperly calibrated confidence intervals. We present proxymate, a framework and open-source Python package for proxy validation and adjustment. proxymate organizes into four levels: The Representativity Level (population validity), the Unit Level (measurement quality), the Estimate Level (decision validity), and the Domain Level (cross-domain transportability). Within each level, proxymate provides diagnostic checks, and targeted adjustment strategies that map specific failures to appropriate corrections. At Meta, proxymate has been adopted by many different use cases, spanning experimentation, prevalence estimation, and monitoring use cases, all facing different proxy challenges (limited human review time, long maturation window of outcomes, low detectability) and showcasing the modularity of the framework. Across all products, proxymate assessed and corrected millions of proxy, primary unit comparisons. It has facilitated launches across multiple work streams including enabling quick decision making on thousands of experiments.

Related papers

• ExComm: Exploration-Stage Communication for Error-Resilient Agentic Test-Time Scaling [57.42714978834704]
  ExComm is a communication protocol for exploration-stage agentic test-time scaling.<n>We show that ExComm consistently outperforms strong test-time scaling baselines.
  arXiv  Detail & Related papers  (2026-05-21T07:38:44Z)
• Doubly Robust Proxy Causal Learning with Neural Mean Embeddings [58.8808794752741]
  We develop a neural doubly robust framework for proxy causal learning with continuous and structured treatments.<n>The framework covers population, heterogeneous, and conditional dose-response functions, yielding full response-curve estimators.<n>Across synthetic and image-valued benchmarks, the proposed estimators outperform existing baselines and single-bridge neural estimators.
  arXiv  Detail & Related papers  (2026-05-10T12:50:25Z)
• Estimate Level Adjustment For Inference With Proxies Under Random Distribution Shifts [42.80341491181117]
  We introduce an estimate-level framework, inspired by domain adaptation techniques, to calibrate proxy-based inference.<n>This framework models the proxy-primary metric discrepancy as a random effect at the parameter level, estimating its distribution from aggregated historical observations.<n>We further validate this approach using publicly available datasets and real-world experiments.
  arXiv  Detail & Related papers  (2026-05-07T16:07:35Z)
• PROXIMA: A Reliability Scoring Framework for Proxy Metrics in Online Controlled Experiments [0.0]
  PROXIMA scores proxy reliability through a composite of three complementary dimensions.<n>It directly audits whether a candidate proxy leads to correct launch decisions.<n>Fragility analysis reveals that recommendation domains exhibit substantially higher segment-level fragility.
  arXiv  Detail & Related papers  (2026-04-15T19:10:53Z)
• Falsifying Predictive Algorithm [2.4006298200630343]
  Empirical investigations into unintended model behavior often show that the algorithm is predicting another outcome than what was intended.<n>We propose a falsification framework that provides a principled statistical test for discriminant validity.
  arXiv  Detail & Related papers  (2026-01-23T19:57:43Z)
• Automating the Selection of Proxy Variables of Unmeasured Confounders [16.773841751009748]
  We extend the existing proxy variable estimator to accommodate scenarios where multiple unmeasured confounders exist between the treatments and the outcome. We propose two data-driven methods for the selection of proxy variables and for the unbiased estimation of causal effects.
  arXiv  Detail & Related papers  (2024-05-25T08:53:49Z)
• Online Decision Mediation [72.80902932543474]
  Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior. In clinical diagnosis, fully-autonomous machine behavior is often beyond ethical affordances.
  arXiv  Detail & Related papers  (2023-10-28T05:59:43Z)
• Choosing a Proxy Metric from Past Experiments [54.338884612982405]
  In many randomized experiments, the treatment effect of the long-term metric is often difficult or infeasible to measure. A common alternative is to measure several short-term proxy metrics in the hope they closely track the long-term metric. We introduce a new statistical framework to both define and construct an optimal proxy metric for use in a homogeneous population of randomized experiments.
  arXiv  Detail & Related papers  (2023-09-14T17:43:02Z)
• Causal Ordering Without Effect Estimation: A Framework for Using Proxies in Treatment Prioritization [3.0509197593879844]
  We develop a decision-focused framework to reason about predictive proxies.<n>We identify conditions under which proxies recover the correct effect ordering, which hold when a proxy reflects a dominant moderator of treatment effects.<n>We show how these conditions emerge as a useful approximation in discrete choice settings, where the propensity to act without an intervention moderates persuasion.
  arXiv  Detail & Related papers  (2022-06-25T02:15:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.