Efficient Targeted Maximum Likelihood Estimators for Two-Phase Design Problems
- URL: http://arxiv.org/abs/2602.24131v1
- Date: Fri, 27 Feb 2026 16:08:41 GMT
- Title: Efficient Targeted Maximum Likelihood Estimators for Two-Phase Design Problems
- Abstract summary: In a two-phase design, a random sample is drawn from the target population in phase 1, during which only a subset of variables is collected.<n>In phase 2, a subsample of the phase-1 cohort is selected, and additional variables are measured.<n>We assume coarsening at random, that is, the phase-2 sampling mechanism depends only on variables fully observed.
- Score: 3.6210754412846318
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In a typical two-phase design, a random sample is drawn from the target population in phase 1, during which only a subset of variables is collected. In phase 2, a subsample of the phase-1 cohort is selected, and additional variables are measured. This setting induces a coarsened data structure on the data from the second phase. We assume coarsening at random, that is, the phase-2 sampling mechanism depends only on variables fully observed. We review existing estimators, including the generalized raking estimator and the inverse probability of censoring weighted targeted maximum likelihood estimation (IPCW-TMLE) along with its extensions that also target the phase-2 sampling mechanism to improve efficiency. We further introduce a new class of estimators constructed within the TMLE framework that are asymptotically equivalent.
Related papers
- Posterior Augmented Flow Matching [64.1559809786948]
Posterior-Augmented Flow Matching (PAFM) is a generalization of flow matching (FM)<n>We show that PAFM improves over FM by up to 3.4 FID50K across different model scales.
arXiv Detail & Related papers (2026-05-01T17:59:59Z) - Accurate ground state energy estimation with noise and imperfect state preparation [0.005587571498826265]
We introduce a classical estimator for the post-processing of quantum phase estimation data.<n>We show that our methods are robust in the presence of both additional phases outside the promise region and global depolarizing noise.<n>The robustness of the moment-projection estimator in the presence of both multiple eigenvalues and realistic noise makes phase estimation with limited depth practical for early fault tolerant quantum experiments.
arXiv Detail & Related papers (2026-03-23T12:04:52Z) - Adaptive Conditional Forest Sampling for Spectral Risk Optimisation under Decision-Dependent Uncertainty [1.14219428942199]
Minimising a spectral risk objective, defined as a convex combination of expected cost and Conditional Value-at-Risk, is challenging.<n>We propose Adaptive Conditional Forest Sampling (ACFS), a four-phase simulation-optimisation framework.<n>ACFS integrates Generalised Random Forests for decision-conditional distribution approximation, CEM-guided global exploration, rank-weighted focused augmentation, and surrogate-to-oracle two-stage reranking.
arXiv Detail & Related papers (2026-03-12T22:53:24Z) - Variance-Reduced Diffusion Sampling via Target Score Identity [0.0]
We study variance reduction for score estimation and diffusion-based sampling in settings where the clean (target) score is available or can be approximated.<n>We develop a plug-and-play nonparametric self-normalized importance sampling estimator compatible with standard reverse-time solvers.<n> Experiments on synthetic targets and PDE-governed inverse problems demonstrate improved sample quality for a fixed simulation budget.
arXiv Detail & Related papers (2026-01-04T16:46:31Z) - Quantum-Circuit Framework for Two-Stage Stochastic Programming via QAOA Integrated with a Quantum Generative Neural Network [1.7240671897505615]
Two-stage programming often discretizes uncertainty into scenarios, but scenario makes recourse expected evaluation scale at least linearly in the scenario count.<n>We propose a unified quantum-circuit workflow in which a pre-trained adversarial network encodes the scenario distribution.
arXiv Detail & Related papers (2025-12-27T02:03:33Z) - Design Stability in Adaptive Experiments: Implications for Treatment Effect Estimation [4.2756749973231924]
We study the problem of estimating the average treatment effect (ATE) under sequentially adaptive treatment assignment mechanisms.<n>In contrast to classical completely randomized designs, we consider a setting in which the probability of assigning treatment to each experimental unit may depend on prior assignments and observed outcomes.<n>We propose and analyze two natural estimators for the ATE: the inverse propensity weighted (IPW) estimator and an augmented IPW (AIPW) estimator.
arXiv Detail & Related papers (2025-10-25T16:30:26Z) - Semiparametric conformal prediction [79.6147286161434]
We construct a conformal prediction set accounting for the joint correlation structure of the vector-valued non-conformity scores.<n>We flexibly estimate the joint cumulative distribution function (CDF) of the scores.<n>Our method yields desired coverage and competitive efficiency on a range of real-world regression problems.
arXiv Detail & Related papers (2024-11-04T14:29:02Z) - Transformers meet Stochastic Block Models: Attention with Data-Adaptive
Sparsity and Cost [53.746169882193456]
Recent works have proposed various sparse attention modules to overcome the quadratic cost of self-attention.
We propose a model that resolves both problems by endowing each attention head with a mixed-membership Block Model.
Our model outperforms previous efficient variants as well as the original Transformer with full attention.
arXiv Detail & Related papers (2022-10-27T15:30:52Z) - Efficient CDF Approximations for Normalizing Flows [64.60846767084877]
We build upon the diffeomorphic properties of normalizing flows to estimate the cumulative distribution function (CDF) over a closed region.
Our experiments on popular flow architectures and UCI datasets show a marked improvement in sample efficiency as compared to traditional estimators.
arXiv Detail & Related papers (2022-02-23T06:11:49Z) - Semi-Supervised Quantile Estimation: Robust and Efficient Inference in High Dimensional Settings [0.5735035463793009]
We consider quantile estimation in a semi-supervised setting, characterized by two available data sets.
We propose a family of semi-supervised estimators for the response quantile(s) based on the two data sets.
arXiv Detail & Related papers (2022-01-25T10:02:23Z) - CARMS: Categorical-Antithetic-REINFORCE Multi-Sample Gradient Estimator [60.799183326613395]
We propose an unbiased estimator for categorical random variables based on multiple mutually negatively correlated (jointly antithetic) samples.
CARMS combines REINFORCE with copula based sampling to avoid duplicate samples and reduce its variance, while keeping the estimator unbiased using importance sampling.
We evaluate CARMS on several benchmark datasets on a generative modeling task, as well as a structured output prediction task, and find it to outperform competing methods including a strong self-control baseline.
arXiv Detail & Related papers (2021-10-26T20:14:30Z) - Machine Learning based optimization for interval uncertainty propagation
with application to vibro-acoustic models [0.0]
Two non-intrusive uncertainty propagation approaches are proposed for the performance analysis of engineering systems.
One approach builds iteratively two distinct training datasets for evaluating separately the upper and lower bounds of the response variable.
The other builds iteratively a single training dataset.
arXiv Detail & Related papers (2021-06-21T15:57:11Z) - Multivariate Probabilistic Regression with Natural Gradient Boosting [63.58097881421937]
We propose a Natural Gradient Boosting (NGBoost) approach based on nonparametrically modeling the conditional parameters of the multivariate predictive distribution.
Our method is robust, works out-of-the-box without extensive tuning, is modular with respect to the assumed target distribution, and performs competitively in comparison to existing approaches.
arXiv Detail & Related papers (2021-06-07T17:44:49Z) - Statistical Approach to Quantum Phase Estimation [62.92678804023415]
We introduce a new statistical and variational approach to the phase estimation algorithm (PEA)
Unlike the traditional and iterative PEAs which return only an eigenphase estimate, the proposed method can determine any unknown eigenstate-eigenphase pair.
We show the simulation results of the method with the Qiskit package on the IBM Q platform and on a local computer.
arXiv Detail & Related papers (2021-04-21T00:02:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.