SECRETS: Subject-Efficient Clinical Randomized Controlled Trials using
Synthetic Intervention
- URL: http://arxiv.org/abs/2305.05078v1
- Date: Mon, 8 May 2023 22:37:16 GMT
- Title: SECRETS: Subject-Efficient Clinical Randomized Controlled Trials using
Synthetic Intervention
- Authors: Sayeri Lala (1) and Niraj K. Jha (1) ((1) Department of Electrical and
Computer Engineering, Princeton University)
- Abstract summary: Cross-over trials can reduce sample size requirements by measuring the treatment effect per individual.
We propose a novel framework, SECRETS, which estimates the individual treatment effect (ITE) per patient in the RCT study without using any external data.
We show that SECRETS can improve the power of an RCT while maintaining comparable significance levels.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The randomized controlled trial (RCT) is the gold standard for estimating the
average treatment effect (ATE) of a medical intervention but requires
100s-1000s of subjects, making it expensive and difficult to implement. While a
cross-over trial can reduce sample size requirements by measuring the treatment
effect per individual, it is only applicable to chronic conditions and
interventions whose effects dissipate rapidly. Another approach is to replace
or augment data collected from an RCT with external data from prospective
studies or prior RCTs, but it is vulnerable to confounders in the external or
augmented data. We propose to simulate the cross-over trial to overcome its
practical limitations while exploiting its strengths. We propose a novel
framework, SECRETS, which, for the first time, estimates the individual
treatment effect (ITE) per patient in the RCT study without using any external
data by leveraging a state-of-the-art counterfactual estimation algorithm,
called synthetic intervention. It also uses a new hypothesis testing strategy
to determine whether the treatment has a clinically significant ATE based on
the estimated ITEs. We show that SECRETS can improve the power of an RCT while
maintaining comparable significance levels; in particular, on three real-world
clinical RCTs (Phase-3 trials), SECRETS increases power over the baseline
method by $\boldsymbol{6}$-$\boldsymbol{54\%}$ (average: 21.5%, standard
deviation: 15.8%).
Related papers
- Progressive Generalization Risk Reduction for Data-Efficient Causal Effect Estimation [30.49865329385806]
Causal effect estimation (CEE) provides a crucial tool for predicting the unobserved counterfactual outcome for an entity.
In this paper, we study a more realistic CEE setting where the labelled data samples are scarce at the beginning.
We propose the Model Agnostic Causal Active Learning (MACAL) algorithm for batch-wise label acquisition.
arXiv Detail & Related papers (2024-11-18T03:17:40Z) - Training and Validating a Treatment Recommender with Partial Verification Evidence [1.0693162404690828]
Current clinical decision support systems (DSS) are trained and validated on observational data from the target clinic.
This is problematic for treatments validated in a randomized clinical trial (RCT) but not yet introduced in any clinic.
Key challenges we address are of missingness -- missing rationale for treatment assignment (the assignment is at random), and missing verification evidence.
arXiv Detail & Related papers (2024-06-10T09:23:00Z) - Adaptive-TMLE for the Average Treatment Effect based on Randomized Controlled Trial Augmented with Real-World Data [0.0]
We consider the problem of estimating the average treatment effect (ATE) when both randomized control trial (RCT) data and real-world data (RWD) are available.
We introduce an adaptive targeted minimum loss-based estimation framework to estimate them.
arXiv Detail & Related papers (2024-05-12T07:10:26Z) - A Weighted Prognostic Covariate Adjustment Method for Efficient and
Powerful Treatment Effect Inferences in Randomized Controlled Trials [0.28087862620958753]
A crucial task for a randomized controlled trial (RCT) is to specify a statistical method that can yield an efficient estimator and powerful test for the treatment effect.
Training a generative AI algorithm on historical control data enables one to construct a digital twin generator (DTG) for RCT participants.
DTG generates a probability distribution for RCT participants' potential control outcome.
arXiv Detail & Related papers (2023-09-25T16:14:13Z) - Improved Policy Evaluation for Randomized Trials of Algorithmic Resource
Allocation [54.72195809248172]
We present a new estimator leveraging our proposed novel concept, that involves retrospective reshuffling of participants across experimental arms at the end of an RCT.
We prove theoretically that such an estimator is more accurate than common estimators based on sample means.
arXiv Detail & Related papers (2023-02-06T05:17:22Z) - Robust and Agnostic Learning of Conditional Distributional Treatment
Effects [62.44901952244514]
The conditional average treatment effect (CATE) is the best point prediction of individual causal effects.
In aggregate analyses, this is usually addressed by measuring distributional treatment effect (DTE)
We provide a new robust and model-agnostic methodology for learning the conditional DTE (CDTE) for a wide class of problems.
arXiv Detail & Related papers (2022-05-23T17:40:31Z) - Treatment Effect Risk: Bounds and Inference [58.442274475425144]
Since the average treatment effect measures the change in social welfare, even if positive, there is a risk of negative effect on, say, some 10% of the population.
In this paper we consider how to nonetheless assess this important risk measure, formalized as the conditional value at risk (CVaR) of the ITE distribution.
Some bounds can also be interpreted as summarizing a complex CATE function into a single metric and are of interest independently of being a bound.
arXiv Detail & Related papers (2022-01-15T17:21:26Z) - Assessment of Treatment Effect Estimators for Heavy-Tailed Data [70.72363097550483]
A central obstacle in the objective assessment of treatment effect (TE) estimators in randomized control trials (RCTs) is the lack of ground truth (or validation set) to test their performance.
We provide a novel cross-validation-like methodology to address this challenge.
We evaluate our methodology across 709 RCTs implemented in the Amazon supply chain.
arXiv Detail & Related papers (2021-12-14T17:53:01Z) - Controlling False Positive/Negative Rates for Deep-Learning-Based
Prostate Cancer Detection on Multiparametric MR images [58.85481248101611]
We propose a novel PCa detection network that incorporates a lesion-level cost-sensitive loss and an additional slice-level loss based on a lesion-to-slice mapping function.
Our experiments based on 290 clinical patients concludes that 1) The lesion-level FNR was effectively reduced from 0.19 to 0.10 and the lesion-level FPR was reduced from 1.03 to 0.66 by changing the lesion-level cost.
arXiv Detail & Related papers (2021-06-04T09:51:27Z) - COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital
Contact Tracing [68.68882022019272]
COVI-AgentSim is an agent-based compartmental simulator based on virology, disease progression, social contact networks, and mobility patterns.
We use COVI-AgentSim to perform cost-adjusted analyses comparing no DCT to: 1) standard binary contact tracing (BCT) that assigns binary recommendations based on binary test results; and 2) a rule-based method for feature-based contact tracing (FCT) that assigns a graded level of recommendation based on diverse individual features.
arXiv Detail & Related papers (2020-10-30T00:47:01Z) - Estimating heterogeneous survival treatment effect in observational data
using machine learning [9.951103976634407]
Methods for estimating heterogeneous treatment effect in observational data have largely focused on continuous or binary outcomes.
Using flexible machine learning methods in the counterfactual framework is a promising approach to address challenges due to complex individual characteristics.
arXiv Detail & Related papers (2020-08-17T01:02:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.