Efficient Adaptive Experimental Design for Average Treatment Effect Estimation

• URL: http://arxiv.org/abs/2002.05308v4
• Date: Tue, 26 Oct 2021 10:01:31 GMT
• Title: Efficient Adaptive Experimental Design for Average Treatment Effect Estimation
• Authors: Masahiro Kato, Takuya Ishihara, Junya Honda, Yusuke Narita
• Abstract summary: We propose an algorithm for efficient experiments with estimators constructed from dependent samples. To justify our proposed approach, we provide finite and infinite sample analyses.
• Score: 18.027128141189355
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The goal of many scientific experiments including A/B testing is to estimate the average treatment effect (ATE), which is defined as the difference between the expected outcomes of two or more treatments. In this paper, we consider a situation where an experimenter can assign a treatment to research subjects sequentially. In adaptive experimental design, the experimenter is allowed to change the probability of assigning a treatment using past observations for estimating the ATE efficiently. However, with this approach, it is difficult to apply a standard statistical method to construct an estimator because the observations are not independent and identically distributed. We thus propose an algorithm for efficient experiments with estimators constructed from dependent samples. We also introduce a sequential testing framework using the proposed estimator. To justify our proposed approach, we provide finite and infinite sample analyses. Finally, we experimentally show that the proposed algorithm exhibits preferable performance.

Related papers

Err

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.