Orthogonal Series Estimation for the Ratio of Conditional Expectation
Functions
- URL: http://arxiv.org/abs/2212.13145v1
- Date: Mon, 26 Dec 2022 13:01:17 GMT
- Title: Orthogonal Series Estimation for the Ratio of Conditional Expectation
Functions
- Authors: Kazuhiko Shinoda and Takahiro Hoshino
- Abstract summary: This chapter develops the general framework for estimation and inference on conditional expectation functions (CEFR)
We derive the pointwise and uniform results for estimation and inference on CEFR, including the validity of the Gaussian bootstrap.
We apply the proposed method to estimate the causal effect of the 401(k) program on household assets.
- Score: 2.855485723554975
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In various fields of data science, researchers are often interested in
estimating the ratio of conditional expectation functions (CEFR). Specifically
in causal inference problems, it is sometimes natural to consider ratio-based
treatment effects, such as odds ratios and hazard ratios, and even
difference-based treatment effects are identified as CEFR in some empirically
relevant settings. This chapter develops the general framework for estimation
and inference on CEFR, which allows the use of flexible machine learning for
infinite-dimensional nuisance parameters. In the first stage of the framework,
the orthogonal signals are constructed using debiased machine learning
techniques to mitigate the negative impacts of the regularization bias in the
nuisance estimates on the target estimates. The signals are then combined with
a novel series estimator tailored for CEFR. We derive the pointwise and uniform
asymptotic results for estimation and inference on CEFR, including the validity
of the Gaussian bootstrap, and provide low-level sufficient conditions to apply
the proposed framework to some specific examples. We demonstrate the
finite-sample performance of the series estimator constructed under the
proposed framework by numerical simulations. Finally, we apply the proposed
method to estimate the causal effect of the 401(k) program on household assets.
Related papers
- Average Causal Effect Estimation in DAGs with Hidden Variables: Extensions of Back-Door and Front-Door Criteria [3.0232957374216953]
We develop one-step corrected plug-in and targeted minimum loss-based estimators of causal effects for a class of directed aparametric graphs (DAGs) with hidden variables.
We leverage machine learning to minimize modeling assumptions while ensuring key statistical properties such as linear primality, double robustness, efficiency, and staying within the bounds of the target parameter space.
arXiv Detail & Related papers (2024-09-06T01:07:29Z) - C-Learner: Constrained Learning for Causal Inference and Semiparametric Statistics [5.395560682099634]
We propose a novel debiased estimator that achieves stable plug-in estimates with desirable properties.
Our constrained learning framework solves for the best plug-in estimator under the constraint that the first-order error with respect to the plugged-in quantity is zero.
Our estimator outperforms one-step estimation and targeting in challenging settings with limited overlap between treatment and control, and performs comparably otherwise.
arXiv Detail & Related papers (2024-05-15T16:38:28Z) - Targeted Machine Learning for Average Causal Effect Estimation Using the
Front-Door Functional [3.0232957374216953]
evaluating the average causal effect (ACE) of a treatment on an outcome often involves overcoming the challenges posed by confounding factors in observational studies.
Here, we introduce novel estimation strategies for the front-door criterion based on the targeted minimum loss-based estimation theory.
We demonstrate the applicability of these estimators to analyze the effect of early stage academic performance on future yearly income.
arXiv Detail & Related papers (2023-12-15T22:04:53Z) - Likelihood Ratio Confidence Sets for Sequential Decision Making [51.66638486226482]
We revisit the likelihood-based inference principle and propose to use likelihood ratios to construct valid confidence sequences.
Our method is especially suitable for problems with well-specified likelihoods.
We show how to provably choose the best sequence of estimators and shed light on connections to online convex optimization.
arXiv Detail & Related papers (2023-11-08T00:10:21Z) - Bayesian Cramér-Rao Bound Estimation with Score-Based Models [3.4480437706804503]
The Bayesian Cram'er-Rao bound (CRB) provides a lower bound on the mean square error of any Bayesian estimator under mild regularity conditions.
This work introduces a new data-driven estimator for the CRB using score matching.
arXiv Detail & Related papers (2023-09-28T00:22:21Z) - Advancing Counterfactual Inference through Nonlinear Quantile Regression [77.28323341329461]
We propose a framework for efficient and effective counterfactual inference implemented with neural networks.
The proposed approach enhances the capacity to generalize estimated counterfactual outcomes to unseen data.
Empirical results conducted on multiple datasets offer compelling support for our theoretical assertions.
arXiv Detail & Related papers (2023-06-09T08:30:51Z) - Learning to Estimate Without Bias [57.82628598276623]
Gauss theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models.
In this paper, we take a first step towards extending this result to non linear settings via deep learning with bias constraints.
A second motivation to BCE is in applications where multiple estimates of the same unknown are averaged for improved performance.
arXiv Detail & Related papers (2021-10-24T10:23:51Z) - Cluster Regularization via a Hierarchical Feature Regression [0.0]
This paper proposes a novel cluster-based regularization - the hierarchical feature regression (HFR)
It mobilizes insights from the domains of machine learning and graph theory to estimate parameters along a supervised hierarchical representation of the predictor set.
An application to the prediction of economic growth is used to illustrate the HFR's effectiveness in an empirical setting.
arXiv Detail & Related papers (2021-07-10T13:03:01Z) - Deconfounding Scores: Feature Representations for Causal Effect
Estimation with Weak Overlap [140.98628848491146]
We introduce deconfounding scores, which induce better overlap without biasing the target of estimation.
We show that deconfounding scores satisfy a zero-covariance condition that is identifiable in observed data.
In particular, we show that this technique could be an attractive alternative to standard regularizations.
arXiv Detail & Related papers (2021-04-12T18:50:11Z) - Causal Collaborative Filtering [50.22155187512759]
Causal Collaborative Filtering is a framework for modeling causality in collaborative filtering and recommendation.
We show that many traditional CF algorithms are actually special cases of CCF under simplified causal graphs.
We propose a conditional intervention approach for $do$-operations so that we can estimate the user-item causal preference.
arXiv Detail & Related papers (2021-02-03T04:16:11Z) - Machine learning for causal inference: on the use of cross-fit
estimators [77.34726150561087]
Doubly-robust cross-fit estimators have been proposed to yield better statistical properties.
We conducted a simulation study to assess the performance of several estimators for the average causal effect (ACE)
When used with machine learning, the doubly-robust cross-fit estimators substantially outperformed all of the other estimators in terms of bias, variance, and confidence interval coverage.
arXiv Detail & Related papers (2020-04-21T23:09:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.