A Review of Generalizability and Transportability

• URL: http://arxiv.org/abs/2102.11904v1
• Date: Tue, 23 Feb 2021 19:34:13 GMT
• Title: A Review of Generalizability and Transportability
• Authors: Irina Degtiar and Sherri Rose
• Abstract summary: Estimates from randomized data may have internal validity but are often not representative of the target population. Observational data may better reflect the target population, and hence be more likely to have external validity, but are subject to potential bias due to unmeasured confounding. This paper presents a framework for addressing external validity bias, including a synthesis of approaches for generalizability and transportability.
• Score: 0.18275108630751835
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: When assessing causal effects, determining the target population to which the results are intended to generalize is a critical decision. Randomized and observational studies each have strengths and limitations for estimating causal effects in a target population. Estimates from randomized data may have internal validity but are often not representative of the target population. Observational data may better reflect the target population, and hence be more likely to have external validity, but are subject to potential bias due to unmeasured confounding. While much of the causal inference literature has focused on addressing internal validity bias, both internal and external validity are necessary for unbiased estimates in a target population. This paper presents a framework for addressing external validity bias, including a synthesis of approaches for generalizability and transportability, the assumptions they require, as well as tests for the heterogeneity of treatment effects and differences between study and target populations.

Related papers

• Data Fusion for Partial Identification of Causal Effects [62.56890808004615]
  We propose a novel partial identification framework that enables researchers to answer key questions.<n>Is the causal effect positive or negative? and How severe must assumption violations be to overturn this conclusion?<n>We apply our framework to the Project STAR study, which investigates the effect of classroom size on students' third-grade standardized test performance.
  arXiv  Detail & Related papers  (2025-05-30T07:13:01Z)
• Causal Lifting of Neural Representations: Zero-Shot Generalization for Causal Inferences [56.23412698865433]
  We focus on causal inferences on a target experiment with unlabeled factual outcomes, retrieved by a predictive model fine-tuned on a labeled similar experiment. First, we show that factual outcome estimation via Empirical Risk Minimization (ERM) may fail to yield valid causal inferences on the target population. We propose Deconfounded Empirical Risk Minimization (DERM), a new simple learning procedure minimizing the risk over a fictitious target population.
  arXiv  Detail & Related papers  (2025-02-10T10:52:17Z)
• Formalising causal inference as prediction on a target population [7.09435109588801]
  In this paper, we develop a version of the potential outcomes framework due to Neyman and Rubin.<n>We construes causal inference as treatment-wise predictions for finite populations where all assumptions are testable in retrospect.
  arXiv  Detail & Related papers  (2024-07-24T16:07:57Z)
• Reduced-Rank Multi-objective Policy Learning and Optimization [57.978477569678844]
  In practice, causal researchers do not have a single outcome in mind a priori. In government-assisted social benefit programs, policymakers collect many outcomes to understand the multidimensional nature of poverty. We present a data-driven dimensionality-reduction methodology for multiple outcomes in the context of optimal policy learning.
  arXiv  Detail & Related papers  (2024-04-29T08:16:30Z)
• Principles from Clinical Research for NLP Model Generalization [10.985226652193543]
  We explore the foundations of generalizability and study the factors that affect it. We demonstrate how learning spurious correlations, such as the distance between entities in relation extraction tasks, can affect a model's internal validity.
  arXiv  Detail & Related papers  (2023-11-07T02:17:25Z)
• Causality and Independence Enhancement for Biased Node Classification [56.38828085943763]
  We propose a novel Causality and Independence Enhancement (CIE) framework, applicable to various graph neural networks (GNNs) Our approach estimates causal and spurious features at the node representation level and mitigates the influence of spurious correlations. Our approach CIE not only significantly enhances the performance of GNNs but outperforms state-of-the-art debiased node classification methods.
  arXiv  Detail & Related papers  (2023-10-14T13:56:24Z)
• Nonparametric Identifiability of Causal Representations from Unknown Interventions [63.1354734978244]
  We study causal representation learning, the task of inferring latent causal variables and their causal relations from mixtures of the variables. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data.
  arXiv  Detail & Related papers  (2023-06-01T10:51:58Z)
• Robustness Evaluation of Regression Tasks with Skewed Domain Preferences [3.42658286826597]
  We deal with two encapsulated problems simultaneously. First, assessing the performance of regression models when non-uniform preferences apply. Second, assessing the robustness of models when dealing with uncertainty regarding the actual underlying distribution of values relevant for such problems.
  arXiv  Detail & Related papers  (2022-12-15T00:37:41Z)
• Externally Valid Policy Choice [0.0]
  We consider the problem of estimating personalized treatment policies that are "externally valid" or "generalizable"<n>We first show that welfare-maximizing policies for the experimental population are robust to a certain class of shifts in the distribution of potential outcomes between the experimental and target populations (holding characteristics fixed)<n>We then develop methods for estimating policies that are robust to shifts in the joint distribution of outcomes and characteristics.
  arXiv  Detail & Related papers  (2022-05-11T15:19:22Z)
• Empirical Estimates on Hand Manipulation are Recoverable: A Step Towards Individualized and Explainable Robotic Support in Everyday Activities [80.37857025201036]
  Key challenge for robotic systems is to figure out the behavior of another agent. Processing correct inferences is especially challenging when (confounding) factors are not controlled experimentally. We propose equipping robots with the necessary tools to conduct observational studies on people.
  arXiv  Detail & Related papers  (2022-01-27T22:15:56Z)
• Conditional Cross-Design Synthesis Estimators for Generalizability in Medicaid [0.1259953341639576]
  We propose a class of novel conditional cross-design synthesis estimators that combine randomized and observational data. We apply these methods to estimate the causal effect of managed care plans on health care spending among Medicaid beneficiaries in New York City.
  arXiv  Detail & Related papers  (2021-09-27T18:20:32Z)
• Causes of Effects: Learning individual responses from population data [23.593582720307207]
  We study the problem of individualization and its applications in medicine. For example, the probability of benefiting from a treatment concerns an individual having a favorable outcome if treated and an unfavorable outcome if untreated. We analyze and expand on existing research by applying bounds to the probability of necessity and sufficiency (PNS) along with graphical criteria and practical applications.
  arXiv  Detail & Related papers  (2021-04-28T12:38:11Z)
• Assessing External Validity Over Worst-case Subpopulations [8.98526174345299]
  Study populations are typically sampled from limited points in space and time. We propose and evaluate the worst-case treatment effect (WTE) across all subpopulations of a given size. We develop a semiparametrically efficient estimator for the WTE that analyzes the external validity of the augmented inverse propensity weighted estimator for the average treatment effect.
  arXiv  Detail & Related papers  (2020-07-05T18:34:14Z)
• Enabling Counterfactual Survival Analysis with Balanced Representations [64.17342727357618]
  Survival data are frequently encountered across diverse medical applications, i.e., drug development, risk profiling, and clinical trials. We propose a theoretically grounded unified framework for counterfactual inference applicable to survival outcomes.
  arXiv  Detail & Related papers  (2020-06-14T01:15:00Z)
• Survival Cluster Analysis [93.50540270973927]
  There is an unmet need in survival analysis for identifying subpopulations with distinct risk profiles. An approach that addresses this need is likely to improve characterization of individual outcomes.
  arXiv  Detail & Related papers  (2020-02-29T22:41:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.