Hi-CI: Deep Causal Inference in High Dimensions
- URL: http://arxiv.org/abs/2008.09858v3
- Date: Fri, 9 Apr 2021 11:56:02 GMT
- Title: Hi-CI: Deep Causal Inference in High Dimensions
- Authors: Ankit Sharma, Garima Gupta, Ranjitha Prasad, Arnab Chatterjee,
Lovekesh Vig, Gautam Shroff
- Abstract summary: We propose Hi-CI, a deep neural network (DNN) based framework for estimating causal effects.
We demonstrate the efficacy of causal effect prediction of the proposed Hi-CI network using synthetic and real-world NEWS datasets.
- Score: 23.588253984635987
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We address the problem of counterfactual regression using causal inference
(CI) in observational studies consisting of high dimensional covariates and
high cardinality treatments. Confounding bias, which leads to inaccurate
treatment effect estimation, is attributed to covariates that affect both
treatments and outcome. The presence of high-dimensional co-variates
exacerbates the impact of bias as it is harder to isolate and measure the
impact of these confounders. In the presence of high-cardinality treatment
variables, CI is rendered ill-posed due to the increase in the number of
counterfactual outcomes to be predicted. We propose Hi-CI, a deep neural
network (DNN) based framework for estimating causal effects in the presence of
large number of covariates, and high-cardinal and continuous treatment
variables. The proposed architecture comprises of a decorrelation network and
an outcome prediction network. In the decorrelation network, we learn a data
representation in lower dimensions as compared to the original covariates and
addresses confounding bias alongside. Subsequently, in the outcome prediction
network, we learn an embedding of high-cardinality and continuous treatments,
jointly with the data representation. We demonstrate the efficacy of causal
effect prediction of the proposed Hi-CI network using synthetic and real-world
NEWS datasets.
Related papers
- Estimating Peer Direct and Indirect Effects in Observational Network Data [16.006409149421515]
We propose a general setting which considers both peer direct effects and peer indirect effects, and the effect of an individual's own treatment.
We use attention mechanisms to distinguish the influences of different neighbors and explore high-order neighbor effects through graph neural networks.
Our theoretical findings have the potential to improve intervention strategies in networked systems, with applications in areas such as social networks and epidemiology.
arXiv Detail & Related papers (2024-08-21T10:02:05Z) - Advancing Counterfactual Inference through Nonlinear Quantile Regression [77.28323341329461]
We propose a framework for efficient and effective counterfactual inference implemented with neural networks.
The proposed approach enhances the capacity to generalize estimated counterfactual outcomes to unseen data.
Empirical results conducted on multiple datasets offer compelling support for our theoretical assertions.
arXiv Detail & Related papers (2023-06-09T08:30:51Z) - How Tempering Fixes Data Augmentation in Bayesian Neural Networks [22.188535244056016]
We show that tempering implicitly reduces the misspecification arising from modeling augmentations as i.i.d. data.
The temperature mimics the role of the effective sample size, reflecting the gain in information provided by the augmentations.
arXiv Detail & Related papers (2022-05-27T11:06:56Z) - Improving Prediction of Cognitive Performance using Deep Neural Networks
in Sparse Data [2.867517731896504]
We used data from an observational, cohort study, Midlife in the United States (MIDUS) to model executive function and episodic memory measures.
Deep neural network (DNN) models consistently ranked highest in all of the cognitive performance prediction tasks.
arXiv Detail & Related papers (2021-12-28T22:23:08Z) - Dimension-Free Average Treatment Effect Inference with Deep Neural
Networks [6.704751710867747]
This paper investigates the estimation and inference of the average treatment effect (ATE) using deep neural networks (DNNs) in the potential outcomes framework.
We show that both DNN estimates of ATE are consistent with dimension-free consistency rates under some assumptions on the underlying true mean regression model.
arXiv Detail & Related papers (2021-12-02T19:28:37Z) - SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event
Data [83.50281440043241]
We study the problem of inferring heterogeneous treatment effects from time-to-event data.
We propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations.
arXiv Detail & Related papers (2021-10-26T20:13:17Z) - Learning Neural Causal Models with Active Interventions [83.44636110899742]
We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process.
Our method significantly reduces the required number of interactions compared with random intervention targeting.
We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
arXiv Detail & Related papers (2021-09-06T13:10:37Z) - Efficient Causal Inference from Combined Observational and
Interventional Data through Causal Reductions [68.6505592770171]
Unobserved confounding is one of the main challenges when estimating causal effects.
We propose a novel causal reduction method that replaces an arbitrary number of possibly high-dimensional latent confounders.
We propose a learning algorithm to estimate the parameterized reduced model jointly from observational and interventional data.
arXiv Detail & Related papers (2021-03-08T14:29:07Z) - CDSM -- Casual Inference using Deep Bayesian Dynamic Survival Models [3.9169188005935927]
We have developed a causal dynamic survival model (CDSM) that uses the potential outcomes framework with the Bayesian recurrent sub-networks to estimate the difference in survival curves.
Using simulated survival datasets, CDSM has shown good causal effect estimation performance across scenarios of sample dimension, event rate, confounding and overlapping.
arXiv Detail & Related papers (2021-01-26T09:15:49Z) - DeepRite: Deep Recurrent Inverse TreatmEnt Weighting for Adjusting
Time-varying Confounding in Modern Longitudinal Observational Data [68.29870617697532]
We propose Deep Recurrent Inverse TreatmEnt weighting (DeepRite) for time-varying confounding in longitudinal data.
DeepRite is shown to recover the ground truth from synthetic data, and estimate unbiased treatment effects from real data.
arXiv Detail & Related papers (2020-10-28T15:05:08Z) - Network Diffusions via Neural Mean-Field Dynamics [52.091487866968286]
We propose a novel learning framework for inference and estimation problems of diffusion on networks.
Our framework is derived from the Mori-Zwanzig formalism to obtain an exact evolution of the node infection probabilities.
Our approach is versatile and robust to variations of the underlying diffusion network models.
arXiv Detail & Related papers (2020-06-16T18:45:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.