Counterfactual Analysis in Dynamic Latent State Models
- URL: http://arxiv.org/abs/2205.13832v4
- Date: Fri, 5 May 2023 19:02:26 GMT
- Title: Counterfactual Analysis in Dynamic Latent State Models
- Authors: Martin Haugh and Raghav Singal
- Abstract summary: We provide an optimization-based framework to perform counterfactual analysis in a dynamic model with hidden states.
We are the first to compute lower and upper bounds on a counterfactual query in a dynamic latent-state model.
- Score: 2.766648389933265
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We provide an optimization-based framework to perform counterfactual analysis
in a dynamic model with hidden states. Our framework is grounded in the
``abduction, action, and prediction'' approach to answer counterfactual queries
and handles two key challenges where (1) the states are hidden and (2) the
model is dynamic. Recognizing the lack of knowledge on the underlying causal
mechanism and the possibility of infinitely many such mechanisms, we optimize
over this space and compute upper and lower bounds on the counterfactual
quantity of interest. Our work brings together ideas from causality,
state-space models, simulation, and optimization, and we apply it on a breast
cancer case study. To the best of our knowledge, we are the first to compute
lower and upper bounds on a counterfactual query in a dynamic latent-state
model.
Related papers
- Rigorous Probabilistic Guarantees for Robust Counterfactual Explanations [80.86128012438834]
We show for the first time that computing the robustness of counterfactuals with respect to plausible model shifts is NP-complete.
We propose a novel probabilistic approach which is able to provide tight estimates of robustness with strong guarantees.
arXiv Detail & Related papers (2024-07-10T09:13:11Z) - Gradient Estimation and Variance Reduction in Stochastic and Deterministic Models [0.0]
This dissertation considers unconstrained, nonlinear optimization problems.
We focus on the gradient itself, that key quantity which enables the solution of such problems.
We present a new framework for calculating the gradient of problems involving both deterministic and elements.
arXiv Detail & Related papers (2024-05-14T14:41:58Z) - Distribution-consistency Structural Causal Models [6.276417011421679]
We introduce a novel textitdistribution-consistency assumption, and in alignment with it, we propose the Distribution-consistency Structural Causal Models (DiscoSCMs)
To concretely reveal the enhanced model capacity, we introduce a new identifiable causal parameter, textitthe probability of consistency, which holds practical significance within DiscoSCM alone.
arXiv Detail & Related papers (2024-01-29T06:46:15Z) - Interpretable Imitation Learning with Dynamic Causal Relations [65.18456572421702]
We propose to expose captured knowledge in the form of a directed acyclic causal graph.
We also design this causal discovery process to be state-dependent, enabling it to model the dynamics in latent causal graphs.
The proposed framework is composed of three parts: a dynamic causal discovery module, a causality encoding module, and a prediction module, and is trained in an end-to-end manner.
arXiv Detail & Related papers (2023-09-30T20:59:42Z) - Endogenous Macrodynamics in Algorithmic Recourse [52.87956177581998]
Existing work on Counterfactual Explanations (CE) and Algorithmic Recourse (AR) has largely focused on single individuals in a static environment.
We show that many of the existing methodologies can be collectively described by a generalized framework.
We then argue that the existing framework does not account for a hidden external cost of recourse, that only reveals itself when studying the endogenous dynamics of recourse at the group level.
arXiv Detail & Related papers (2023-08-16T07:36:58Z) - Distributed Bayesian Learning of Dynamic States [65.7870637855531]
The proposed algorithm is a distributed Bayesian filtering task for finite-state hidden Markov models.
It can be used for sequential state estimation, as well as for modeling opinion formation over social networks under dynamic environments.
arXiv Detail & Related papers (2022-12-05T19:40:17Z) - Maximum entropy exploration in contextual bandits with neural networks
and energy based models [63.872634680339644]
We present two classes of models, one with neural networks as reward estimators, and the other with energy based models.
We show that both techniques outperform well-known standard algorithms, where energy based models have the best overall performance.
This provides practitioners with new techniques that perform well in static and dynamic settings, and are particularly well suited to non-linear scenarios with continuous action spaces.
arXiv Detail & Related papers (2022-10-12T15:09:45Z) - A Theory of Dynamic Benchmarks [24.170405353348592]
We study the benefits and practical limitations of dynamic benchmarking.
These results provide a theoretical foundation and a causal explanation for observed bottlenecks in empirical work.
arXiv Detail & Related papers (2022-10-06T18:56:46Z) - Causal Dynamics Learning for Task-Independent State Abstraction [61.707048209272884]
We introduce Causal Dynamics Learning for Task-Independent State Abstraction (CDL)
CDL learns a theoretically proved causal dynamics model that removes unnecessary dependencies between state variables and the action.
A state abstraction can then be derived from the learned dynamics.
arXiv Detail & Related papers (2022-06-27T17:02:53Z) - Towards Robust and Reliable Algorithmic Recourse [11.887537452826624]
We propose a novel framework, RObust Algorithmic Recourse (ROAR), that leverages adversarial training for finding recourses that are robust to model shifts.
We also carry out detailed theoretical analysis which underscores the importance of constructing recourses that are robust to model shifts.
arXiv Detail & Related papers (2021-02-26T17:38:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.