A Unifying Framework for Causal Explanation of Sequential Decision
Making
- URL: http://arxiv.org/abs/2205.15462v1
- Date: Mon, 30 May 2022 23:17:58 GMT
- Title: A Unifying Framework for Causal Explanation of Sequential Decision
Making
- Authors: Samer B. Nashed and Saaduddin Mahmud and Claudia V. Goldman and Shlomo
Zilberstein
- Abstract summary: We present a novel framework for causal explanations of sequential decision-making systems.
We show how to identify semantically distinct types of explanations for agent actions using a single unified approach.
- Score: 24.29934526009098
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present a novel framework for causal explanations of stochastic,
sequential decision-making systems. Building on the well-studied structural
causal model paradigm for causal reasoning, we show how to identify
semantically distinct types of explanations for agent actions using a single
unified approach. We provide results on the generality of this framework, run
time bounds, and offer several approximate techniques. Finally, we discuss
several qualitative scenarios that illustrate the framework's flexibility and
efficacy.
Related papers
- A process algebraic framework for multi-agent dynamic epistemic systems [55.2480439325792]
We propose a unifying framework for modeling and analyzing multi-agent, knowledge-based, dynamic systems.
On the modeling side, we propose a process algebraic, agent-oriented specification language that makes such a framework easy to use for practical purposes.
arXiv Detail & Related papers (2024-07-24T08:35:50Z) - Fast Explanations via Policy Gradient-Optimized Explainer [7.011763596804071]
This paper introduces a novel framework that represents attribution-based explanations via probability distributions.
The proposed framework offers a robust, scalable solution for real-time, large-scale model explanations.
We validate our framework on image and text classification tasks and the experiments demonstrate that our method reduces inference time by over 97% and memory usage by 70%.
arXiv Detail & Related papers (2024-05-29T00:01:40Z) - Distribution-consistency Structural Causal Models [6.276417011421679]
We introduce a novel textitdistribution-consistency assumption, and in alignment with it, we propose the Distribution-consistency Structural Causal Models (DiscoSCMs)
To concretely reveal the enhanced model capacity, we introduce a new identifiable causal parameter, textitthe probability of consistency, which holds practical significance within DiscoSCM alone.
arXiv Detail & Related papers (2024-01-29T06:46:15Z) - An Axiomatic Approach to Model-Agnostic Concept Explanations [67.84000759813435]
We propose an approach to concept explanations that satisfy three natural axioms: linearity, recursivity, and similarity.
We then establish connections with previous concept explanation methods, offering insight into their varying semantic meanings.
arXiv Detail & Related papers (2024-01-12T20:53:35Z) - A Semantic Approach to Decidability in Epistemic Planning (Extended
Version) [72.77805489645604]
We use a novel semantic approach to achieve decidability.
Specifically, we augment the logic of knowledge S5$_n$ and with an interaction axiom called (knowledge) commutativity.
We prove that our framework admits a finitary non-fixpoint characterization of common knowledge, which is of independent interest.
arXiv Detail & Related papers (2023-07-28T11:26:26Z) - A Model-Agnostic SAT-based Approach for Symbolic Explanation Enumeration [26.500149465292246]
We generate explanations to locally explain a single prediction by analyzing the relationship between the features and the output.
Our approach uses a propositional encoding of the predictive model and a SAT-based setting to generate two types of symbolic explanations Sufficient Reasons and Counterfactuals.
arXiv Detail & Related papers (2022-06-23T08:35:47Z) - Explainability in Process Outcome Prediction: Guidelines to Obtain
Interpretable and Faithful Models [77.34726150561087]
We define explainability through the interpretability of the explanations and the faithfulness of the explainability model in the field of process outcome prediction.
This paper contributes a set of guidelines named X-MOP which allows selecting the appropriate model based on the event log specifications.
arXiv Detail & Related papers (2022-03-30T05:59:50Z) - A Formalisation of Abstract Argumentation in Higher-Order Logic [77.34726150561087]
We present an approach for representing abstract argumentation frameworks based on an encoding into classical higher-order logic.
This provides a uniform framework for computer-assisted assessment of abstract argumentation frameworks using interactive and automated reasoning tools.
arXiv Detail & Related papers (2021-10-18T10:45:59Z) - Counterfactual Explanations in Sequential Decision Making Under
Uncertainty [27.763369810430653]
We develop methods to find counterfactual explanations for sequential decision making processes.
In our problem formulation, the counterfactual explanation specifies an alternative sequence of actions differing in at most k actions.
We show that our algorithm finds can provide valuable insights to enhance decision making under uncertainty.
arXiv Detail & Related papers (2021-07-06T17:38:19Z) - Towards Interpretable Reasoning over Paragraph Effects in Situation [126.65672196760345]
We focus on the task of reasoning over paragraph effects in situation, which requires a model to understand the cause and effect.
We propose a sequential approach for this task which explicitly models each step of the reasoning process with neural network modules.
In particular, five reasoning modules are designed and learned in an end-to-end manner, which leads to a more interpretable model.
arXiv Detail & Related papers (2020-10-03T04:03:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.