Explainable Data-Driven Optimization: From Context to Decision and Back
Again
- URL: http://arxiv.org/abs/2301.10074v2
- Date: Wed, 19 Jul 2023 18:37:04 GMT
- Title: Explainable Data-Driven Optimization: From Context to Decision and Back
Again
- Authors: Alexandre Forel, Axel Parmentier, Thibaut Vidal
- Abstract summary: Data-driven optimization uses contextual information and machine learning algorithms to find solutions to decision problems with uncertain parameters.
We introduce a counterfactual explanation methodology tailored to explain solutions to data-driven problems.
We demonstrate our approach by explaining key problems in operations management such as inventory management and routing.
- Score: 76.84947521482631
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Data-driven optimization uses contextual information and machine learning
algorithms to find solutions to decision problems with uncertain parameters.
While a vast body of work is dedicated to interpreting machine learning models
in the classification setting, explaining decision pipelines involving learning
algorithms remains unaddressed. This lack of interpretability can block the
adoption of data-driven solutions as practitioners may not understand or trust
the recommended decisions. We bridge this gap by introducing a counterfactual
explanation methodology tailored to explain solutions to data-driven problems.
We introduce two classes of explanations and develop methods to find nearest
explanations of random forest and nearest-neighbor predictors. We demonstrate
our approach by explaining key problems in operations management such as
inventory management and routing.
Related papers
- Sequential Decision Making with Expert Demonstrations under Unobserved Heterogeneity [22.0059059325909]
We study the problem of online sequential decision-making given auxiliary demonstrations from experts who made their decisions based on unobserved contextual information.
This setting arises in many application domains, such as self-driving cars, healthcare, and finance.
We propose the Experts-as-Priors algorithm (ExPerior) to establish an informative prior distribution over the learner's decision-making problem.
arXiv Detail & Related papers (2024-04-10T18:00:17Z) - Predict-Then-Optimize by Proxy: Learning Joint Models of Prediction and
Optimization [59.386153202037086]
Predict-Then- framework uses machine learning models to predict unknown parameters of an optimization problem from features before solving.
This approach can be inefficient and requires handcrafted, problem-specific rules for backpropagation through the optimization step.
This paper proposes an alternative method, in which optimal solutions are learned directly from the observable features by predictive models.
arXiv Detail & Related papers (2023-11-22T01:32:06Z) - What and How of Machine Learning Transparency: Building Bespoke
Explainability Tools with Interoperable Algorithmic Components [77.87794937143511]
This paper introduces a collection of hands-on training materials for explaining data-driven predictive models.
These resources cover the three core building blocks of this technique: interpretable representation composition, data sampling and explanation generation.
arXiv Detail & Related papers (2022-09-08T13:33:25Z) - Inverse Online Learning: Understanding Non-Stationary and Reactionary
Policies [79.60322329952453]
We show how to develop interpretable representations of how agents make decisions.
By understanding the decision-making processes underlying a set of observed trajectories, we cast the policy inference problem as the inverse to this online learning problem.
We introduce a practical algorithm for retrospectively estimating such perceived effects, alongside the process through which agents update them.
Through application to the analysis of UNOS organ donation acceptance decisions, we demonstrate that our approach can bring valuable insights into the factors that govern decision processes and how they change over time.
arXiv Detail & Related papers (2022-03-14T17:40:42Z) - Synthesizing explainable counterfactual policies for algorithmic
recourse with program synthesis [18.485744170172545]
We learn a program that outputs a sequence of explainable counterfactual actions given a user description and a causal graph.
An experimental evaluation on synthetic and real-world datasets shows how our approach generates effective interventions.
arXiv Detail & Related papers (2022-01-18T17:16:45Z) - Learning MDPs from Features: Predict-Then-Optimize for Sequential
Decision Problems by Reinforcement Learning [52.74071439183113]
We study the predict-then-optimize framework in the context of sequential decision problems (formulated as MDPs) solved via reinforcement learning.
Two significant computational challenges arise in applying decision-focused learning to MDPs.
arXiv Detail & Related papers (2021-06-06T23:53:31Z) - Inverse Multiobjective Optimization Through Online Learning [14.366265951396587]
We study the problem of learning the objective functions or constraints of a multiobjective decision making model.
We develop two online learning algorithms with implicit update rules which can handle noisy data.
Numerical results show that both algorithms can learn the parameters with great accuracy and are robust to noise.
arXiv Detail & Related papers (2020-10-12T17:53:49Z) - Learning with Differentiable Perturbed Optimizers [54.351317101356614]
We propose a systematic method to transform operations into operations that are differentiable and never locally constant.
Our approach relies on perturbeds, and can be used readily together with existing solvers.
We show how this framework can be connected to a family of losses developed in structured prediction, and give theoretical guarantees for their use in learning tasks.
arXiv Detail & Related papers (2020-02-20T11:11:32Z) - Explaining Data-Driven Decisions made by AI Systems: The Counterfactual
Approach [11.871523410051527]
We consider an explanation as a set of the system's data inputs that causally drives the decision.
We show that features that have a large importance weight for a model prediction may not affect the corresponding decision.
arXiv Detail & Related papers (2020-01-21T09:58:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.