Decision-Value Attribution in Predict-then-Optimize Systems
- URL: http://arxiv.org/abs/2606.29878v1
- Date: Mon, 29 Jun 2026 07:17:05 GMT
- Title: Decision-Value Attribution in Predict-then-Optimize Systems
- Abstract summary: Decision Value Attribution (DVA) is a framework for attributing the value of a fixed prediction--optimization pipeline.<n>We present three variants: InfoDVA attributes value to features, DesignDVA attributes value to operational configurations, and Decision-Value Interactions (DVI) quantifies how information and design jointly create value.
- Score: 42.371764229953165
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Predictive models are increasingly embedded in operational decision-making, yet standard explanation methods typically explain forecasts rather than the decisions those forecasts induce. This distinction is important in predict-then-optimize systems: large forecast changes may leave the optimizer's action unchanged, while small changes can alter the selected decision and its realized value. We propose Decision Value Attribution (DVA), a Shapley-based framework for attributing the value of a fixed prediction--optimization pipeline. The framework defines cooperative games whose payoff is the downstream decision value, allowing the players to be information sources, optimization or design parameters, or both. We present three variants: InfoDVA attributes value to features, DesignDVA attributes value to operational configurations, and Decision-Value Interactions (DVI) quantifies how information and design jointly create value. We further distinguish post-DVA, which evaluates decisions using realized outcomes, from pre-DVA, which evaluates decisions under the model's full prediction. This separation turns attribution into a decision-level diagnostic of whether the model's operational beliefs align with realized performance. The resulting attributions are expressed in the units of the operational objective and decompose the gain or loss relative to a baseline. Case studies in electricity storage arbitrage and emergency medical service coverage show that predictive explanations can be poor proxies for operational value, that DVA can guide targeted information-control interventions, and that optimization configurations determine when predictive information is decision-relevant.
Related papers
- Decision-Driven Regularization: A Blended Model for Learning and Optimization [1.4055982190455338]
We study the learning and optimization approach, which first learns how outcomes result from the features, and then selects optimal decisions based on these outcomes.<n>We propose a bi-objective formulation that balances prediction accuracy and cost minimization, termed decision-driven regularization.
arXiv Detail & Related papers (2026-08-15T08:49:33Z) - Bridging Predictions and Interventions: An Integrated Framework for Automated Decision-Systems [44.41008845972734]
This Perspective develops an integrated framework for studying automated decision systems (ADS) in social systems.<n>Our aim is to improve our understanding of ADS and more meaningfully anticipate its downstream societal and organizational consequences.
arXiv Detail & Related papers (2026-06-24T10:29:10Z) - Treatment Effect Estimation for Optimal Decision-Making [65.30942348196443]
We study optimal decision-making based on two-stage CATE estimators.<n>We propose a novel two-stage learning objective that retargets the CATE to balance CATE estimation error and decision performance.
arXiv Detail & Related papers (2025-05-19T13:24:57Z) - Evaluating and Correcting Performative Effects of Decision Support
Systems via Causal Domain Shift [1.6574413179773764]
Decision Support System provides a prediction for an agent to affect the value of the target variable.
When deploying a DSS in high-stakes settings it is imperative to carefully assess the performative effects of the DSS.
We propose to model the deployment of a DSS as causal domain shift and provide novel cross-domain identification results.
arXiv Detail & Related papers (2024-03-01T10:19:17Z) - End-to-End Learning for Fair Multiobjective Optimization Under
Uncertainty [55.04219793298687]
The Predict-Then-Forecast (PtO) paradigm in machine learning aims to maximize downstream decision quality.
This paper extends the PtO methodology to optimization problems with nondifferentiable Ordered Weighted Averaging (OWA) objectives.
It shows how optimization of OWA functions can be effectively integrated with parametric prediction for fair and robust optimization under uncertainty.
arXiv Detail & Related papers (2024-02-12T16:33:35Z) - Prediction-Oriented Bayesian Active Learning [51.426960808684655]
Expected predictive information gain (EPIG) is an acquisition function that measures information gain in the space of predictions rather than parameters.
EPIG leads to stronger predictive performance compared with BALD across a range of datasets and models.
arXiv Detail & Related papers (2023-04-17T10:59:57Z) - Robust Design and Evaluation of Predictive Algorithms under Unobserved Confounding [6.925076885159747]
We propose a framework for robust design and evaluation of predictive algorithms.<n>We show that varying confounding assumptions substantially affects credit risk predictions and fairness evaluations across income groups.
arXiv Detail & Related papers (2022-12-19T20:41:44Z) - Data-Driven Offline Decision-Making via Invariant Representation
Learning [97.49309949598505]
offline data-driven decision-making involves synthesizing optimized decisions with no active interaction.
A key challenge is distributional shift: when we optimize with respect to the input into a model trained from offline data, it is easy to produce an out-of-distribution (OOD) input that appears erroneously good.
In this paper, we formulate offline data-driven decision-making as domain adaptation, where the goal is to make accurate predictions for the value of optimized decisions.
arXiv Detail & Related papers (2022-11-21T11:01:37Z) - Regret Bounds and Experimental Design for Estimate-then-Optimize [9.340611077939828]
In practical applications, data is used to make decisions in two steps: estimation and optimization.
Errors in the estimation step can lead estimate-then-optimize to sub-optimal decisions.
We provide a novel bound on this regret for smooth and unconstrained optimization problems.
arXiv Detail & Related papers (2022-10-27T16:13:48Z) - Explainability's Gain is Optimality's Loss? -- How Explanations Bias
Decision-making [0.0]
Explanations help to facilitate communication between the algorithm and the human decision-maker.
Feature-based explanations' semantics of causal models induce leakage from the decision-maker's prior beliefs.
Such differences can lead to sub-optimal and biased decision outcomes.
arXiv Detail & Related papers (2022-06-17T11:43:42Z) - Inverse Active Sensing: Modeling and Understanding Timely
Decision-Making [111.07204912245841]
We develop a framework for the general setting of evidence-based decision-making under endogenous, context-dependent time pressure.
We demonstrate how it enables modeling intuitive notions of surprise, suspense, and optimality in decision strategies.
arXiv Detail & Related papers (2020-06-25T02:30:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.