Distributionally Robust Recourse Action
- URL: http://arxiv.org/abs/2302.11211v1
- Date: Wed, 22 Feb 2023 08:52:01 GMT
- Title: Distributionally Robust Recourse Action
- Authors: Duy Nguyen, Ngoc Bui, Viet Anh Nguyen
- Abstract summary: A recourse action aims to explain a particular algorithmic decision by showing one specific way in which the instance could be modified to receive an alternate outcome.
We propose the Distributionally Robust Recourse Action (DiRRAc) framework, which generates a recourse action that has a high probability of being valid under a mixture of model shifts.
- Score: 12.139222986297263
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: A recourse action aims to explain a particular algorithmic decision by
showing one specific way in which the instance could be modified to receive an
alternate outcome. Existing recourse generation methods often assume that the
machine learning model does not change over time. However, this assumption does
not always hold in practice because of data distribution shifts, and in this
case, the recourse action may become invalid. To redress this shortcoming, we
propose the Distributionally Robust Recourse Action (DiRRAc) framework, which
generates a recourse action that has a high probability of being valid under a
mixture of model shifts. We formulate the robustified recourse setup as a
min-max optimization problem, where the max problem is specified by Gelbrich
distance over an ambiguity set around the distribution of model parameters.
Then we suggest a projected gradient descent algorithm to find a robust
recourse according to the min-max objective. We show that our DiRRAc framework
can be extended to hedge against the misspecification of the mixture weights.
Numerical experiments with both synthetic and three real-world datasets
demonstrate the benefits of our proposed framework over state-of-the-art
recourse methods.
Related papers
- Perfect Counterfactuals in Imperfect Worlds: Modelling Noisy Implementation of Actions in Sequential Algorithmic Recourse [26.57812122315108]
Algorithmic recourse provides actions to individuals who have been adversely affected by automated decision-making.
Knowing the recourse does not guarantee that users would implement it perfectly, either due to environmental variability or personal choices.
We propose the RObust SEquential (ROSE) recourse generator to output a sequence of steps that will lead to the desired outcome even under imperfect implementation.
arXiv Detail & Related papers (2024-10-03T07:47:42Z) - Training Normalizing Flows with the Precision-Recall Divergence [73.92251251511199]
We show that achieving a specified precision-recall trade-off corresponds to minimising -divergences from a family we call the em PR-divergences
We propose a novel generative model that is able to train a normalizing flow to minimise any -divergence, and in particular, achieve a given precision-recall trade-off.
arXiv Detail & Related papers (2023-02-01T17:46:47Z) - Robust Bayesian Recourse [13.526999070658231]
Algorithmic recourse aims to recommend an informative feedback to overturn an unfavorable machine learning decision.
We introduce in this paper the Bayesian recourse, a model-agnostic recourse that minimizes the posterior probability odds ratio.
We present our min-max robust counterpart with the goal of hedging against future changes in the machine learning model parameters.
arXiv Detail & Related papers (2022-06-22T04:17:17Z) - Toward Certified Robustness Against Real-World Distribution Shifts [65.66374339500025]
We train a generative model to learn perturbations from data and define specifications with respect to the output of the learned model.
A unique challenge arising from this setting is that existing verifiers cannot tightly approximate sigmoid activations.
We propose a general meta-algorithm for handling sigmoid activations which leverages classical notions of counter-example-guided abstraction refinement.
arXiv Detail & Related papers (2022-06-08T04:09:13Z) - Distributionally Robust Models with Parametric Likelihood Ratios [123.05074253513935]
Three simple ideas allow us to train models with DRO using a broader class of parametric likelihood ratios.
We find that models trained with the resulting parametric adversaries are consistently more robust to subpopulation shifts when compared to other DRO approaches.
arXiv Detail & Related papers (2022-04-13T12:43:12Z) - Probabilistically Robust Recourse: Navigating the Trade-offs between
Costs and Robustness in Algorithmic Recourse [34.39887495671287]
We propose an objective function which simultaneously minimizes the gap between the achieved (resulting) and desired recourse invalidation rates.
We develop novel theoretical results to characterize the recourse invalidation rates corresponding to any given instance.
Experimental evaluation with multiple real world datasets demonstrates the efficacy of the proposed framework.
arXiv Detail & Related papers (2022-03-13T21:39:24Z) - A Variational Inference Approach to Inverse Problems with Gamma
Hyperpriors [60.489902135153415]
This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors.
The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement.
arXiv Detail & Related papers (2021-11-26T06:33:29Z) - Algorithmic Recourse in Partially and Fully Confounded Settings Through
Bounding Counterfactual Effects [0.6299766708197883]
Algorithmic recourse aims to provide actionable recommendations to individuals to obtain a more favourable outcome from an automated decision-making system.
Existing methods compute the effect of recourse actions using a causal model learnt from data under the assumption of no hidden confounding and modelling assumptions such as additive noise.
We propose an alternative approach for discrete random variables which relaxes these assumptions and allows for unobserved confounding and arbitrary structural equations.
arXiv Detail & Related papers (2021-06-22T15:07:49Z) - Modeling the Second Player in Distributionally Robust Optimization [90.25995710696425]
We argue for the use of neural generative models to characterize the worst-case distribution.
This approach poses a number of implementation and optimization challenges.
We find that the proposed approach yields models that are more robust than comparable baselines.
arXiv Detail & Related papers (2021-03-18T14:26:26Z) - Gaussian MRF Covariance Modeling for Efficient Black-Box Adversarial
Attacks [86.88061841975482]
We study the problem of generating adversarial examples in a black-box setting, where we only have access to a zeroth order oracle.
We use this setting to find fast one-step adversarial attacks, akin to a black-box version of the Fast Gradient Sign Method(FGSM)
We show that the method uses fewer queries and achieves higher attack success rates than the current state of the art.
arXiv Detail & Related papers (2020-10-08T18:36:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.