Explaining the Black-box Smoothly- A Counterfactual Approach

• URL: http://arxiv.org/abs/2101.04230v1
• Date: Mon, 11 Jan 2021 23:12:11 GMT
• Title: Explaining the Black-box Smoothly- A Counterfactual Approach
• Abstract summary: We propose a BlackBox emphCounterfactual Explainer for medical imaging applications. Our framework explains the outcome by gradually emphexaggerating the semantic effect of the given outcome label.
• Score: 12.985758871588454
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: We propose a BlackBox \emph{Counterfactual Explainer} that is explicitly developed for medical imaging applications. Classical approaches (e.g. saliency maps) assessing feature importance do not explain \emph{how} and \emph{why} variations in a particular anatomical region is relevant to the outcome, which is crucial for transparent decision making in healthcare application. Our framework explains the outcome by gradually \emph{exaggerating} the semantic effect of the given outcome label. Given a query input to a classifier, Generative Adversarial Networks produce a progressive set of perturbations to the query image that gradually changes the posterior probability from its original class to its negation. We design the loss function to ensure that essential and potentially relevant details, such as support devices, are preserved in the counterfactually generated images. We provide an extensive evaluation of different classification tasks on the chest X-Ray images. Our experiments show that a counterfactually generated visual explanation is consistent with the disease's clinical relevant measurements, both quantitatively and qualitatively.

Related papers

• Causal Inference with Unstructured Outcomes [35.842670756205614]
  We propose a causal query for unstructured outcomes.<n>Key idea is to learn what features of the outcome are most causally affected by the treatment.
  arXiv  Detail & Related papers  (2026-08-04T03:53:04Z)
• Seeing What Shouldn't Be There: Counterfactual GANs for Medical Image Attribution [1.8149406825355134]
  Ascription of an image gives insights into the objects that influence the classification of the whole image or its pixels towards a specific category.<n>Most of the existing visualization techniques are based on discriminative models and highlight regions of the input image participating in the decision-making of a classifier.<n>To overcome the issue, a counterfactual explanation ( CX) based class-oriented feature attribution method is proposed.
  arXiv  Detail & Related papers  (2026-05-06T17:30:49Z)
• MAMBO-NET: Multi-Causal Aware Modeling Backdoor-Intervention Optimization for Medical Image Segmentation Network [51.68708264694361]
  Confusion factors can affect medical images, such as complex anatomical variations and imaging modality limitations.<n>We propose a multi-causal aware modeling backdoor-intervention optimization network for medical image segmentation.<n>Our method significantly reduces the influence of confusion factors, leading to enhanced segmentation accuracy.
  arXiv  Detail & Related papers  (2025-05-28T01:40:10Z)
• Contrastive Learning with Counterfactual Explanations for Radiology Report Generation [83.30609465252441]
  We propose a textbfCountertextbfFactual textbfExplanations-based framework (CoFE) for radiology report generation. Counterfactual explanations serve as a potent tool for understanding how decisions made by algorithms can be changed by asking what if'' scenarios. Experiments on two benchmarks demonstrate that leveraging the counterfactual explanations enables CoFE to generate semantically coherent and factually complete reports.
  arXiv  Detail & Related papers  (2024-07-19T17:24:25Z)
• Multi-task Explainable Skin Lesion Classification [54.76511683427566]
  We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
  arXiv  Detail & Related papers  (2023-10-11T05:49:47Z)
• Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models [49.95603725998561]
  We propose a new paradigm to build robust and interpretable medical image classifiers with natural language concepts. Specifically, we first query clinical concepts from GPT-4, then transform latent image features into explicit concepts with a vision-language model.
  arXiv  Detail & Related papers  (2023-10-04T21:57:09Z)
• medXGAN: Visual Explanations for Medical Classifiers through a Generative Latent Space [38.57696431713717]
  We propose a novel medical imaging generative framework, medXGAN, to explain what a medical adversarial focuses on in its binary predictions. By encoding domain knowledge of medical images, we are able to disentangle anatomical structure and pathology, leading to fine-grained visualization. Our method outperforms baselines such as Gradient-Weighted Class Activation Mapping (Grad-CAM) and Integrated Gradients in localization and explanatory ability.
  arXiv  Detail & Related papers  (2022-04-11T19:27:15Z)
• Interpretable Mammographic Image Classification using Cased-Based Reasoning and Deep Learning [20.665935997959025]
  We present a novel interpretable neural network algorithm that uses case-based reasoning for mammography. Our network presents both a prediction of malignancy and an explanation of that prediction using known medical features.
  arXiv  Detail & Related papers  (2021-07-12T17:42:09Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• This is not the Texture you are looking for! Introducing Novel Counterfactual Explanations for Non-Experts using Generative Adversarial Learning [59.17685450892182]
  counterfactual explanation systems try to enable a counterfactual reasoning by modifying the input image. We present a novel approach to generate such counterfactual image explanations based on adversarial image-to-image translation techniques. Our results show that our approach leads to significantly better results regarding mental models, explanation satisfaction, trust, emotions, and self-efficacy than two state-of-the art systems.
  arXiv  Detail & Related papers  (2020-12-22T10:08:05Z)
• Combining Similarity and Adversarial Learning to Generate Visual Explanation: Application to Medical Image Classification [0.0]
  We leverage a learning framework to produce our visual explanations method. Using metrics from the literature, our method outperforms state-of-the-art approaches. We validate our approach on a large chest X-ray database.
  arXiv  Detail & Related papers  (2020-12-14T08:34:12Z)
• Explaining Clinical Decision Support Systems in Medical Imaging using Cycle-Consistent Activation Maximization [112.2628296775395]
  Clinical decision support using deep neural networks has become a topic of steadily growing interest. clinicians are often hesitant to adopt the technology because its underlying decision-making process is considered to be intransparent and difficult to comprehend. We propose a novel decision explanation scheme based on CycleGAN activation which generates high-quality visualizations of classifier decisions even in smaller data sets.
  arXiv  Detail & Related papers  (2020-10-09T14:39:27Z)
• Interpretable Deep Models for Cardiac Resynchronisation Therapy Response Prediction [8.152884957975354]
  We propose a novel framework for image-based classification based on a variational autoencoder (VAE) The VAE disentangles the latent space based on explanations' drawn from existing clinical knowledge. We demonstrate our framework on the problem of predicting response of patients with cardiomyopathy to cardiac resynchronization therapy (CRT) from cine cardiac magnetic resonance images.
  arXiv  Detail & Related papers  (2020-06-24T15:35:47Z)
• Interpreting Medical Image Classifiers by Optimization Based Counterfactual Impact Analysis [2.512212190779389]
  We present a model saliency mapping framework tailored to medical imaging. We replace techniques with a strong neighborhood conditioned inpainting approach, which avoids implausible artefacts.
  arXiv  Detail & Related papers  (2020-04-03T14:59:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.