Counterfactual Explanation and Instance-Generation using Cycle-Consistent Generative Adversarial Networks

• URL: http://arxiv.org/abs/2301.08939v1
• Date: Sat, 21 Jan 2023 11:14:34 GMT
• Title: Counterfactual Explanation and Instance-Generation using Cycle-Consistent Generative Adversarial Networks
• Abstract summary: We propose a novel strategy that is not reliant on image classification. We leverage Cycle-Consistency principle (a.k.a CycleGAN) to perform the translation in unsupervised way. We evaluate our method on three datasets including a synthetic, tuberculosis and BraTS dataset.
• Score: 1.5469452301122175
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The image-based diagnosis is now a vital aspect of modern automation assisted diagnosis. To enable models to produce pixel-level diagnosis, pixel-level ground-truth labels are essentially required. However, since it is often not straight forward to obtain the labels in many application domains such as in medical image, classification-based approaches have become the de facto standard to perform the diagnosis. Though they can identify class-salient regions, they may not be useful for diagnosis where capturing all of the evidences is important requirement. Alternatively, a counterfactual explanation (CX) aims at providing explanations using a casual reasoning process of form "If X has not happend, Y would not heppend". Existing CX approaches, however, use classifier to explain features that can change its predictions. Thus, they can only explain class-salient features, rather than entire object of interest. This hence motivates us to propose a novel CX strategy that is not reliant on image classification. This work is inspired from the recent developments in generative adversarial networks (GANs) based image-to-image domain translation, and leverages to translate an abnormal image to counterpart normal image (i.e. counterfactual instance CI) to find discrepancy maps between the two. Since it is generally not possible to obtain abnormal and normal image pairs, we leverage Cycle-Consistency principle (a.k.a CycleGAN) to perform the translation in unsupervised way. We formulate CX in terms of a discrepancy map that, when added from the abnormal image, will make it indistinguishable from the CI. We evaluate our method on three datasets including a synthetic, tuberculosis and BraTS dataset. All these experiments confirm the supremacy of propose method in generating accurate CX and CI.

Related papers

• Seeing What Shouldn't Be There: Counterfactual GANs for Medical Image Attribution [1.8149406825355134]
  Ascription of an image gives insights into the objects that influence the classification of the whole image or its pixels towards a specific category.<n>Most of the existing visualization techniques are based on discriminative models and highlight regions of the input image participating in the decision-making of a classifier.<n>To overcome the issue, a counterfactual explanation ( CX) based class-oriented feature attribution method is proposed.
  arXiv  Detail & Related papers  (2026-05-06T17:30:49Z)
• A Graph-Based Framework for Interpretable Whole Slide Image Analysis [86.37618055724441]
  We develop a framework that transforms whole-slide images into biologically-informed graph representations.<n>Our approach builds graph nodes from tissue regions that respect natural structures, not arbitrary grids.<n>We demonstrate strong performance on challenging cancer staging and survival prediction tasks.
  arXiv  Detail & Related papers  (2025-03-14T20:15:04Z)
• TagGAN: A Generative Model for Data Tagging [1.820857020024539]
  We propose a novel Generative Adversarial Networks (GANs)-based framework, TagGAN. TagGAN is tailored for weakly-supervised fine-grained disease map generation from purely image-level labeled data. Our method is first to generate fine-grained disease maps to visualize disease lesions in a weekly supervised setting without requiring pixel-level annotations.
  arXiv  Detail & Related papers  (2025-02-25T04:29:18Z)
• Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image [63.59114880750643]
  We introduce a novel Spatial-aware Attention Generative Adrialversa Network (SAGAN) for one-class semi-supervised generation of health images. SAGAN generates high-quality health images corresponding to unlabeled data, guided by the reconstruction of normal images and restoration of pseudo-anomaly images. Extensive experiments on three medical datasets demonstrate that the proposed SAGAN outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-05-21T15:41:34Z)
• COIN: Counterfactual inpainting for weakly supervised semantic segmentation for medical images [3.5418498524791766]
  This research is development of a novel counterfactual inpainting approach (COIN) COIN flips the predicted classification label from abnormal to normal by using a generative model. The effectiveness of the method is demonstrated by segmenting synthetic targets and actual kidney tumors from CT images acquired from Tartu University Hospital in Estonia.
  arXiv  Detail & Related papers  (2024-04-19T12:09:49Z)
• AMAE: Adaptation of Pre-Trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays [17.91123470181453]
  We propose AMAE, a two-stage algorithm for adaptation of the pre-trained masked autoencoder (MAE) AMAE leads to consistent performance gains over competing self-supervised and dual distribution anomaly detection methods.
  arXiv  Detail & Related papers  (2023-07-24T12:03:50Z)
• Industrial and Medical Anomaly Detection Through Cycle-Consistent Adversarial Networks [0.6554326244334868]
  A new Anomaly Detection (AD) approach for industrial and medical images is proposed. The proposed method uses Cycle-Generative Adrial Networks (Cycle-GAN) for (ab)normal-to-normal translation. Results demonstrate accurate performance with a zero false negative constraint compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-02-10T10:25:12Z)
• Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rays [65.88435151891369]
  Radiomics-Guided Transformer (RGT) fuses textitglobal image information with textitlocal knowledge-guided radiomics information. RGT consists of an image Transformer branch, a radiomics Transformer branch, and fusion layers that aggregate image and radiomic information.
  arXiv  Detail & Related papers  (2022-07-10T06:32:56Z)
• Dual-Distribution Discrepancy for Anomaly Detection in Chest X-Rays [29.57501199670898]
  We propose a novel strategy, Dual-distribution Discrepancy for Anomaly Detection (DDAD), utilizing both known normal images and unlabeled images. Experiments on three CXR datasets demonstrate that the proposed DDAD achieves consistent, significant gains and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-06-08T14:52:27Z)
• Generative Residual Attention Network for Disease Detection [51.60842580044539]
  We present a novel approach for disease generation in X-rays using a conditional generative adversarial learning. We generate a corresponding radiology image in a target domain while preserving the identity of the patient. We then use the generated X-ray image in the target domain to augment our training to improve the detection performance.
  arXiv  Detail & Related papers  (2021-10-25T14:15:57Z)
• Multi-Label Generalized Zero Shot Learning for the Classification of Disease in Chest Radiographs [0.7734726150561088]
  We propose a zero shot learning network that can simultaneously predict multiple seen and unseen diseases in chest X-ray images. The network is end-to-end trainable and requires no independent pre-training for the offline feature extractor. Our network outperforms two strong baselines in terms of recall, precision, f1 score, and area under the receiver operating characteristic curve.
  arXiv  Detail & Related papers  (2021-07-14T09:04:20Z)
• Contrastive Attention for Automatic Chest X-ray Report Generation [124.60087367316531]
  In most cases, the normal regions dominate the entire chest X-ray image, and the corresponding descriptions of these normal regions dominate the final report. We propose Contrastive Attention (CA) model, which compares the current input image with normal images to distill the contrastive information. We achieve the state-of-the-art results on the two public datasets.
  arXiv  Detail & Related papers  (2021-06-13T11:20:31Z)
• Cross-Modal Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop [63.81818077092879]
  We propose an end-to-end semi-supervised cross-modal contrastive learning framework for medical images. We first apply an image encoder to classify the chest X-rays and to generate the image features. The radiomic features are then passed through another dedicated encoder to act as the positive sample for the image features generated from the same chest X-ray.
  arXiv  Detail & Related papers  (2021-04-11T09:16:29Z)
• Auxiliary Signal-Guided Knowledge Encoder-Decoder for Medical Report Generation [107.3538598876467]
  We propose an Auxiliary Signal-Guided Knowledge-Decoder (ASGK) to mimic radiologists' working patterns. ASGK integrates internal visual feature fusion and external medical linguistic information to guide medical knowledge transfer and learning.
  arXiv  Detail & Related papers  (2020-06-06T01:00:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.