Combining Similarity and Adversarial Learning to Generate Visual Explanation: Application to Medical Image Classification

• URL: http://arxiv.org/abs/2012.07332v1
• Date: Mon, 14 Dec 2020 08:34:12 GMT
• Title: Combining Similarity and Adversarial Learning to Generate Visual Explanation: Application to Medical Image Classification
• Authors: Martin Charachon, C\'eline Hudelot, Paul-Henry Courn\`ede, Camille Ruppli, Roberto Ardon
• Abstract summary: We leverage a learning framework to produce our visual explanations method. Using metrics from the literature, our method outperforms state-of-the-art approaches. We validate our approach on a large chest X-ray database.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Explaining decisions of black-box classifiers is paramount in sensitive domains such as medical imaging since clinicians confidence is necessary for adoption. Various explanation approaches have been proposed, among which perturbation based approaches are very promising. Within this class of methods, we leverage a learning framework to produce our visual explanations method. From a given classifier, we train two generators to produce from an input image the so called similar and adversarial images. The similar image shall be classified as the input image whereas the adversarial shall not. Visual explanation is built as the difference between these two generated images. Using metrics from the literature, our method outperforms state-of-the-art approaches. The proposed approach is model-agnostic and has a low computation burden at prediction time. Thus, it is adapted for real-time systems. Finally, we show that random geometric augmentations applied to the original image play a regularization role that improves several previously proposed explanation methods. We validate our approach on a large chest X-ray database.

Related papers

• Advancements in Feature Extraction Recognition of Medical Imaging Systems Through Deep Learning Technique [0.36651088217486427]
  An objective function based on weight is proposed to achieve the purpose of fast image recognition. A technique for threshold optimization utilizing a simplex algorithm is presented. It is found that different types of objects are independent of each other and compact in image processing.
  arXiv  Detail & Related papers  (2024-05-23T04:46:51Z)
• Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration [50.62725807357586]
  This article presents a general Bayesian learning framework for multi-modal groupwise image registration. We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables. Experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images.
  arXiv  Detail & Related papers  (2024-01-04T08:46:39Z)
• A Test Statistic Estimation-based Approach for Establishing Self-interpretable CNN-based Binary Classifiers [7.424003880270276]
  Post-hoc interpretability methods have the limitation that they can produce plausible but different interpretations. The proposed method is self-interpretable, quantitative. Unlike the traditional post-hoc interpretability methods, the proposed method is self-interpretable, quantitative.
  arXiv  Detail & Related papers  (2023-03-13T05:51:35Z)
• Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
  We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images. We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem. Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-29T08:41:17Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• Beyond Fine-tuning: Classifying High Resolution Mammograms using Function-Preserving Transformations [32.40975574666405]
  The task of classifying mammograms is very challenging because the lesion is usually small in the high resolution image. In this paper, we propose to go beyond fine-tuning by introducing a novel framework called MorphHR. The proposed framework is to integrate function-preserving transformations, for any continuous non-linear activation neurons, to internally regularise the network for improving mammograms classification.
  arXiv  Detail & Related papers  (2021-01-20T03:04:07Z)
• Generative Adversarial U-Net for Domain-free Medical Image Augmentation [49.72048151146307]
  The shortage of annotated medical images is one of the biggest challenges in the field of medical image computing. In this paper, we develop a novel generative method named generative adversarial U-Net. Our newly designed model is domain-free and generalizable to various medical images.
  arXiv  Detail & Related papers  (2021-01-12T23:02:26Z)
• This is not the Texture you are looking for! Introducing Novel Counterfactual Explanations for Non-Experts using Generative Adversarial Learning [59.17685450892182]
  counterfactual explanation systems try to enable a counterfactual reasoning by modifying the input image. We present a novel approach to generate such counterfactual image explanations based on adversarial image-to-image translation techniques. Our results show that our approach leads to significantly better results regarding mental models, explanation satisfaction, trust, emotions, and self-efficacy than two state-of-the art systems.
  arXiv  Detail & Related papers  (2020-12-22T10:08:05Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)
• Just Noticeable Difference for Machines to Generate Adversarial Images [0.34376560669160383]
  The proposed method is based on a popular concept of experimental psychology called, Just Noticeable Difference. The adversarial images generated in this study looks more natural compared to the output of state of the art adversarial image generators.
  arXiv  Detail & Related papers  (2020-01-29T19:42:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.