Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosis

• URL: http://arxiv.org/abs/2304.04579v2
• Date: Mon, 17 Apr 2023 09:20:43 GMT
• Title: Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosis
• Authors: Cristiano Patr\'icio, Jo\~ao C. Neves, Lu\'is F. Teixeira
• Abstract summary: Existing deep learning approaches for melanoma skin lesion diagnosis are deemed black-box models. We propose an inherently interpretable framework to improve the interpretability of concept-based models. Our method outperforms existing black-box and concept-based models for skin lesion classification.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Early detection of melanoma is crucial for preventing severe complications and increasing the chances of successful treatment. Existing deep learning approaches for melanoma skin lesion diagnosis are deemed black-box models, as they omit the rationale behind the model prediction, compromising the trustworthiness and acceptability of these diagnostic methods. Attempts to provide concept-based explanations are based on post-hoc approaches, which depend on an additional model to derive interpretations. In this paper, we propose an inherently interpretable framework to improve the interpretability of concept-based models by incorporating a hard attention mechanism and a coherence loss term to assure the visual coherence of concept activations by the concept encoder, without requiring the supervision of additional annotations. The proposed framework explains its decision in terms of human-interpretable concepts and their respective contribution to the final prediction, as well as a visual interpretation of the locations where the concept is present in the image. Experiments on skin image datasets demonstrate that our method outperforms existing black-box and concept-based models for skin lesion classification.

Related papers

• Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosis [8.252227380729188]
  We propose a concept complement bottleneck model for interpretable medical image diagnosis. We propose to use concept adapters for specific concepts to mine the concept differences and score concepts in their own attention channels. Our model outperforms the state-of-the-art competitors in concept detection and disease diagnosis tasks.
  arXiv  Detail & Related papers  (2024-10-20T16:52:09Z)
• Evidential Concept Embedding Models: Towards Reliable Concept Explanations for Skin Disease Diagnosis [24.946148305384202]
  Concept Bottleneck Models (CBM) have emerged as an active interpretable framework incorporating human-interpretable concepts into decision-making. We propose an evidential Concept Embedding Model (evi-CEM) which employs evidential learning to model the concept uncertainty. Our evaluation demonstrates that evi-CEM achieves superior performance in terms of concept prediction.
  arXiv  Detail & Related papers  (2024-06-27T12:29:50Z)
• Improving Intervention Efficacy via Concept Realignment in Concept Bottleneck Models [57.86303579812877]
  Concept Bottleneck Models (CBMs) ground image classification on human-understandable concepts to allow for interpretable model decisions. Existing approaches often require numerous human interventions per image to achieve strong performances. We introduce a trainable concept realignment intervention module, which leverages concept relations to realign concept assignments post-intervention.
  arXiv  Detail & Related papers  (2024-05-02T17:59:01Z)
• Concept-Attention Whitening for Interpretable Skin Lesion Diagnosis [7.5422729055429745]
  We propose a novel Concept-Attention Whitening (CAW) framework for interpretable skin lesion diagnosis. In the former branch, we train a convolutional neural network (CNN) with an inserted CAW layer to perform skin lesion diagnosis. In the latter branch, the matrix is calculated under the guidance of the concept attention mask.
  arXiv  Detail & Related papers  (2024-04-09T04:04:50Z)
• Separable Multi-Concept Erasure from Diffusion Models [52.51972530398691]
  We propose a Separable Multi-concept Eraser (SepME) to eliminate unsafe concepts from large-scale diffusion models. The latter separates optimizable model weights, making each weight increment correspond to a specific concept erasure. Extensive experiments indicate the efficacy of our approach in eliminating concepts, preserving model performance, and offering flexibility in the erasure or recovery of various concepts.
  arXiv  Detail & Related papers  (2024-02-03T11:10:57Z)
• MICA: Towards Explainable Skin Lesion Diagnosis via Multi-Level Image-Concept Alignment [4.861768967055006]
  We propose a multi-modal explainable disease diagnosis framework that meticulously aligns medical images and clinical-related concepts semantically at multiple strata. Our method, while preserving model interpretability, attains high performance and label efficiency for concept detection and disease diagnosis.
  arXiv  Detail & Related papers  (2024-01-16T17:45:01Z)
• Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models [0.0]
  We show that vision-language models can be used to alleviate the dependence on a large number of concept-annotated samples. In particular, we propose an embedding learning strategy to adapt CLIP to the downstream task of skin lesion classification using concept-based descriptions as textual embeddings.
  arXiv  Detail & Related papers  (2023-11-24T08:31:34Z)
• Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models [49.95603725998561]
  We propose a new paradigm to build robust and interpretable medical image classifiers with natural language concepts. Specifically, we first query clinical concepts from GPT-4, then transform latent image features into explicit concepts with a vision-language model.
  arXiv  Detail & Related papers  (2023-10-04T21:57:09Z)
• Interpretable Vertebral Fracture Diagnosis [69.68641439851777]
  Black-box neural network models learn clinically relevant features for fracture diagnosis. This work identifies the concepts networks use for vertebral fracture diagnosis in CT images.
  arXiv  Detail & Related papers  (2022-03-30T13:07:41Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• Concept Bottleneck Models [79.91795150047804]
  State-of-the-art models today do not typically support the manipulation of concepts like "the existence of bone spurs" We revisit the classic idea of first predicting concepts that are provided at training time, and then using these concepts to predict the label. On x-ray grading and bird identification, concept bottleneck models achieve competitive accuracy with standard end-to-end models.
  arXiv  Detail & Related papers  (2020-07-09T07:47:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.