Explainable AI (XAI) in Image Segmentation in Medicine, Industry, and Beyond: A Survey

• URL: http://arxiv.org/abs/2405.01636v1
• Date: Thu, 2 May 2024 18:00:25 GMT
• Title: Explainable AI (XAI) in Image Segmentation in Medicine, Industry, and Beyond: A Survey
• Authors: Rokas Gipiškis, Chun-Wei Tsai, Olga Kurasova,
• Abstract summary: We present the first comprehensive survey on XAI in semantic image segmentation. This work focuses on techniques that were either specifically introduced for dense prediction tasks or were extended for them by modifying existing methods in classification.
• Score: 0.10923877073891446
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Artificial Intelligence (XAI) has found numerous applications in computer vision. While image classification-based explainability techniques have garnered significant attention, their counterparts in semantic segmentation have been relatively neglected. Given the prevalent use of image segmentation, ranging from medical to industrial deployments, these techniques warrant a systematic look. In this paper, we present the first comprehensive survey on XAI in semantic image segmentation. This work focuses on techniques that were either specifically introduced for dense prediction tasks or were extended for them by modifying existing methods in classification. We analyze and categorize the literature based on application categories and domains, as well as the evaluation metrics and datasets used. We also propose a taxonomy for interpretable semantic segmentation, and discuss potential challenges and future research directions.

Related papers

• Image Segmentation in Foundation Model Era: A Survey [99.19456390358211]
  Current research in image segmentation lacks a detailed analysis of distinct characteristics, challenges, and solutions associated with these advancements. This survey seeks to fill this gap by providing a thorough review of cutting-edge research centered around FM-driven image segmentation. An exhaustive overview of over 300 segmentation approaches is provided to encapsulate the breadth of current research efforts.
  arXiv  Detail & Related papers  (2024-08-23T10:07:59Z)
• Masked Image Modeling: A Survey [73.21154550957898]
  Masked image modeling emerged as a powerful self-supervised learning technique in computer vision. We construct a taxonomy and review the most prominent papers in recent years. We aggregate the performance results of various masked image modeling methods on the most popular datasets.
  arXiv  Detail & Related papers  (2024-08-13T07:27:02Z)
• Semi-Supervised Semantic Segmentation Based on Pseudo-Labels: A Survey [49.47197748663787]
  This review aims to provide a first comprehensive and organized overview of the state-of-the-art research results on pseudo-label methods in the field of semi-supervised semantic segmentation. In addition, we explore the application of pseudo-label technology in medical and remote-sensing image segmentation.
  arXiv  Detail & Related papers  (2024-03-04T10:18:38Z)
• Representing visual classification as a linear combination of words [0.0]
  We present an explainability strategy that uses a vision-language model to identify language-based descriptors of a visual classification task. By leveraging a pre-trained joint embedding space between images and text, our approach estimates a new classification task as a linear combination of words. We find that the resulting descriptors largely align with clinical knowledge despite a lack of domain-specific language training.
  arXiv  Detail & Related papers  (2023-11-18T02:00:20Z)
• Utilizing Segment Anything Model For Assessing Localization of GRAD-CAM in Medical Imaging [0.0]
  Saliency map algorithms are being applied in multiple fields, including medical imaging. Current works examine capabilities through assessing the localization of saliency maps upon medical abnormalities within an image. We propose utilizing Segment Anything Model (SAM) to both further the accuracy of such existing metrics, while also generalizing beyond the need for human annotations.
  arXiv  Detail & Related papers  (2023-06-24T19:54:50Z)
• Panoptic Segmentation: A Review [2.270719568619559]
  This paper presents the first comprehensive review of existing panoptic segmentation methods. Panoptic segmentation is currently under study to help gain a more nuanced knowledge of the image scenes for video surveillance, crowd counting, self-autonomous driving, medical image analysis.
  arXiv  Detail & Related papers  (2021-11-19T14:40:24Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• Weakly supervised multiple instance learning histopathological tumor segmentation [51.085268272912415]
  We propose a weakly supervised framework for whole slide imaging segmentation. We exploit a multiple instance learning scheme for training models. The proposed framework has been evaluated on multi-locations and multi-centric public data from The Cancer Genome Atlas and the PatchCamelyon dataset.
  arXiv  Detail & Related papers  (2020-04-10T13:12:47Z)
• Towards Interpretable Semantic Segmentation via Gradient-weighted Class Activation Mapping [71.91734471596432]
  We propose SEG-GRAD-CAM, a gradient-based method for interpreting semantic segmentation. Our method is an extension of the widely-used Grad-CAM method, applied locally to produce heatmaps showing the relevance of individual pixels for semantic segmentation.
  arXiv  Detail & Related papers  (2020-02-26T12:32:40Z)
• Deep Learning in Medical Ultrasound Image Segmentation: a Review [9.992387025633805]
  It can be a key step to provide a reliable basis for clinical diagnosis, such as 3D reconstruction of human tissues. Deep learning-based methods for ultrasound image segmentation are categorized into six main groups according to their architectures and training. In the end, the challenges and potential research directions for medical ultrasound image segmentation are discussed.
  arXiv  Detail & Related papers  (2020-02-18T16:33:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.