Interpretable Medical Image Classification using Prototype Learning and
Privileged Information
- URL: http://arxiv.org/abs/2310.15741v1
- Date: Tue, 24 Oct 2023 11:28:59 GMT
- Title: Interpretable Medical Image Classification using Prototype Learning and
Privileged Information
- Authors: Luisa Gallee, Meinrad Beer, and Michael Goetz
- Abstract summary: Interpretability is often an essential requirement in medical imaging.
In this work, we investigate whether additional information available during the training process can be used to create an understandable and powerful model.
We propose an innovative solution called Proto-Caps that leverages the benefits of capsule networks, prototype learning and the use of privileged information.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Interpretability is often an essential requirement in medical imaging.
Advanced deep learning methods are required to address this need for
explainability and high performance. In this work, we investigate whether
additional information available during the training process can be used to
create an understandable and powerful model. We propose an innovative solution
called Proto-Caps that leverages the benefits of capsule networks, prototype
learning and the use of privileged information. Evaluating the proposed
solution on the LIDC-IDRI dataset shows that it combines increased
interpretability with above state-of-the-art prediction performance. Compared
to the explainable baseline model, our method achieves more than 6 % higher
accuracy in predicting both malignancy (93.0 %) and mean characteristic
features of lung nodules. Simultaneously, the model provides case-based
reasoning with prototype representations that allow visual validation of
radiologist-defined attributes.
Related papers
- PRECISe : Prototype-Reservation for Explainable Classification under Imbalanced and Scarce-Data Settings [0.0]
PRECISe is an explainable-by-design model meticulously constructed to address all three challenges.
PreCISe outperforms the current state-of-the-art methods on data efficient generalization to minority classes.
Case study is presented to highlight the model's ability to produce easily interpretable predictions.
arXiv Detail & Related papers (2024-08-11T12:05:32Z) - ProtoAL: Interpretable Deep Active Learning with prototypes for medical imaging [0.6292138336765966]
We propose the ProtoAL method, where we integrate an interpretable DL model into the Deep Active Learning framework.
We evaluated ProtoAL on the Messidor dataset, achieving an area under the precision-recall curve of 0.79 while utilizing only 76.54% of the available labeled data.
arXiv Detail & Related papers (2024-04-06T21:39:49Z) - Enhancing and Adapting in the Clinic: Source-free Unsupervised Domain
Adaptation for Medical Image Enhancement [34.11633495477596]
We propose an algorithm for source-free unsupervised domain adaptive medical image enhancement (SAME)
A structure-preserving enhancement network is first constructed to learn a robust source model from synthesized training data.
A pseudo-label picker is developed to boost the knowledge distillation of enhancement tasks.
arXiv Detail & Related papers (2023-12-03T10:01:59Z) - Robust and Interpretable Medical Image Classifiers via Concept
Bottleneck Models [49.95603725998561]
We propose a new paradigm to build robust and interpretable medical image classifiers with natural language concepts.
Specifically, we first query clinical concepts from GPT-4, then transform latent image features into explicit concepts with a vision-language model.
arXiv Detail & Related papers (2023-10-04T21:57:09Z) - Deep Prototypical-Parts Ease Morphological Kidney Stone Identification
and are Competitively Robust to Photometric Perturbations [0.9236074230806579]
We learn Prototypical Parts (PPs) per kidney stone subtype to generate an output classification.
Our implementation's average accuracy is lower than state-of-the-art (SOTA) non-interpretable DL models by 1.5 %.
Our models perform 2.8% better on perturbed images with a lower standard deviation, without adversarial training.
arXiv Detail & Related papers (2023-04-08T17:43:31Z) - On the Robustness of Pretraining and Self-Supervision for a Deep
Learning-based Analysis of Diabetic Retinopathy [70.71457102672545]
We compare the impact of different training procedures for diabetic retinopathy grading.
We investigate different aspects such as quantitative performance, statistics of the learned feature representations, interpretability and robustness to image distortions.
Our results indicate that models from ImageNet pretraining report a significant increase in performance, generalization and robustness to image distortions.
arXiv Detail & Related papers (2021-06-25T08:32:45Z) - Variational Knowledge Distillation for Disease Classification in Chest
X-Rays [102.04931207504173]
We propose itvariational knowledge distillation (VKD), which is a new probabilistic inference framework for disease classification based on X-rays.
We demonstrate the effectiveness of our method on three public benchmark datasets with paired X-ray images and EHRs.
arXiv Detail & Related papers (2021-03-19T14:13:56Z) - Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
We propose a deep co-attention network for multi-view subspace learning.
It aims to extract both the common information and the complementary information in an adversarial setting.
In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
arXiv Detail & Related papers (2021-02-15T18:46:44Z) - Potential Features of ICU Admission in X-ray Images of COVID-19 Patients [8.83608410540057]
This paper presents an original methodology for extracting semantic features that correlate to severity from a data set with patient ICU admission labels.
The methodology employs a neural network trained to recognise lung pathologies to extract the semantic features.
The method has shown to be capable of selecting images for the learned features, which could translate some information about their common locations in the lung.
arXiv Detail & Related papers (2020-09-26T13:48:39Z) - Hemogram Data as a Tool for Decision-making in COVID-19 Management:
Applications to Resource Scarcity Scenarios [62.997667081978825]
COVID-19 pandemics has challenged emergency response systems worldwide, with widespread reports of essential services breakdown and collapse of health care structure.
This work describes a machine learning model derived from hemogram exam data performed in symptomatic patients.
Proposed models can predict COVID-19 qRT-PCR results in symptomatic individuals with high accuracy, sensitivity and specificity.
arXiv Detail & Related papers (2020-05-10T01:45:03Z) - Self-Training with Improved Regularization for Sample-Efficient Chest
X-Ray Classification [80.00316465793702]
We present a deep learning framework that enables robust modeling in challenging scenarios.
Our results show that using 85% lesser labeled data, we can build predictive models that match the performance of classifiers trained in a large-scale data setting.
arXiv Detail & Related papers (2020-05-03T02:36:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.