Attri-VAE: attribute-based, disentangled and interpretable representations of medical images with variational autoencoders

• URL: http://arxiv.org/abs/2203.10417v1
• Date: Sun, 20 Mar 2022 00:19:40 GMT
• Title: Attri-VAE: attribute-based, disentangled and interpretable representations of medical images with variational autoencoders
• Authors: Irem Cetin, Oscar Camara, Miguel Angel Gonzalez Ballester
• Abstract summary: We propose a VAE approach that includes an attribute regularization term to associate clinical and medical imaging attributes with different regularized dimensions in the generated latent space. The proposed model provided an excellent trade-off between reconstruction fidelity, disentanglement, and interpretability, outperforming state-of-the-art VAE approaches.
• Score: 0.5451140334681147
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep learning (DL) methods where interpretability is intrinsically considered as part of the model are required to better understand the relationship of clinical and imaging-based attributes with DL outcomes, thus facilitating their use in reasoning medical decisions. Latent space representations built with variational autoencoders (VAE) do not ensure individual control of data attributes. Attribute-based methods enforcing attribute disentanglement have been proposed in the literature for classical computer vision tasks in benchmark data. In this paper, we propose a VAE approach, the Attri-VAE, that includes an attribute regularization term to associate clinical and medical imaging attributes with different regularized dimensions in the generated latent space, enabling a better disentangled interpretation of the attributes. Furthermore, the generated attention maps explained the attribute encoding in the regularized latent space dimensions. The Attri-VAE approach analyzed healthy and myocardial infarction patients with clinical, cardiac morphology, and radiomics attributes. The proposed model provided an excellent trade-off between reconstruction fidelity, disentanglement, and interpretability, outperforming state-of-the-art VAE approaches according to several quantitative metrics. The resulting latent space allowed the generation of realistic synthetic data in the trajectory between two distinct input samples or along a specific attribute dimension to better interpret changes between different cardiac conditions.

Related papers

• Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder [38.81441978142279]
  We propose a novel method that operates directly on the latent space of a generative model, specifically a Diffusion Autoencoder (DAE) This approach offers inherent interpretability by enabling the generation of Counterfactual explanations (CEs) We show that these latent representations are helpful for medical condition classification and the ordinal regression of pathologies, such as vertebral compression fractures (VCF) and diabetic retinopathy (DR)
  arXiv  Detail & Related papers  (2024-08-02T21:01:30Z)
• Interpretable Representation Learning of Cardiac MRI via Attribute Regularization [2.0221870195041087]
  Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. We propose an Attributed-regularized Soft Introspective Variational Autoencoder that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder.
  arXiv  Detail & Related papers  (2024-06-12T14:47:51Z)
• Attribute Regularized Soft Introspective Variational Autoencoder for Interpretable Cardiac Disease Classification [2.4828003234992666]
  Interpretability is essential to ensure that clinicians can comprehend and trust artificial intelligence models. We propose a novel interpretable approach that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder.
  arXiv  Detail & Related papers  (2023-12-14T13:20:57Z)
• ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Models [69.9178140563928]
  Colonoscopy analysis is essential for assisting clinical diagnosis and treatment. The scarcity of annotated data limits the effectiveness and generalization of existing methods. We propose an Adaptive Refinement Semantic Diffusion Model (ArSDM) to generate colonoscopy images that benefit the downstream tasks.
  arXiv  Detail & Related papers  (2023-09-03T07:55:46Z)
• Attribute Regularized Soft Introspective VAE: Towards Cardiac Attribute Regularization Through MRI Domains [2.4828003234992666]
  We propose the Attributed Soft Introspective VAE (Attri-SIVAE) by incorporating an attribute regularized loss into the Soft-Intro VAE framework. We evaluate the proposed method on cardiac MRI data from different domains, such as various scanner vendors and acquisition centers.
  arXiv  Detail & Related papers  (2023-07-24T08:47:45Z)
• Learning disentangled representations for explainable chest X-ray classification using Dirichlet VAEs [68.73427163074015]
  This study explores the use of the Dirichlet Variational Autoencoder (DirVAE) for learning disentangled latent representations of chest X-ray (CXR) images. The predictive capacity of multi-modal latent representations learned by DirVAE models is investigated through implementation of an auxiliary multi-label classification task.
  arXiv  Detail & Related papers  (2023-02-06T18:10:08Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model [71.80319052891817]
  We present a relation-driven semi-supervised framework for medical image classification. It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations. Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
  arXiv  Detail & Related papers  (2020-05-15T06:57:54Z)
• Attribute-based Regularization of Latent Spaces for Variational Auto-Encoders [79.68916470119743]
  We present a novel method to structure the latent space of a Variational Auto-Encoder (VAE) to encode different continuous-valued attributes explicitly. This is accomplished by using an attribute regularization loss which enforces a monotonic relationship between the attribute values and the latent code of the dimension along which the attribute is to be encoded.
  arXiv  Detail & Related papers  (2020-04-11T20:53:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.