On dataset transferability in medical image classification

• URL: http://arxiv.org/abs/2412.20172v1
• Date: Sat, 28 Dec 2024 15:00:04 GMT
• Title: On dataset transferability in medical image classification
• Authors: Dovile Juodelyte, Enzo Ferrante, Yucheng Lu, Prabhant Singh, Joaquin Vanschoren, Veronika Cheplygina,
• Abstract summary: Current transferability estimation methods are often suboptimal in medical image classification. We propose a novel transferability metric that combines feature quality with gradients to evaluate both the suitability and adaptability of source model features for target tasks. Our results show that our method outperforms existing transferability metrics in both settings.
• Score: 17.2563652152858
• License:
• Abstract: Current transferability estimation methods designed for natural image datasets are often suboptimal in medical image classification. These methods primarily focus on estimating the suitability of pre-trained source model features for a target dataset, which can lead to unrealistic predictions, such as suggesting that the target dataset is the best source for itself. To address this, we propose a novel transferability metric that combines feature quality with gradients to evaluate both the suitability and adaptability of source model features for target tasks. We evaluate our approach in two new scenarios: source dataset transferability for medical image classification and cross-domain transferability. Our results show that our method outperforms existing transferability metrics in both settings. We also provide insight into the factors influencing transfer performance in medical image classification, as well as the dynamics of cross-domain transfer from natural to medical images. Additionally, we provide ground-truth transfer performance benchmarking results to encourage further research into transferability estimation for medical image classification. Our code and experiments are available at https://github.com/DovileDo/transferability-in-medical-imaging.

Related papers

• Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis [55.959002385347645]
  Scaling by training on large datasets has been shown to enhance the quality and fidelity of image generation and manipulation with diffusion models. Latent Drifting enables diffusion models to be conditioned for medical images fitted for the complex task of counterfactual image generation. Our results demonstrate significant performance gains in various scenarios when combined with different fine-tuning schemes.
  arXiv  Detail & Related papers  (2024-12-30T01:59:34Z)
• FedMedICL: Towards Holistic Evaluation of Distribution Shifts in Federated Medical Imaging [68.6715007665896]
  FedMedICL is a unified framework and benchmark to holistically evaluate federated medical imaging challenges. We comprehensively evaluate several popular methods on six diverse medical imaging datasets. We find that a simple batch balancing technique surpasses advanced methods in average performance across FedMedICL experiments.
  arXiv  Detail & Related papers  (2024-07-11T19:12:23Z)
• Pick the Best Pre-trained Model: Towards Transferability Estimation for Medical Image Segmentation [20.03177073703528]
  Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task. We propose a new Transferability Estimation (TE) method for medical image segmentation. Our method surpasses all current algorithms for transferability estimation in medical image segmentation.
  arXiv  Detail & Related papers  (2023-07-22T01:58:18Z)
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
  We propose a domain transfer approach based on conditional invertible neural networks (cINNs) Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood. Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
  arXiv  Detail & Related papers  (2023-03-17T18:00:27Z)
• Parameter-Efficient Transformer with Hybrid Axial-Attention for Medical Image Segmentation [10.441315305453504]
  We propose a parameter-efficient transformer to explore intrinsic inductive bias via position information for medical image segmentation. Motivated by this, we present a novel Hybrid Axial-Attention (HAA) that can be equipped with spatial pixel-wise information and relative position information as inductive bias.
  arXiv  Detail & Related papers  (2022-11-17T13:54:55Z)
• What Makes Transfer Learning Work For Medical Images: Feature Reuse & Other Factors [1.5207770161985628]
  It is unclear what factors determine whether - and to what extent - transfer learning to the medical domain is useful. We explore the relationship between transfer learning, data size, the capacity and inductive bias of the model, as well as the distance between the source and target domain.
  arXiv  Detail & Related papers  (2022-03-02T10:13:11Z)
• Transferability Estimation using Bhattacharyya Class Separability [37.52588126267552]
  Transfer learning is a popular method for leveraging pre-trained models in computer vision. It is difficult to quantify which pre-trained source models are suitable for a specific target task. We propose a novel method for quantifying transferability between a source model and a target dataset.
  arXiv  Detail & Related papers  (2021-11-24T20:22:28Z)
• Supervised Transfer Learning at Scale for Medical Imaging [8.341246672632582]
  We investigate whether modern methods can change the fortune of transfer learning for medical imaging. We study the class of large-scale pre-trained networks presented by Kolesnikov et al. on three diverse imaging tasks. We find that for some of these properties transfer from natural to medical images is indeed extremely effective, but only when performed at sufficient scale.
  arXiv  Detail & Related papers  (2021-01-14T23:55:49Z)
• Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization [59.5104563755095]
  We introduce a simple but effective approach to improve the generalization capability of deep neural networks in the field of medical imaging classification. Motivated by the observation that the domain variability of the medical images is to some extent compact, we propose to learn a representative feature space through variational encoding.
  arXiv  Detail & Related papers  (2020-09-27T12:30:30Z)
• Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model [71.80319052891817]
  We present a relation-driven semi-supervised framework for medical image classification. It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations. Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
  arXiv  Detail & Related papers  (2020-05-15T06:57:54Z)
• What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation [51.7837386041158]
  We develop a new unsupervised semantic transfer model including two complementary modules for endoscopic lesions segmentation. Specifically, T_D focuses on where to translate transferable visual information of medical lesions via residual transferability-aware bottleneck. T_F highlights how to augment transferable semantic features of various lesions and automatically ignore untransferable representations.
  arXiv  Detail & Related papers  (2020-04-24T00:57:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.