See Through the Fog: Curriculum Learning with Progressive Occlusion in Medical Imaging

• URL: http://arxiv.org/abs/2306.15574v2
• Date: Fri, 30 Jun 2023 16:20:26 GMT
• Title: See Through the Fog: Curriculum Learning with Progressive Occlusion in Medical Imaging
• Authors: Pradeep Singh, Kishore Babu Nampalle, Uppala Vivek Narayan, Balasubramanian Raman
• Abstract summary: Deep learning models often struggle with challenging images where critical features are partially or fully occluded. We propose a novel curriculum learning-based approach to train deep learning models to handle occluded medical images effectively.
• Score: 15.382184404673389
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In recent years, deep learning models have revolutionized medical image interpretation, offering substantial improvements in diagnostic accuracy. However, these models often struggle with challenging images where critical features are partially or fully occluded, which is a common scenario in clinical practice. In this paper, we propose a novel curriculum learning-based approach to train deep learning models to handle occluded medical images effectively. Our method progressively introduces occlusion, starting from clear, unobstructed images and gradually moving to images with increasing occlusion levels. This ordered learning process, akin to human learning, allows the model to first grasp simple, discernable patterns and subsequently build upon this knowledge to understand more complicated, occluded scenarios. Furthermore, we present three novel occlusion synthesis methods, namely Wasserstein Curriculum Learning (WCL), Information Adaptive Learning (IAL), and Geodesic Curriculum Learning (GCL). Our extensive experiments on diverse medical image datasets demonstrate substantial improvements in model robustness and diagnostic accuracy over conventional training methodologies.

Related papers

• Autoregressive Sequence Modeling for 3D Medical Image Representation [48.706230961589924]
  We introduce a pioneering method for learning 3D medical image representations through an autoregressive sequence pre-training framework. Our approach various 3D medical images based on spatial, contrast, and semantic correlations, treating them as interconnected visual tokens within a token sequence.
  arXiv  Detail & Related papers  (2024-09-13T10:19:10Z)
• A Systematic Review of Few-Shot Learning in Medical Imaging [1.049712834719005]
  Few-shot learning techniques can reduce data scarcity issues and enhance medical image analysis. This systematic review gives a comprehensive overview of few-shot learning in medical imaging.
  arXiv  Detail & Related papers  (2023-09-20T16:10:53Z)
• Fine-Grained Self-Supervised Learning with Jigsaw Puzzles for Medical Image Classification [11.320414512937946]
  Classifying fine-grained lesions is challenging due to minor and subtle differences in medical images. We introduce Fine-Grained Self-Supervised Learning(FG-SSL) method for classifying subtle lesions in medical images. We evaluate the proposed fine-grained self-supervised learning method on comprehensive experiments using various medical image recognition datasets.
  arXiv  Detail & Related papers  (2023-08-10T02:08:15Z)
• Few-Shot Classification of Skin Lesions from Dermoscopic Images by Meta-Learning Representative Embeddings [1.957558771641347]
  Annotated images and ground truth for diagnosis of rare and novel diseases are scarce. Few-shot learning, and meta-learning in general, aim to overcome these issues by aiming to perform well in low data regimes. This paper focuses on improving meta-learning for the classification of dermoscopic images.
  arXiv  Detail & Related papers  (2022-10-30T21:27:15Z)
• Understanding the Tricks of Deep Learning in Medical Image Segmentation: Challenges and Future Directions [66.40971096248946]
  In this paper, we collect a series of MedISeg tricks for different model implementation phases. We experimentally explore the effectiveness of these tricks on consistent baselines. We also open-sourced a strong MedISeg repository, where each component has the advantage of plug-and-play.
  arXiv  Detail & Related papers  (2022-09-21T12:30:05Z)
• Continual Learning with Bayesian Model based on a Fixed Pre-trained Feature Extractor [55.9023096444383]
  Current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes. Inspired by the process of learning new knowledge in human brains, we propose a Bayesian generative model for continual learning.
  arXiv  Detail & Related papers  (2022-04-28T08:41:51Z)
• LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
  We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection. Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch. Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
  arXiv  Detail & Related papers  (2022-04-12T12:25:05Z)
• Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound Reconstruction [61.62191904755521]
  3D freehand US reconstruction is promising in addressing the problem by providing broad range and freeform scan. Existing deep learning based methods only focus on the basic cases of skill sequences. We propose a novel approach to sensorless freehand 3D US reconstruction considering the complex skill sequences.
  arXiv  Detail & Related papers  (2021-07-31T16:06:50Z)
• Continual Active Learning for Efficient Adaptation of Machine Learning Models to Changing Image Acquisition [3.205205037629335]
  We propose a method for continual active learning on a data stream of medical images. It recognizes shifts or additions of new imaging sources - domains - and adapts training accordingly. Results demonstrate that the proposed method outperforms naive active learning while requiring less manual labelling.
  arXiv  Detail & Related papers  (2021-06-07T05:39:06Z)
• Unsupervised Medical Image Alignment with Curriculum Learning [16.72680081620203]
  We explore different curriculum learning methods for training convolutional neural networks on the task of deformable pairwise 3D medical image registration. Our experiments with an underlying state-of-the-art deep learning model show that curriculum learning can lead to superior results compared to conventional training.
  arXiv  Detail & Related papers  (2021-02-20T20:26:01Z)
• A Multi-Stage Attentive Transfer Learning Framework for Improving COVID-19 Diagnosis [49.3704402041314]
  We propose a multi-stage attentive transfer learning framework for improving COVID-19 diagnosis. Our proposed framework consists of three stages to train accurate diagnosis models through learning knowledge from multiple source tasks and data of different domains. Importantly, we propose a novel self-supervised learning method to learn multi-scale representations for lung CT images.
  arXiv  Detail & Related papers  (2021-01-14T01:39:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.