Class-Incremental Continual Learning for General Purpose Healthcare Models

• URL: http://arxiv.org/abs/2311.04301v1
• Date: Tue, 7 Nov 2023 19:17:59 GMT
• Title: Class-Incremental Continual Learning for General Purpose Healthcare Models
• Authors: Amritpal Singh, Mustafa Burak Gurbuz, Shiva Souhith Gantha, Prahlad Jasti
• Abstract summary: Continual learning allows learning on new tasks without performance drop on previous tasks. A single model can sequentially learn new tasks from different specialties and achieve comparable performance to naive methods.
• Score: 3.768737590492549
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Healthcare clinics regularly encounter dynamic data that changes due to variations in patient populations, treatment policies, medical devices, and emerging disease patterns. Deep learning models can suffer from catastrophic forgetting when fine-tuned in such scenarios, causing poor performance on previously learned tasks. Continual learning allows learning on new tasks without performance drop on previous tasks. In this work, we investigate the performance of continual learning models on four different medical imaging scenarios involving ten classification datasets from diverse modalities, clinical specialties, and hospitals. We implement various continual learning approaches and evaluate their performance in these scenarios. Our results demonstrate that a single model can sequentially learn new tasks from different specialties and achieve comparable performance to naive methods. These findings indicate the feasibility of recycling or sharing models across the same or different medical specialties, offering another step towards the development of general-purpose medical imaging AI that can be shared across institutions.

Related papers

• Personalized Event Prediction for Electronic Health Records [7.224184629864593]
  Clinical event sequences consist of hundreds of clinical events that represent records of patient care in time. One important challenge of learning predictive models of clinical sequences is their patient-specific variability.
  arXiv  Detail & Related papers  (2023-08-21T20:03:16Z)
• Prediction of Post-Operative Renal and Pulmonary Complications Using Transformers [69.81176740997175]
  We evaluate the performance of transformer-based models in predicting postoperative acute renal failure, pulmonary complications, and postoperative in-hospital mortality. Our results demonstrate that transformer-based models can achieve superior performance in predicting postoperative complications and outperform traditional machine learning models.
  arXiv  Detail & Related papers  (2023-06-01T14:08:05Z)
• Understanding the Tricks of Deep Learning in Medical Image Segmentation: Challenges and Future Directions [66.40971096248946]
  In this paper, we collect a series of MedISeg tricks for different model implementation phases. We experimentally explore the effectiveness of these tricks on consistent baselines. We also open-sourced a strong MedISeg repository, where each component has the advantage of plug-and-play.
  arXiv  Detail & Related papers  (2022-09-21T12:30:05Z)
• Patient Aware Active Learning for Fine-Grained OCT Classification [12.89552245538411]
  We propose a framework that incorporates clinical insights into the sample selection process of active learning. Our medically interpretable active learning framework captures diverse disease manifestations from patients to improve performance of OCT classification.
  arXiv  Detail & Related papers  (2022-06-23T05:47:51Z)
• Continual Learning with Bayesian Model based on a Fixed Pre-trained Feature Extractor [55.9023096444383]
  Current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes. Inspired by the process of learning new knowledge in human brains, we propose a Bayesian generative model for continual learning.
  arXiv  Detail & Related papers  (2022-04-28T08:41:51Z)
• LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
  We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection. Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch. Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
  arXiv  Detail & Related papers  (2022-04-12T12:25:05Z)
• What Do You See in this Patient? Behavioral Testing of Clinical NLP Models [69.09570726777817]
  We introduce an extendable testing framework that evaluates the behavior of clinical outcome models regarding changes of the input. We show that model behavior varies drastically even when fine-tuned on the same data and that allegedly best-performing models have not always learned the most medically plausible patterns.
  arXiv  Detail & Related papers  (2021-11-30T15:52:04Z)
• Learning Predictive and Interpretable Timeseries Summaries from ICU Data [33.787187660310444]
  We propose a new procedure to learn summaries of clinical time-series that are both predictive and easily understood by humans. Our learned summaries outperform traditional interpretable model classes and achieve performance comparable to state-of-the-art deep learning models on an in-hospital mortality classification task.
  arXiv  Detail & Related papers  (2021-09-22T21:14:05Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)
• A Visual Analytics System for Multi-model Comparison on Clinical Data Predictions [21.86694022749115]
  We develop a visual analytics system that compares multiple models' prediction criteria and evaluates their consistency. We demonstrate the effectiveness of our system to assist clinicians and researchers in comparing and quantitatively evaluating different machine learning methods.
  arXiv  Detail & Related papers  (2020-02-18T20:33:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.