Deep Transfer Learning for Infectious Disease Case Detection Using
Electronic Medical Records
- URL: http://arxiv.org/abs/2103.06710v1
- Date: Mon, 8 Mar 2021 01:53:29 GMT
- Title: Deep Transfer Learning for Infectious Disease Case Detection Using
Electronic Medical Records
- Authors: Ye Ye, Andrew Gu
- Abstract summary: During an infectious disease pandemic, it is critical to share electronic medical records or models (learned from these records) across regions.
Applying one region's data/model to another region often have distribution shift issues that violate the assumptions of traditional machine learning techniques.
To explore the potential of deep transfer learning algorithms, we applied two data-based algorithms and model-based transfer learning algorithms to infectious disease detection tasks.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: During an infectious disease pandemic, it is critical to share electronic
medical records or models (learned from these records) across regions. Applying
one region's data/model to another region often have distribution shift issues
that violate the assumptions of traditional machine learning techniques.
Transfer learning can be a solution. To explore the potential of deep transfer
learning algorithms, we applied two data-based algorithms (domain adversarial
neural networks and maximum classifier discrepancy) and model-based transfer
learning algorithms to infectious disease detection tasks. We further studied
well-defined synthetic scenarios where the data distribution differences
between two regions are known. Our experiments show that, in the context of
infectious disease classification, transfer learning may be useful when (1) the
source and target are similar and the target training data is insufficient and
(2) the target training data does not have labels. Model-based transfer
learning works well in the first situation, in which case the performance
closely matched that of the data-based transfer learning models. Still, further
investigation of the domain shift in real world research data to account for
the drop in performance is needed.
Related papers
- Few-shot learning for COVID-19 Chest X-Ray Classification with
Imbalanced Data: An Inter vs. Intra Domain Study [49.5374512525016]
Medical image datasets are essential for training models used in computer-aided diagnosis, treatment planning, and medical research.
Some challenges are associated with these datasets, including variability in data distribution, data scarcity, and transfer learning issues when using models pre-trained from generic images.
We propose a methodology based on Siamese neural networks in which a series of techniques are integrated to mitigate the effects of data scarcity and distribution imbalance.
arXiv Detail & Related papers (2024-01-18T16:59:27Z) - Amplifying Pathological Detection in EEG Signaling Pathways through
Cross-Dataset Transfer Learning [10.212217551908525]
We study the effectiveness of data and model scaling and cross-dataset knowledge transfer in a real-world pathology classification task.
We identify the challenges of possible negative transfer and emphasize the significance of some key components.
Our findings indicate a small and generic model (e.g. ShallowNet) performs well on a single dataset, however, a larger model (e.g. TCN) performs better on transfer and learning from a larger and diverse dataset.
arXiv Detail & Related papers (2023-09-19T20:09:15Z) - LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection.
Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch.
Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
arXiv Detail & Related papers (2022-04-12T12:25:05Z) - Forecasting new diseases in low-data settings using transfer learning [0.0]
We show how knowledge of related diseases can help make predictions of new diseases using transfer learning.
We find that transfer learning offers the potential to improve predictions, even beyond a model based on data from the target disease.
arXiv Detail & Related papers (2022-04-07T17:54:39Z) - When Accuracy Meets Privacy: Two-Stage Federated Transfer Learning
Framework in Classification of Medical Images on Limited Data: A COVID-19
Case Study [77.34726150561087]
COVID-19 pandemic has spread rapidly and caused a shortage of global medical resources.
CNN has been widely utilized and verified in analyzing medical images.
arXiv Detail & Related papers (2022-03-24T02:09:41Z) - 2021 BEETL Competition: Advancing Transfer Learning for Subject
Independence & Heterogenous EEG Data Sets [89.84774119537087]
We design two transfer learning challenges around diagnostics and Brain-Computer-Interfacing (BCI)
Task 1 is centred on medical diagnostics, addressing automatic sleep stage annotation across subjects.
Task 2 is centred on Brain-Computer Interfacing (BCI), addressing motor imagery decoding across both subjects and data sets.
arXiv Detail & Related papers (2022-02-14T12:12:20Z) - Intra-domain and cross-domain transfer learning for time series data --
How transferable are the features? [0.0]
This study aims to assess how transferable are the features between different domains of time series data.
The effects of transfer learning are observed in terms of predictive performance of the models and their convergence rate during training.
arXiv Detail & Related papers (2022-01-12T12:55:21Z) - Semi-supervised Optimal Transport with Self-paced Ensemble for
Cross-hospital Sepsis Early Detection [12.704730765459257]
State-of-the-art methods require large amounts of labeled medical data for supervised learning.
Lack of labeled data will cause enormous obstacles if one hospital wants to deploy a new Sepsis detection system.
We propose a semi-supervised optimal transport with self-paced ensemble framework for Sepsis early detection.
arXiv Detail & Related papers (2021-06-18T20:54:18Z) - Dual-Teacher++: Exploiting Intra-domain and Inter-domain Knowledge with
Reliable Transfer for Cardiac Segmentation [69.09432302497116]
We propose a cutting-edge semi-supervised domain adaptation framework, namely Dual-Teacher++.
We design novel dual teacher models, including an inter-domain teacher model to explore cross-modality priors from source domain (e.g., MR) and an intra-domain teacher model to investigate the knowledge beneath unlabeled target domain.
In this way, the student model can obtain reliable dual-domain knowledge and yield improved performance on target domain data.
arXiv Detail & Related papers (2021-01-07T05:17:38Z) - Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype
Prediction [55.94378672172967]
We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients.
We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks.
Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
arXiv Detail & Related papers (2020-09-02T02:50:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.