Forecasting new diseases in low-data settings using transfer learning
- URL: http://arxiv.org/abs/2204.05059v1
- Date: Thu, 7 Apr 2022 17:54:39 GMT
- Title: Forecasting new diseases in low-data settings using transfer learning
- Authors: Kirstin Roster, Colm Connaughton, Francisco A. Rodrigues
- Abstract summary: We show how knowledge of related diseases can help make predictions of new diseases using transfer learning.
We find that transfer learning offers the potential to improve predictions, even beyond a model based on data from the target disease.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recent infectious disease outbreaks, such as the COVID-19 pandemic and the
Zika epidemic in Brazil, have demonstrated both the importance and difficulty
of accurately forecasting novel infectious diseases. When new diseases first
emerge, we have little knowledge of the transmission process, the level and
duration of immunity to reinfection, or other parameters required to build
realistic epidemiological models. Time series forecasts and machine learning,
while less reliant on assumptions about the disease, require large amounts of
data that are also not available in early stages of an outbreak. In this study,
we examine how knowledge of related diseases can help make predictions of new
diseases in data-scarce environments using transfer learning. We implement both
an empirical and a theoretical approach. Using empirical data from Brazil, we
compare how well different machine learning models transfer knowledge between
two different disease pairs: (i) dengue and Zika, and (ii) influenza and
COVID-19. In the theoretical analysis, we generate data using different
transmission and recovery rates with an SIR compartmental model, and then
compare the effectiveness of different transfer learning methods. We find that
transfer learning offers the potential to improve predictions, even beyond a
model based on data from the target disease, though the appropriate source
disease must be chosen carefully. While imperfect, these models offer an
additional input for decision makers during pandemic response.
Related papers
- Artificial Intelligence for Infectious Disease Prediction and Prevention: A Comprehensive Review [1.4874449172133888]
The paper critically assesses the potential of AI and outlines its limitations in infectious disease management.
It categorizes contributions into three areas: predictions using Public Health Data to prevent the spread of a transmissible disease within a region; predictions using Patients' Medical Data to detect whether a person is infected by a transmissible disease; and predictions using both Public and patient medical data to estimate the extent of disease spread in a population.
arXiv Detail & Related papers (2024-11-14T00:43:32Z) - Using Pre-training and Interaction Modeling for ancestry-specific disease prediction in UK Biobank [69.90493129893112]
Recent genome-wide association studies (GWAS) have uncovered the genetic basis of complex traits, but show an under-representation of non-European descent individuals.
Here, we assess whether we can improve disease prediction across diverse ancestries using multiomic data.
arXiv Detail & Related papers (2024-04-26T16:39:50Z) - Machine Learning for Infectious Disease Risk Prediction: A Survey [14.030548098195258]
We systematically describe how machine learning can play an essential role in quantitatively characterizing disease transmission patterns.
We discuss challenges encountered when dealing with model inputs, designing task-oriented objectives, and conducting performance evaluation.
arXiv Detail & Related papers (2023-08-06T06:57:11Z) - Transfer learning and Local interpretable model agnostic based visual
approach in Monkeypox Disease Detection and Classification: A Deep Learning
insights [0.0]
The recent development of Monkeypox disease poses a global pandemic threat when the world is still fighting Coronavirus Disease 2019 (COVID-19).
We have conducted two studies where we modified and tested six distinct deep learning models-VGG16, InceptionResNetV2, ResNet50, ResNet101, MobileNetV2, and VGG19-using transfer learning approaches.
Our preliminary computational results show that the proposed modified InceptionResNetV2 and MobileNetV2 models perform best by achieving an accuracy ranging from 93% to 99%.
arXiv Detail & Related papers (2022-11-01T18:07:34Z) - Data-Centric Epidemic Forecasting: A Survey [56.99209141838794]
This survey delves into various data-driven methodological and practical advancements.
We enumerate the large number of epidemiological datasets and novel data streams that are relevant to epidemic forecasting.
We also discuss experiences and challenges that arise in real-world deployment of these forecasting systems.
arXiv Detail & Related papers (2022-07-19T16:15:11Z) - Deep Transfer Learning for Infectious Disease Case Detection Using
Electronic Medical Records [0.0]
During an infectious disease pandemic, it is critical to share electronic medical records or models (learned from these records) across regions.
Applying one region's data/model to another region often have distribution shift issues that violate the assumptions of traditional machine learning techniques.
To explore the potential of deep transfer learning algorithms, we applied two data-based algorithms and model-based transfer learning algorithms to infectious disease detection tasks.
arXiv Detail & Related papers (2021-03-08T01:53:29Z) - An Optimal Control Approach to Learning in SIDARTHE Epidemic model [67.22168759751541]
We propose a general approach for learning time-variant parameters of dynamic compartmental models from epidemic data.
We forecast the epidemic evolution in Italy and France.
arXiv Detail & Related papers (2020-10-28T10:58:59Z) - Steering a Historical Disease Forecasting Model Under a Pandemic: Case
of Flu and COVID-19 [75.99038202534628]
We propose CALI-Net, a neural transfer learning architecture which allows us to'steer' a historical disease forecasting model to new scenarios where flu and COVID co-exist.
Our experiments demonstrate that our approach is successful in adapting a historical forecasting model to the current pandemic.
arXiv Detail & Related papers (2020-09-23T22:35:43Z) - Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype
Prediction [55.94378672172967]
We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients.
We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks.
Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
arXiv Detail & Related papers (2020-09-02T02:50:30Z) - Cross-lingual Transfer Learning for COVID-19 Outbreak Alignment [90.12602012910465]
We train on Italy's early COVID-19 outbreak through Twitter and transfer to several other countries.
Our experiments show strong results with up to 0.85 Spearman correlation in cross-country predictions.
arXiv Detail & Related papers (2020-06-05T02:04:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.