Transfer Learning using 66 Diseases for Disease Forecasting Applications

• URL: http://arxiv.org/abs/2605.27269v1
• Date: Tue, 26 May 2026 16:45:21 GMT
• Title: Transfer Learning using 66 Diseases for Disease Forecasting Applications
• Abstract summary: We train machine learning models on data that span 66 infectious diseases and several data streams.<n>We find that incorporating other data streams improves forecasting in the vast majority.<n>A major contribution of this work is in compiling a publicly-available database of data for use by the infectious disease forecasting community.
• Score: 39.146761527401424
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Disease forecasting models typically rely on a single data stream, making models brittle when histories are short or noisy. Recent top-performing models have shown that synthesizing multiple reporting systems for the same disease improves performance. Other recent work takes this idea a step further, using transfer learning to train a forecasting model for one disease using data from a different disease. We expand upon each of these approaches greatly, training machine learning models on data that span 66 infectious diseases and several data streams. We investigate the value of incorporating different data streams for forecasting 20 different disease data streams. We find that incorporating other data streams improves forecasting in the vast majority (84.9%) of time series and model structures considered. However, our work highlights that the quality of the added data matters, where adding data extremely different from the target data stream can sometimes degrade forecast performance. A major contribution of this work is in compiling a publicly-available database of data for use by the infectious disease forecasting community.

Related papers

• Developing a Strong Pre-Trained Base Model for Plant Leaf Disease Classification [0.0]
  This thesis aims to train a new Base Model based on the DenseNet201 architecture to classify plant leaf disease.<n>Open datasets for the field of plant leaf disease classification have been identified as well as models that can be trained on them.
  arXiv  Detail & Related papers  (2026-05-02T06:33:38Z)
• Disease Progression and Subtype Modeling for Combined Discrete and Continuous Input Data [37.93788591991097]
  We propose a novel disease progression model that handles both discrete and continuous data types.<n>We demonstrate the effectiveness of Mixed-SuStaIn through simulation experiments and real-world data from the Alzheimer's Disease Neuroimaging Initiative.
  arXiv  Detail & Related papers  (2026-02-25T15:31:30Z)
• PEMS: Pre-trained Epidemic Time-series Models [23.897701882327972]
  We introduce Pre-trained Epidemic Time-Series Models (PEMS) PEMS learn from diverse time-series datasets of a variety of diseases by formulating pre-training as a set of self-supervised learning (SSL) tasks. The resultant PEM outperforms previous state-of-the-art methods in various downstream time-series tasks across datasets of varying seasonal patterns, geography, and mechanism of contagion including the novel Covid-19 pandemic unseen in pre-trained data with better efficiency using smaller fraction of datasets.
  arXiv  Detail & Related papers  (2023-11-14T01:40:21Z)
• MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation [58.93221876843639]
  This paper introduces a novel, end-to-end diffusion-based risk prediction model, named MedDiffusion. It enhances risk prediction performance by creating synthetic patient data during training to enlarge sample space. It discerns hidden relationships between patient visits using a step-wise attention mechanism, enabling the model to automatically retain the most vital information for generating high-quality data.
  arXiv  Detail & Related papers  (2023-10-04T01:36:30Z)
• When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlations [16.782625445546273]
  We demonstrate that in 43% of settings, a model trained on data from two hospitals has poorer worst group accuracy over both hospitals than a model trained on just a single hospital's data. We explain that this phenomenon arises from the spurious correlation that emerges between the disease and hospital, due to hospital-specific image artifacts.
  arXiv  Detail & Related papers  (2023-08-08T17:58:45Z)
• A Bayesian Generative Adversarial Network (GAN) to Generate Synthetic Time-Series Data, Application in Combined Sewer Flow Prediction [3.3139597764446607]
  In machine learning, generative models are a class of methods capable of learning data distribution to generate artificial data. In this study, we developed a GAN model to generate synthetic time series to balance our limited recorded time series data. The aim is to predict the flow using precipitation data and examine the impact of data augmentation using synthetic data in model performance.
  arXiv  Detail & Related papers  (2023-01-31T16:12:26Z)
• Data-Centric Epidemic Forecasting: A Survey [56.99209141838794]
  This survey delves into various data-driven methodological and practical advancements. We enumerate the large number of epidemiological datasets and novel data streams that are relevant to epidemic forecasting. We also discuss experiences and challenges that arise in real-world deployment of these forecasting systems.
  arXiv  Detail & Related papers  (2022-07-19T16:15:11Z)
• On the Efficacy of Adversarial Data Collection for Question Answering: Results from a Large-Scale Randomized Study [65.17429512679695]
  In adversarial data collection (ADC), a human workforce interacts with a model in real time, attempting to produce examples that elicit incorrect predictions. Despite ADC's intuitive appeal, it remains unclear when training on adversarial datasets produces more robust models.
  arXiv  Detail & Related papers  (2021-06-02T00:48:33Z)
• Adversarial Sample Enhanced Domain Adaptation: A Case Study on Predictive Modeling with Electronic Health Records [57.75125067744978]
  We propose a data augmentation method to facilitate domain adaptation. adversarially generated samples are used during domain adaptation. Results confirm the effectiveness of our method and the generality on different tasks.
  arXiv  Detail & Related papers  (2021-01-13T03:20:20Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.