IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem

• URL: http://arxiv.org/abs/2604.18521v2
• Date: Wed, 29 Apr 2026 15:38:04 GMT
• Title: IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem
• Abstract summary: Epidemic forecasting has become an integral part of real-time infectious disease outbreak response.<n>We propose IDOBE, a curated collection of epidemiological time series focused on outbreak forecasting.<n>IDOBE compiles from multiple data repositories spanning over a century of surveillance and across U.S. states and global locations.
• Score: 1.443414322584475
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Epidemic forecasting has become an integral part of real-time infectious disease outbreak response. While collaborative ensembles composed of statistical and machine learning models have become the norm for real-time forecasting, standardized benchmark datasets for evaluating such methods are lacking. Further, there is limited understanding on performance of these methods for novel outbreaks with limited historical data. In this paper, we propose IDOBE, a curated collection of epidemiological time series focused on outbreak forecasting. IDOBE compiles from multiple data repositories spanning over a century of surveillance and across U.S. states and global locations. We perform derivative-based segmentation to generate over 10,000 outbreaks covering multiple outcomes such as cases and hospitalizations for 13 diseases. We consider a variety of information-theoretic and distributional measures to quantify the epidemiological diversity of the dataset. Finally, we perform multi-horizon short-term forecasting (1- to 4-week-ahead) through the progression of the outbreak using 11 baseline models and report on their performance. In addition to standard metrics such as NMSE and MAPE for point forecasts, we include probabilistic scoring rules such as Normalized Weighted Interval Score (NWIS) to quantify the performance. We find that MLP-based methods have the most robust performance, with statistical methods having a slight edge during the pre-peak phase. IDOBE dataset along with baselines are released publicly on https://github.com/NSSAC/IDOBE to enable standardized, reproducible benchmarking of outbreak forecasting methods.

Related papers

• Beyond Time Series: Spatial Reasoning for Epidemic Forecasting via Multimodal Learning [50.948271066372826]
  We introduce a spatially structured multimodal epidemic forecasting setting that integrates region-level temporal surveillance data with spatially localized auxiliary signals.<n>We evaluate our approach on real-world COVID-19, influenza, and influenza-like illness (IIL) forecasting tasks under realistic real-time evaluation protocols.
  arXiv  Detail & Related papers  (2026-06-20T17:58:17Z)
• Understanding Key Features of Time Series Foundation Models from Epidemic Forecasting [1.7191952770783792]
  Seasonal influenza infects millions of people and causes substantial morbidity and mortality in the United States each year.<n>Reliable forecasts of epidemic time series can inform vaccination timing, hospital staffing, and resource allocation.<n>We evaluate regional influenza forecasting using influenza-like illness surveillance and influenza-associated hospitalization time series.
  arXiv  Detail & Related papers  (2026-06-17T20:01:48Z)
• EpiCastBench: Datasets and Benchmarks for Multivariate Epidemic Forecasting [3.63099567325064]
  We present EpiCastBench, a large-scale benchmarking framework featuring 40 curated (correlated) multivariate epidemic datasets.<n>These datasets span a wide range of infectious diseases and exhibit diverse characteristics in terms of temporal granularity, series length, and sparsity.<n>By leveraging this framework, we conduct a comprehensive evaluation of 15 multivariate forecasting models spanning statistical baselines to state-of-the-art deep learning and foundation models.
  arXiv  Detail & Related papers  (2026-05-12T06:22:56Z)
• SpatialEpiBench: Benchmarking Spatial Information and Epidemic Priors in Forecasting [14.31847187460321]
  Accurate forecasting is crucial for public health response, resource allocation, and intervention.<n>Because epidemics unfold across regions, realistic epidemiological methods are natural candidates for improving forecasts.<n>Despite growing interest in spatial information, no standardized benchmark exists, and current evaluations often use simple train chronological-test that do not reflect real-time forecasting practice.
  arXiv  Detail & Related papers  (2026-05-07T16:31:43Z)
• Learning from Neighbors with PHIBP: Predicting Infectious Disease Dynamics in Data-Sparse Environments [14.991529825278477]
  We present the detailed computational framework and experimental application of the Poisson Hierarchical Indian Buffet Process (PHIBP)<n>The PHIBP's architecture, grounded in the concept of absolute abundance, systematically borrows statistical strength from related regions and circumvents the known sensitivities of relative-rate methods to zero counts.<n>We show that this principled approach provides a robust foundation for generating coherent predictive distributions and for the effective use of comparative measures such as alpha and beta diversity.
  arXiv  Detail & Related papers  (2025-12-24T07:10:17Z)
• A Climate-Aware Deep Learning Framework for Generalizable Epidemic Forecasting [0.0]
  ForecastNet-XCL creates accurate RSV forecasts up to 100 weeks in advance based on climate and temporal data, without access to real-time surveillance on RSV.<n>ForecastNet-XCL reliably outperformed statistical baselines, individual neural nets, and conventional ensemble methods in both within- and cross-state scenarios.
  arXiv  Detail & Related papers  (2025-10-22T14:04:42Z)
• Pre-training Epidemic Time Series Forecasters with Compartmental Prototypes [8.716953628182742]
  We propose CAPE, the first open-source pre-trained model for epidemic forecasting.<n>Unlike existing time series foundation models that overlook epidemiological challenges, CAPE models epidemic dynamics as of latent population states.<n>On a comprehensive benchmark spanning 17 diseases and 50+ regions, CAPE significantly outperforms strong baselines in zero-shot, few-shot, and full-shot forecasting.
  arXiv  Detail & Related papers  (2025-02-05T17:29:36Z)
• Deep Ensembles Meets Quantile Regression: Uncertainty-aware Imputation for Time Series [45.76310830281876]
  We propose Quantile Sub-Ensembles, a novel method to estimate uncertainty with ensemble of quantile-regression-based task networks. Our method not only produces accurate imputations that is robust to high missing rates, but also is computationally efficient due to the fast training of its non-generative model.
  arXiv  Detail & Related papers  (2023-12-03T05:52:30Z)
• Forecast reconciliation for vaccine supply chain optimization [61.13962963550403]
  Vaccine supply chain optimization can benefit from hierarchical time series forecasting. Forecasts of different hierarchy levels become incoherent when higher levels do not match the sum of the lower levels forecasts. We tackle the vaccine sale forecasting problem by modeling sales data from GSK between 2010 and 2021 as a hierarchical time series.
  arXiv  Detail & Related papers  (2023-05-02T14:34:34Z)
• Comparative Analysis of Machine Learning Approaches to Analyze and Predict the Covid-19 Outbreak [10.307715136465056]
  We present a comparative analysis of various machine learning (ML) approaches in predicting the COVID-19 outbreak in the epidemiological domain. The results reveal the advantages of ML algorithms for supporting decision making of evolving short term policies.
  arXiv  Detail & Related papers  (2021-02-11T11:57:33Z)
• STELAR: Spatio-temporal Tensor Factorization with Latent Epidemiological Regularization [76.57716281104938]
  We develop a tensor method to predict the evolution of epidemic trends for many regions simultaneously. STELAR enables long-term prediction by incorporating latent temporal regularization through a system of discrete-time difference equations. We conduct experiments using both county- and state-level COVID-19 data and show that our model can identify interesting latent patterns of the epidemic.
  arXiv  Detail & Related papers  (2020-12-08T21:21:47Z)
• UNITE: Uncertainty-based Health Risk Prediction Leveraging Multi-sourced Data [81.00385374948125]
  We present UNcertaInTy-based hEalth risk prediction (UNITE) model. UNITE provides accurate disease risk prediction and uncertainty estimation leveraging multi-sourced health data. We evaluate UNITE on real-world disease risk prediction tasks: nonalcoholic fatty liver disease (NASH) and Alzheimer's disease (AD) UNITE achieves up to 0.841 in F1 score for AD detection, up to 0.609 in PR-AUC for NASH detection, and outperforms various state-of-the-art baselines by up to $19%$ over the best baseline.
  arXiv  Detail & Related papers  (2020-10-22T02:28:11Z)
• MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
  This paper aims at a unified deep learning approach to predict patient prognosis and therapy response. We formalize the prognosis modeling as a multi-modal asynchronous time series classification task. Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
  arXiv  Detail & Related papers  (2020-10-08T15:30:17Z)
• Tracking disease outbreaks from sparse data with Bayesian inference [55.82986443159948]
  The COVID-19 pandemic provides new motivation for estimating the empirical rate of transmission during an outbreak. Standard methods struggle to accommodate the partial observability and sparse data common at finer scales. We propose a Bayesian framework which accommodates partial observability in a principled manner.
  arXiv  Detail & Related papers  (2020-09-12T20:37:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.