On a Reinforcement Learning Methodology for Epidemic Control, with application to COVID-19

• URL: http://arxiv.org/abs/2511.18035v1
• Date: Sat, 22 Nov 2025 12:23:27 GMT
• Title: On a Reinforcement Learning Methodology for Epidemic Control, with application to COVID-19
• Abstract summary: We combine a compartmental epidemic model with sequential Bayesian inference and reinforcement learning controllers.<n>We study two RL policies: an ICU threshold rule computed via Monte Carlo grid search, and a policy based on a posterior averaged Q learning agent.<n>We validate the framework by fitting the epidemic model to publicly available ICU occupancy data from the COVID 19 pandemic in England.
• Score: 39.146761527401424
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents a real time, data driven decision support framework for epidemic control. We combine a compartmental epidemic model with sequential Bayesian inference and reinforcement learning (RL) controllers that adaptively choose intervention levels to balance disease burden, such as intensive care unit (ICU) load, against socio economic costs. We construct a context specific cost function using empirical experiments and expert feedback. We study two RL policies: an ICU threshold rule computed via Monte Carlo grid search, and a policy based on a posterior averaged Q learning agent. We validate the framework by fitting the epidemic model to publicly available ICU occupancy data from the COVID 19 pandemic in England and then generating counterfactual roll out scenarios under each RL controller, which allows us to compare the RL policies to the historical government strategy. Over a 300 day period and for a range of cost parameters, both controllers substantially reduce ICU burden relative to the observed interventions, illustrating how Bayesian sequential learning combined with RL can support the design of epidemic control policies.

Related papers

• Post-Training at the Edge of Detectability: A Game-Theoretic Approach to Fine-Tuning [58.088509347353465]
  Reinforcement learning (RL) fine-tuning is widely used in language model training.<n>We propose a game-theoretic framework that gives this trade-off an explicit statistical interpretation.
  arXiv  Detail & Related papers  (2026-07-29T00:19:09Z)
• Learning to Compress Time-to-Control: A Reinforcement Learning Framework for Chronic Disease Management [4.772536418776007]
  We argue that chronic disease management is structurally a more tractable RL setting than the acute-care problems the field has primarily studied.<n>We present simulation results on synthetic state machines for hypertension and type 2 diabetes.
  arXiv  Detail & Related papers  (2026-05-10T23:43:39Z)
• Learning Pareto-Optimal Pandemic Intervention Policies with MORL [1.160208922584163]
  We develop a framework for modeling and evaluating disease-spread prevention strategies.<n>Our simulator reproduces national-scale pandemic dynamics with orders of magnitude higher fidelity than other models.<n>This work supports transparent, evidence-based policymaking for mitigating public health crises.
  arXiv  Detail & Related papers  (2025-10-02T12:06:29Z)
• Model-free Methods for Event History Analysis and Efficient Adjustment (PhD Thesis) [55.2480439325792]
  This thesis is a series of independent contributions to statistics unified by a model-free perspective.<n>The first chapter elaborates on how a model-free perspective can be used to formulate flexible methods that leverage prediction techniques from machine learning.<n>The second chapter studies the concept of local independence, which describes whether the evolution of one process is directly influenced by another.
  arXiv  Detail & Related papers  (2025-02-11T19:24:09Z)
• Evaluating COVID-19 vaccine allocation policies using Bayesian $m$-top exploration [39.47724912690087]
  We present a novel technique for evaluating vaccine allocation strategies using a multi-armed bandit framework.<n>$m$-top exploration allows the algorithm to learn $m$ policies for which it expects the highest utility.<n>We consider the Belgian COVID-19 epidemic using the individual-based model STRIDE, where we learn a set of vaccination policies that minimize the number of infections and hospitalisations.
  arXiv  Detail & Related papers  (2023-01-30T12:22:30Z)
• Data-driven control of COVID-19 in buildings: a reinforcement-learning approach [1.2187048691454236]
  COVID-19 pandemic has led to the shutdown and closure of workplaces with an estimated total cost of more than $16 trillion. This research article proposes data-driven control strategies to design optimal indoor airflow to minimize the exposure of occupants to viral pathogens in built environments.
  arXiv  Detail & Related papers  (2022-12-27T17:28:28Z)
• Exploring the Pareto front of multi-objective COVID-19 mitigation policies using reinforcement learning [1.7056617973440933]
  Infectious disease outbreaks can have a disruptive impact on public health and societal processes. Current research focuses on optimizing policies with a single objective, such as the pathogen's attack rate. We apply deep multi-objective reinforcement learning and build upon a state-of-the-art algorithm to learn a set of solutions.
  arXiv  Detail & Related papers  (2022-04-11T11:55:06Z)
• Compartmental Models for COVID-19 and Control via Policy Interventions [0.0]
  We demonstrate an approach to replicate and forecast the spread of the SARS-CoV-2 pandemic using the toolkit of probabilistic programming languages (PPLs) Our goal is to study the impact of various modeling assumptions and motivate policy interventions enacted to limit the spread of infectious diseases. We are not epidemiologists; the sole aim of this study is to serve as an exposition of methods, not to directly infer the real-world impact of policy-making for COVID-19.
  arXiv  Detail & Related papers  (2022-03-06T02:50:54Z)
• Reinforcement Learning with Heterogeneous Data: Estimation and Inference [84.72174994749305]
  We introduce the K-Heterogeneous Markov Decision Process (K-Hetero MDP) to address sequential decision problems with population heterogeneity. We propose the Auto-Clustered Policy Evaluation (ACPE) for estimating the value of a given policy, and the Auto-Clustered Policy Iteration (ACPI) for estimating the optimal policy in a given policy class. We present simulations to support our theoretical findings, and we conduct an empirical study on the standard MIMIC-III dataset.
  arXiv  Detail & Related papers  (2022-01-31T20:58:47Z)
• Multi-Objective Model-based Reinforcement Learning for Infectious Disease Control [19.022696762983017]
  Severe infectious diseases such as the novel coronavirus (COVID-19) pose a huge threat to public health. Stringent control measures, such as school closures and stay-at-home orders, while having significant effects, also bring huge economic losses. We propose a Multi-Objective Model-based Reinforcement Learning framework to facilitate data-driven decision-making and minimize the overall long-term cost.
  arXiv  Detail & Related papers  (2020-09-09T23:55:27Z)
• When and How to Lift the Lockdown? Global COVID-19 Scenario Analysis and Policy Assessment using Compartmental Gaussian Processes [111.69190108272133]
  coronavirus disease 2019 (COVID-19) global pandemic has led many countries to impose unprecedented lockdown measures. Data-driven models that predict COVID-19 fatalities under different lockdown policy scenarios are essential. This paper develops a Bayesian model for predicting the effects of COVID-19 lockdown policies in a global context.
  arXiv  Detail & Related papers  (2020-05-13T18:21:50Z)
• Predictive Modeling of ICU Healthcare-Associated Infections from Imbalanced Data. Using Ensembles and a Clustering-Based Undersampling Approach [55.41644538483948]
  This work is focused on both the identification of risk factors and the prediction of healthcare-associated infections in intensive-care units. The aim is to support decision making addressed at reducing the incidence rate of infections.
  arXiv  Detail & Related papers  (2020-05-07T16:13:12Z)
• Robust Deep Reinforcement Learning against Adversarial Perturbations on State Observations [88.94162416324505]
  A deep reinforcement learning (DRL) agent observes its states through observations, which may contain natural measurement errors or adversarial noises. Since the observations deviate from the true states, they can mislead the agent into making suboptimal actions. We show that naively applying existing techniques on improving robustness for classification tasks, like adversarial training, is ineffective for many RL tasks.
  arXiv  Detail & Related papers  (2020-03-19T17:59:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.