Modeling and Optimization of Epidemiological Control Policies Through Reinforcement Learning

• URL: http://arxiv.org/abs/2402.06640v1
• Date: Thu, 25 Jan 2024 22:39:39 GMT
• Title: Modeling and Optimization of Epidemiological Control Policies Through Reinforcement Learning
• Authors: Ishir Rao
• Abstract summary: The impact of a pandemic can be minimized by enforcing certain restrictions on a community. While minimizing infection and death rates, these restrictions can also lead to economic crises. We train a reinforcement learning agent to enforce the optimal restriction on a pandemic simulation based on a reward function.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Pandemics involve the high transmission of a disease that impacts global and local health and economic patterns. The impact of a pandemic can be minimized by enforcing certain restrictions on a community. However, while minimizing infection and death rates, these restrictions can also lead to economic crises. Epidemiological models help propose pandemic control strategies based on non-pharmaceutical interventions such as social distancing, curfews, and lockdowns, reducing the economic impact of these restrictions. However, designing manual control strategies while considering disease spread and economic status is non-trivial. Optimal strategies can be designed through multi-objective reinforcement learning (MORL) models, which demonstrate how restrictions can be used to optimize the outcome of a pandemic. In this research, we utilized an epidemiological Susceptible, Exposed, Infected, Recovered, Deceased (SEIRD) model: a compartmental model for virtually simulating a pandemic day by day. We combined the SEIRD model with a deep double recurrent Q-network to train a reinforcement learning agent to enforce the optimal restriction on the SEIRD simulation based on a reward function. We tested two agents with unique reward functions and pandemic goals to obtain two strategies. The first agent placed long lockdowns to reduce the initial spread of the disease, followed by cyclical and shorter lockdowns to mitigate the resurgence of the disease. The second agent provided similar infection rates but an improved economy by implementing a 10-day lockdown and 20-day no-restriction cycle. This use of reinforcement learning and epidemiological modeling allowed for both economic and infection mitigation in multiple pandemic scenarios.

Related papers

• Agent-Based Model: Simulating a Virus Expansion Based on the Acceptance of Containment Measures [65.62256987706128]
  Compartmental epidemiological models categorize individuals based on their disease status. We propose an ABM architecture that combines an adapted SEIRD model with a decision-making model for citizens. We illustrate the designed model by examining the progression of SARS-CoV-2 infections in A Coruna, Spain.
  arXiv  Detail & Related papers  (2023-07-28T08:01:05Z)
• Epidemic Control on a Large-Scale-Agent-Based Epidemiology Model using Deep Deterministic Policy Gradient [0.7244731714427565]
  lockdowns, rapid vaccination programs, school closures, and economic stimulus can have positive or unintended negative consequences. Current research to model and determine an optimal intervention automatically through round-tripping is limited by the simulation objectives, scale (a few thousand individuals), model types that are not suited for intervention studies, and the number of intervention strategies they can explore (discrete vs continuous). We address these challenges using a Deep Deterministic Policy Gradient (DDPG) based policy optimization framework on a large-scale (100,000 individual) epidemiological agent-based simulation.
  arXiv  Detail & Related papers  (2023-04-10T09:26:07Z)
• Exploring the Pareto front of multi-objective COVID-19 mitigation policies using reinforcement learning [1.7056617973440933]
  Infectious disease outbreaks can have a disruptive impact on public health and societal processes. Current research focuses on optimizing policies with a single objective, such as the pathogen's attack rate. We apply deep multi-objective reinforcement learning and build upon a state-of-the-art algorithm to learn a set of solutions.
  arXiv  Detail & Related papers  (2022-04-11T11:55:06Z)
• A Microscopic Pandemic Simulator for Pandemic Prediction Using Scalable Million-Agent Reinforcement Learning [7.653466578233261]
  This paper proposes a deep-reinforcement-learning-powered microscopic model named Microscopic Pandemic Simulator (MPS) By replacing rule-based agents with rational agents whose behaviors are driven to maximize rewards, the MPS provides a better approximation of real world dynamics. This paper first calibrates the MPS against real-world data in Allegheny, US, then demonstratively evaluates two government strategies: information disclosure and quarantine.
  arXiv  Detail & Related papers  (2021-08-14T17:07:25Z)
• STELAR: Spatio-temporal Tensor Factorization with Latent Epidemiological Regularization [76.57716281104938]
  We develop a tensor method to predict the evolution of epidemic trends for many regions simultaneously. STELAR enables long-term prediction by incorporating latent temporal regularization through a system of discrete-time difference equations. We conduct experiments using both county- and state-level COVID-19 data and show that our model can identify interesting latent patterns of the epidemic.
  arXiv  Detail & Related papers  (2020-12-08T21:21:47Z)
• An Optimal Control Approach to Learning in SIDARTHE Epidemic model [67.22168759751541]
  We propose a general approach for learning time-variant parameters of dynamic compartmental models from epidemic data. We forecast the epidemic evolution in Italy and France.
  arXiv  Detail & Related papers  (2020-10-28T10:58:59Z)
• Steering a Historical Disease Forecasting Model Under a Pandemic: Case of Flu and COVID-19 [75.99038202534628]
  We propose CALI-Net, a neural transfer learning architecture which allows us to'steer' a historical disease forecasting model to new scenarios where flu and COVID co-exist. Our experiments demonstrate that our approach is successful in adapting a historical forecasting model to the current pandemic.
  arXiv  Detail & Related papers  (2020-09-23T22:35:43Z)
• Data-driven Simulation and Optimization for Covid-19 Exit Strategies [16.31545249131776]
  The rapid spread of the Coronavirus SARS-2 is a major challenge that led almost all governments worldwide to take drastic measures to respond to the tragedy. We have built a pandemic simulation and forecasting toolkit that combines a deep learning estimation of the epidemiological parameters of the disease.
  arXiv  Detail & Related papers  (2020-06-12T11:18:25Z)
• A General Framework for Survival Analysis and Multi-State Modelling [70.31153478610229]
  We use neural ordinary differential equations as a flexible and general method for estimating multi-state survival models. We show that our model exhibits state-of-the-art performance on popular survival data sets and demonstrate its efficacy in a multi-state setting.
  arXiv  Detail & Related papers  (2020-06-08T19:24:54Z)
• A Deep Q-learning/genetic Algorithms Based Novel Methodology For Optimizing Covid-19 Pandemic Government Actions [63.669642197519934]
  We use the SEIR epidemiological model to represent the evolution of the virus COVID-19 over time in the population. The sequences of actions (confinement, self-isolation, two-meter distance or not taking restrictions) are evaluated according to a reward system. We prove that our methodology is a valid tool to discover actions governments can take to reduce the negative effects of a pandemic in both senses.
  arXiv  Detail & Related papers  (2020-05-15T17:17:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.