VacSIM: Learning Effective Strategies for COVID-19 Vaccine Distribution using Reinforcement Learning

• URL: http://arxiv.org/abs/2009.06602v3
• Date: Sat, 4 Dec 2021 14:05:24 GMT
• Title: VacSIM: Learning Effective Strategies for COVID-19 Vaccine Distribution using Reinforcement Learning
• Authors: Raghav Awasthi, Keerat Kaur Guliani, Saif Ahmad Khan, Aniket Vashishtha, Mehrab Singh Gill, Arshita Bhatt, Aditya Nagori, Aniket Gupta, Ponnurangam Kumaraguru, Tavpritesh Sethi
• Abstract summary: VacSIM is a novel pipeline that dovetails Deep Reinforcement Learning models into a Contextual Bandits approach for optimizing the distribution of COVID-19 vaccine. We evaluate this framework against a naive allocation approach of distributing vaccine proportional to the incidence of COVID-19 cases in five different States across India.
• Score: 6.167847933188907
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: A COVID-19 vaccine is our best bet for mitigating the ongoing onslaught of the pandemic. However, vaccine is also expected to be a limited resource. An optimal allocation strategy, especially in countries with access inequities and temporal separation of hot-spots, might be an effective way of halting the disease spread. We approach this problem by proposing a novel pipeline VacSIM that dovetails Deep Reinforcement Learning models into a Contextual Bandits approach for optimizing the distribution of COVID-19 vaccine. Whereas the Reinforcement Learning models suggest better actions and rewards, Contextual Bandits allow online modifications that may need to be implemented on a day-to-day basis in the real world scenario. We evaluate this framework against a naive allocation approach of distributing vaccine proportional to the incidence of COVID-19 cases in five different States across India (Assam, Delhi, Jharkhand, Maharashtra and Nagaland) and demonstrate up to 9039 potential infections prevented and a significant increase in the efficacy of limiting the spread over a period of 45 days through the VacSIM approach. Our models and the platform are extensible to all states of India and potentially across the globe. We also propose novel evaluation strategies including standard compartmental model-based projections and a causality-preserving evaluation of our model. Since all models carry assumptions that may need to be tested in various contexts, we open source our model VacSIM and contribute a new reinforcement learning environment compatible with OpenAI gym to make it extensible for real-world applications across the globe. (http://vacsim.tavlab.iiitd.edu.in:8000/).

Related papers

• Modelling the Spread of COVID-19 in Indoor Spaces using Automated Probabilistic Planning [0.0]
  coronavirus disease 2019 (COVID-19) pandemic has been ongoing for around 3 years. Several strategies for controlling the spread of the disease have been debated by healthcare professionals. To anticipate the potential impact of the disease, and to simulate the effectiveness of different mitigation strategies, a robust model of disease spread is needed.
  arXiv  Detail & Related papers  (2023-08-16T07:41:53Z)
• Cooperating Graph Neural Networks with Deep Reinforcement Learning for Vaccine Prioritization [0.0]
  This study explores the vaccine prioritization strategy to reduce the overall burden of the pandemic when the supply is limited. Existing methods conduct macro-level or simplified micro-level vaccine distribution by assuming the homogeneous behavior within subgroup populations. We develop a novel deep reinforcement learning to seek the optimal vaccine allocation strategy for the high-degree spatial-temporal disease evolution system.
  arXiv  Detail & Related papers  (2023-05-09T04:19:10Z)
• Evaluating COVID-19 vaccine allocation policies using Bayesian $m$-top exploration [53.122045119395594]
  We present a novel technique for evaluating vaccine allocation strategies using a multi-armed bandit framework. $m$-top exploration allows the algorithm to learn $m$ policies for which it expects the highest utility. We consider the Belgian COVID-19 epidemic using the individual-based model STRIDE, where we learn a set of vaccination policies.
  arXiv  Detail & Related papers  (2023-01-30T12:22:30Z)
• Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification [60.49594822215981]
  This paper presents a classification model for detecting COVID-19 vaccination related search queries. We propose a novel approach of considering dense features as memory tokens that the model can attend to. We show that this new modeling approach enables a significant improvement to the Vaccine Search Insights (VSI) task.
  arXiv  Detail & Related papers  (2022-12-16T13:57:41Z)
• Boundary Guided Semantic Learning for Real-time COVID-19 Lung Infection Segmentation System [69.40329819373954]
  The coronavirus disease 2019 (COVID-19) continues to have a negative impact on healthcare systems around the world. At the current stage, automatically segmenting the lung infection area from CT images is essential for the diagnosis and treatment of COVID-19. We propose a boundary guided semantic learning network (BSNet) in this paper.
  arXiv  Detail & Related papers  (2022-09-07T05:01:38Z)
• Compartmental Models for COVID-19 and Control via Policy Interventions [0.0]
  We demonstrate an approach to replicate and forecast the spread of the SARS-CoV-2 pandemic using the toolkit of probabilistic programming languages (PPLs) Our goal is to study the impact of various modeling assumptions and motivate policy interventions enacted to limit the spread of infectious diseases. We are not epidemiologists; the sole aim of this study is to serve as an exposition of methods, not to directly infer the real-world impact of policy-making for COVID-19.
  arXiv  Detail & Related papers  (2022-03-06T02:50:54Z)
• Modeling the effect of the vaccination campaign on the Covid-19 pandemic [0.0]
  We introduce SAIVR, a mathematical model able to forecast the Covid-19 epidemic evolution during the vaccination campaign. The model contains several parameters and initial conditions that are estimated by employing a semi-supervised machine learning procedure. Instructed by these results, we performed an extensive study on the temporal evolution of the pandemic under varying values of roll-out daily rates, vaccine efficacy, and a broad range of societal vaccine hesitancy/denial levels.
  arXiv  Detail & Related papers  (2021-08-27T19:12:13Z)
• Semi-supervised Neural Networks solve an inverse problem for modeling Covid-19 spread [61.9008166652035]
  We study the spread of COVID-19 using a semi-supervised neural network. We assume a passive part of the population remains isolated from the virus dynamics.
  arXiv  Detail & Related papers  (2020-10-10T19:33:53Z)
• Analysis of COVID-19 cases in India through Machine Learning: A Study of Intervention [3.4483987421251516]
  To combat the coronavirus disease 2019 (COVID-19) pandemic, the world has vaccination, plasma therapy, herd immunity, and epidemiological interventions as few possible options. In this work, we have suggested the SIR model with intervention, which incorporates the epidemiological interventions in the classical SIR model. We present predicted numbers of active and recovered COVID-19 cases till Sept 30, 2020, for entire India and some states of India and also estimate the 95% and 99% confidence interval for the predicted cases.
  arXiv  Detail & Related papers  (2020-08-17T05:45:50Z)
• Cross-lingual Transfer Learning for COVID-19 Outbreak Alignment [90.12602012910465]
  We train on Italy's early COVID-19 outbreak through Twitter and transfer to several other countries. Our experiments show strong results with up to 0.85 Spearman correlation in cross-country predictions.
  arXiv  Detail & Related papers  (2020-06-05T02:04:25Z)
• When and How to Lift the Lockdown? Global COVID-19 Scenario Analysis and Policy Assessment using Compartmental Gaussian Processes [111.69190108272133]
  coronavirus disease 2019 (COVID-19) global pandemic has led many countries to impose unprecedented lockdown measures. Data-driven models that predict COVID-19 fatalities under different lockdown policy scenarios are essential. This paper develops a Bayesian model for predicting the effects of COVID-19 lockdown policies in a global context.
  arXiv  Detail & Related papers  (2020-05-13T18:21:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.