A Multi-Agent Reinforcement Learning Framework for Evaluating the U.S. Ending the HIV Epidemic Plan

• URL: http://arxiv.org/abs/2311.00855v2
• Date: Mon, 6 Nov 2023 22:33:41 GMT
• Title: A Multi-Agent Reinforcement Learning Framework for Evaluating the U.S. Ending the HIV Epidemic Plan
• Authors: Dinesh Sharma, Ankit Shah, Chaitra Gopalappa
• Abstract summary: Ending the HIV Epidemic initiative aims to reduce new infections by 90% by 2030. Existing HIV decision analytic models either evaluate specific cities or the overall national population, thus overlooking jurisdictional interactions or differences. We propose a multi-agent reinforcement learning (MARL) model, that enables jurisdiction-specific decision analyses but in an environment with cross-jurisdictional epidemiological interactions.
• Score: 2.498439320062193
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Human immunodeficiency virus (HIV) is a major public health concern in the United States, with about 1.2 million people living with HIV and 35,000 newly infected each year. There are considerable geographical disparities in HIV burden and care access across the U.S. The 2019 Ending the HIV Epidemic (EHE) initiative aims to reduce new infections by 90% by 2030, by improving coverage of diagnoses, treatment, and prevention interventions and prioritizing jurisdictions with high HIV prevalence. Identifying optimal scale-up of intervention combinations will help inform resource allocation. Existing HIV decision analytic models either evaluate specific cities or the overall national population, thus overlooking jurisdictional interactions or differences. In this paper, we propose a multi-agent reinforcement learning (MARL) model, that enables jurisdiction-specific decision analyses but in an environment with cross-jurisdictional epidemiological interactions. In experimental analyses, conducted on jurisdictions within California and Florida, optimal policies from MARL were significantly different than those generated from single-agent RL, highlighting the influence of jurisdictional variations and interactions. By using comprehensive modeling of HIV and formulations of state space, action space, and reward functions, this work helps demonstrate the strengths and applicability of MARL for informing public health policies, and provides a framework for expanding to the national-level to inform the EHE.

Related papers

• Promoting Fair Vaccination Strategies Through Influence Maximization: A Case Study on COVID-19 Spread [5.505634045241288]
  The aftermath of the Covid-19 pandemic saw more severe outcomes for racial minority groups and economically-deprived communities. We propose a novel approach to develop vaccination strategies which incorporate demographic fairness.
  arXiv  Detail & Related papers  (2024-02-20T20:54:18Z)
• Time Series Forecasting of HIV/AIDS in the Philippines Using Deep Learning: Does COVID-19 Epidemic Matter? [0.0]
  The HIV/AIDS epidemic in the Philippines is the one that is spreading the quickest in the western Pacific. Although the full effects of COVID-19 on HIV services and development are still unknown, it is predicted that such disruptions could lead to an increase in HIV casualties. This study uses Multilayer Perceptron Neural Network to forecast time series during the period when the COVID-19 pandemic strikes the nation.
  arXiv  Detail & Related papers  (2024-01-11T14:11:30Z)
• First 100 days of pandemic; an interplay of pharmaceutical, behavioral and digital interventions -- A study using agent based modeling [14.192977334409104]
  We simulate realistic pharmaceutical, behavioral, and digital interventions that mirror challenges in real-world policy adoption. Our analysis reveals the pivotal role of the initial 100 days in dictating a pandemic's course.
  arXiv  Detail & Related papers  (2024-01-09T19:38:59Z)
• Agent-Based Model: Simulating a Virus Expansion Based on the Acceptance of Containment Measures [65.62256987706128]
  Compartmental epidemiological models categorize individuals based on their disease status. We propose an ABM architecture that combines an adapted SEIRD model with a decision-making model for citizens. We illustrate the designed model by examining the progression of SARS-CoV-2 infections in A Coruna, Spain.
  arXiv  Detail & Related papers  (2023-07-28T08:01:05Z)
• A k-mer Based Approach for SARS-CoV-2 Variant Identification [55.78588835407174]
  We show that preserving the order of the amino acids helps the underlying classifiers to achieve better performance. We also show the importance of the different amino acids which play a key role in identifying variants and how they coincide with those reported by the USA's Centers for Disease Control and Prevention (CDC)
  arXiv  Detail & Related papers  (2021-08-07T15:08:15Z)
• Timely Tracking of Infection Status of Individuals in a Population [70.21702849459986]
  We consider real-time timely tracking of infection status of individuals in a population. In this work, a health care provider wants to detect infected people as well as people who recovered from the disease.
  arXiv  Detail & Related papers  (2020-12-24T18:49:22Z)
• Cross-lingual Transfer Learning for COVID-19 Outbreak Alignment [90.12602012910465]
  We train on Italy's early COVID-19 outbreak through Twitter and transfer to several other countries. Our experiments show strong results with up to 0.85 Spearman correlation in cross-country predictions.
  arXiv  Detail & Related papers  (2020-06-05T02:04:25Z)
• A Deep Q-learning/genetic Algorithms Based Novel Methodology For Optimizing Covid-19 Pandemic Government Actions [63.669642197519934]
  We use the SEIR epidemiological model to represent the evolution of the virus COVID-19 over time in the population. The sequences of actions (confinement, self-isolation, two-meter distance or not taking restrictions) are evaluated according to a reward system. We prove that our methodology is a valid tool to discover actions governments can take to reduce the negative effects of a pandemic in both senses.
  arXiv  Detail & Related papers  (2020-05-15T17:17:45Z)
• $\alpha$-Satellite: An AI-driven System and Benchmark Datasets for Hierarchical Community-level Risk Assessment to Help Combat COVID-19 [24.774285634657787]
  coronavirus disease (COVID-19) has infected more than 531,000 people with more than 24,000 deaths in at least 171 countries. A growing number of areas reporting local sub-national community transmission would represent a significant turn for the worse in the battle against the novel coronavirus. We propose and develop an AI-driven system (named $alpha$-Satellite, as an initial offering) to provide hierarchical community-level risk assessment.
  arXiv  Detail & Related papers  (2020-03-27T04:44:53Z)
• Mapping the Landscape of Artificial Intelligence Applications against COVID-19 [59.30734371401316]
  COVID-19, the disease caused by the SARS-CoV-2 virus, has been declared a pandemic by the World Health Organization. We present an overview of recent studies using Machine Learning and, more broadly, Artificial Intelligence to tackle many aspects of the COVID-19 crisis.
  arXiv  Detail & Related papers  (2020-03-25T12:30:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.