Learning from pandemics: using extraordinary events can improve disease now-casting models

• URL: http://arxiv.org/abs/2101.06774v1
• Date: Sun, 17 Jan 2021 20:36:19 GMT
• Title: Learning from pandemics: using extraordinary events can improve disease now-casting models
• Authors: Sara Mesquita, Cl\'audio Haupt Vieira, L\'ilia Perfeito and Joana Gon\c{c}alves-S\'a
• Abstract summary: Fear, curiosity and many other reasons can lead individuals to search for health-related information, masking the disease-driven searches. Here, we focus on the two pandemics of the 21st century (2009-H1N1 flu and Covid-19) and propose a methodology to discriminate between search patterns linked to general information seeking. We show that by learning from such pandemic periods, with high anxiety and media hype, it is possible to select online searches and improve model performance.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Online searches have been used to study different health-related behaviours, including monitoring disease outbreaks. An obvious caveat is that several reasons can motivate individuals to seek online information and models that are blind to people's motivations are of limited use and can even mislead. This is particularly true during extraordinary public health crisis, such as the ongoing pandemic, when fear, curiosity and many other reasons can lead individuals to search for health-related information, masking the disease-driven searches. However, health crisis can also offer an opportunity to disentangle between different drivers and learn about human behavior. Here, we focus on the two pandemics of the 21st century (2009-H1N1 flu and Covid-19) and propose a methodology to discriminate between search patterns linked to general information seeking (media driven) and search patterns possibly more associated with actual infection (disease driven). We show that by learning from such pandemic periods, with high anxiety and media hype, it is possible to select online searches and improve model performance both in pandemic and seasonal settings. Moreover, and despite the common claim that more data is always better, our results indicate that lower volume of the right data can be better than including large volumes of apparently similar data, especially in the long run. Our work provides a general framework that can be applied beyond specific events and diseases, and argues that algorithms can be improved simply by using less (better) data. This has important consequences, for example, to solve the accuracy-explainability trade-off in machine-learning.

Related papers

• Human Behavior in the Time of COVID-19: Learning from Big Data [71.26355067309193]
  Since March 2020, there have been over 600 million confirmed cases of COVID-19 and more than six million deaths. The pandemic has impacted and even changed human behavior in almost every aspect. Researchers have been employing big data techniques such as natural language processing, computer vision, audio signal processing, frequent pattern mining, and machine learning.
  arXiv  Detail & Related papers  (2023-03-23T17:19:26Z)
• Practical Challenges in Differentially-Private Federated Survival Analysis of Medical Data [57.19441629270029]
  In this paper, we take advantage of the inherent properties of neural networks to federate the process of training of survival analysis models. In the realistic setting of small medical datasets and only a few data centers, this noise makes it harder for the models to converge. We propose DPFed-post which adds a post-processing stage to the private federated learning scheme.
  arXiv  Detail & Related papers  (2022-02-08T10:03:24Z)
• #StayHome or #Marathon? Social Media Enhanced Pandemic Surveillance on Spatial-temporal Dynamic Graphs [23.67939019353524]
  COVID-19 has caused lasting damage to almost every domain in public health, society, and economy. Existing studies rely on the aggregation of traditional statistical models and epidemic spread theory. We propose a novel framework, Social Media enhAnced pandemic knowledge based on the extracted events and relationships.
  arXiv  Detail & Related papers  (2021-08-08T15:46:05Z)
• An introduction to causal reasoning in health analytics [2.199093822766999]
  We will try to highlight some of the drawbacks that may arise in traditional machine learning and statistical approaches to analyze the observational data. We will demonstrate the applications of causal inference in tackling some common machine learning issues.
  arXiv  Detail & Related papers  (2021-05-10T20:25:56Z)
• Combining Graph Neural Networks and Spatio-temporal Disease Models to Predict COVID-19 Cases in Germany [0.0]
  Several experts have called for the necessity to account for human mobility to explain the spread of COVID-19. Most statistical or epidemiological models cannot directly incorporate unstructured data sources, including data that may encode human mobility. We propose a trade-off between both research directions and present a novel learning approach that combines the advantages of statistical regression and machine learning models.
  arXiv  Detail & Related papers  (2021-01-03T16:39:00Z)
• A general method for estimating the prevalence of Influenza-Like-Symptoms with Wikipedia data [0.979731979071071]
  Influenza is an acute respiratory seasonal disease that affects millions of people worldwide and causes thousands of deaths in Europe alone. We show the feasibility of exploiting information about Wikipedia's page views to obtain accurate estimates of influenza-like illnesses incidence in four European countries: Italy, Germany, Belgium, and the Netherlands. We propose a novel language-agnostic method, based on two algorithms, Personalized PageRank and CycleRank, to automatically select the most relevant Wikipedia pages to be monitored without the need for expert supervision.
  arXiv  Detail & Related papers  (2020-10-28T11:44:44Z)
• Steering a Historical Disease Forecasting Model Under a Pandemic: Case of Flu and COVID-19 [75.99038202534628]
  We propose CALI-Net, a neural transfer learning architecture which allows us to'steer' a historical disease forecasting model to new scenarios where flu and COVID co-exist. Our experiments demonstrate that our approach is successful in adapting a historical forecasting model to the current pandemic.
  arXiv  Detail & Related papers  (2020-09-23T22:35:43Z)
• Epidemic mitigation by statistical inference from contact tracing data [61.04165571425021]
  We develop Bayesian inference methods to estimate the risk that an individual is infected. We propose to use probabilistic risk estimation in order to optimize testing and quarantining strategies for the control of an epidemic. Our approaches translate into fully distributed algorithms that only require communication between individuals who have recently been in contact.
  arXiv  Detail & Related papers  (2020-09-20T12:24:45Z)
• A General Framework for Survival Analysis and Multi-State Modelling [70.31153478610229]
  We use neural ordinary differential equations as a flexible and general method for estimating multi-state survival models. We show that our model exhibits state-of-the-art performance on popular survival data sets and demonstrate its efficacy in a multi-state setting.
  arXiv  Detail & Related papers  (2020-06-08T19:24:54Z)
• COVI White Paper [67.04578448931741]
  Contact tracing is an essential tool to change the course of the Covid-19 pandemic. We present an overview of the rationale, design, ethical considerations and privacy strategy of COVI,' a Covid-19 public peer-to-peer contact tracing and risk awareness mobile application developed in Canada.
  arXiv  Detail & Related papers  (2020-05-18T07:40:49Z)
• The Pace and Pulse of the Fight against Coronavirus across the US, A Google Trends Approach [0.0]
  Google Trends can be used as a proxy for what people are thinking, needing, and planning. We use it to provide both insights into, and potential indicators of, important changes in information-seeking patterns during pandemics like COVID-19.
  arXiv  Detail & Related papers  (2020-05-05T20:55:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.