Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model

• URL: http://arxiv.org/abs/2204.04521v1
• Date: Sat, 9 Apr 2022 18:01:18 GMT
• Title: Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model
• Authors: Usman Naseem, Byoung Chan Lee, Matloob Khushi, Jinman Kim, Adam G. Dunn
• Abstract summary: We present PHS-BERT, a transformer-based language model to identify tasks related to public health surveillance on social media. Compared with existing PLMs that are mainly evaluated on limited tasks, PHS-BERT achieved state-of-the-art performance on all 25 tested datasets.
• Score: 9.070482285386387
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A user-generated text on social media enables health workers to keep track of information, identify possible outbreaks, forecast disease trends, monitor emergency cases, and ascertain disease awareness and response to official health correspondence. This exchange of health information on social media has been regarded as an attempt to enhance public health surveillance (PHS). Despite its potential, the technology is still in its early stages and is not ready for widespread application. Advancements in pretrained language models (PLMs) have facilitated the development of several domain-specific PLMs and a variety of downstream applications. However, there are no PLMs for social media tasks involving PHS. We present and release PHS-BERT, a transformer-based PLM, to identify tasks related to public health surveillance on social media. We compared and benchmarked the performance of PHS-BERT on 25 datasets from different social medial platforms related to 7 different PHS tasks. Compared with existing PLMs that are mainly evaluated on limited tasks, PHS-BERT achieved state-of-the-art performance on all 25 tested datasets, showing that our PLM is robust and generalizable in the common PHS tasks. By making PHS-BERT available, we aim to facilitate the community to reduce the computational cost and introduce new baselines for future works across various PHS-related tasks.

Related papers

• SMP Challenge: An Overview and Analysis of Social Media Prediction Challenge [63.311045291016555]
  Social Media Popularity Prediction (SMPP) is a crucial task that involves automatically predicting future popularity values of online posts. This paper summarizes the challenging task, data, and research progress.
  arXiv  Detail & Related papers  (2024-05-17T02:36:14Z)
• Event Detection from Social Media for Epidemic Prediction [76.90779562626541]
  We develop a framework to extract and analyze epidemic-related events from social media posts. Experimentation reveals how ED models trained on COVID-based SPEED can effectively detect epidemic events for three unseen epidemics. We show that reporting sharp increases in the extracted events by our framework can provide warnings 4-9 weeks earlier than the WHO epidemic declaration for Monkeypox.
  arXiv  Detail & Related papers  (2024-04-02T06:31:17Z)
• Benefits and Harms of Large Language Models in Digital Mental Health [40.02859683420844]
  Large language models (LLMs) show promise in leading digital mental health to uncharted territory. This article presents contemporary perspectives on the opportunities and risks posed by LLMs in the design, development, and implementation of digital mental health tools.
  arXiv  Detail & Related papers  (2023-11-07T14:11:10Z)
• Balanced and Explainable Social Media Analysis for Public Health with Large Language Models [13.977401672173533]
  Current techniques for public health analysis involve popular models such as BERT and large language models (LLMs) To tackle these challenges, the data imbalance issue can be overcome by sophisticated data augmentation methods for social media datasets. In this paper, a novel ALEX framework is proposed for social media analysis on public health.
  arXiv  Detail & Related papers  (2023-09-12T04:15:34Z)
• UQ at #SMM4H 2023: ALEX for Public Health Analysis with Social Media [33.081637097464146]
  Current techniques for public health analysis involve popular models such as BERT and large language models (LLMs) In this paper, a novel ALEX framework is proposed to improve the performance of public health analysis on social media.
  arXiv  Detail & Related papers  (2023-09-08T08:54:55Z)
• Evaluating the Impact of Social Determinants on Health Prediction in the Intensive Care Unit [10.764842579064636]
  Social determinants of health (SDOH) play a crucial role in a person's health and well-being. Most risk prediction models based on electronic health records do not incorporate a comprehensive set of SDOH features. Our work links a publicly available EHR database, MIMIC-IV, to well-documented SDOH features.
  arXiv  Detail & Related papers  (2023-05-22T01:27:51Z)
• The Design and Implementation of a National AI Platform for Public Healthcare in Italy: Implications for Semantics and Interoperability [62.997667081978825]
  The Italian National Health Service is adopting Artificial Intelligence through its technical agencies. Such a vast programme requires special care in formalising the knowledge domain. Questions have been raised about the impact that AI could have on patients, practitioners, and health systems.
  arXiv  Detail & Related papers  (2023-04-24T08:00:02Z)
• BEV-Net: Assessing Social Distancing Compliance by Joint People Localization and Geometric Reasoning [77.08836528980248]
  Social distancing, an essential public health measure, has gained significant attention since the outbreak of the COVID-19 pandemic. In this work, the problem of visual social distancing compliance assessment in busy public areas with wide field-of-view cameras is considered. A dataset of crowd scenes with people annotations under a bird's eye view (BEV) and ground truth for metric distances is introduced. A multi-branch network, BEV-Net, is proposed to localize individuals in world coordinates and identify high-risk regions where social distancing is violated.
  arXiv  Detail & Related papers  (2021-10-10T23:56:37Z)
• An Urban Population Health Observatory System to Support COVID-19 Pandemic Preparedness, Response, and Management: Design and Development Study [0.8602553195689513]
  This study sought to redefine the Healthy People 2030 SDoH taxonomy to accommodate the COVID-19 pandemic. We aim to implement a prototype for the Urban Population Health Observatory (UPHO), a web-based platform that integrates classified group-level SDoH indicators to individual- and aggregate-level population health data.
  arXiv  Detail & Related papers  (2021-06-16T16:48:55Z)
• PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception [50.551003004553806]
  We create a dataset of physically-grounded abstract social events, PHASE, that resemble a wide range of real-life social interactions. Phase is validated with human experiments demonstrating that humans perceive rich interactions in the social events. As a baseline model, we introduce a Bayesian inverse planning approach, SIMPLE, which outperforms state-of-the-art feed-forward neural networks.
  arXiv  Detail & Related papers  (2021-03-02T18:44:57Z)
• Assessing the Severity of Health States based on Social Media Posts [62.52087340582502]
  We propose a multiview learning framework that models both the textual content as well as contextual-information to assess the severity of the user's health state. The diverse NLU views demonstrate its effectiveness on both the tasks and as well as on the individual disease to assess a user's health.
  arXiv  Detail & Related papers  (2020-09-21T03:45:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.