Actively evaluating and learning the distinctions that matter: Vaccine safety signal detection from emergency triage notes

• URL: http://arxiv.org/abs/2507.18123v1
• Date: Thu, 24 Jul 2025 06:18:34 GMT
• Title: Actively evaluating and learning the distinctions that matter: Vaccine safety signal detection from emergency triage notes
• Authors: Sedigh Khademi, Christopher Palmer, Muhammad Javed, Hazel Clothier, Jim Buttery, Gerardo Luis Dimaguila, Jim Black,
• Abstract summary: COVID-19 vaccines have showcased the global communitys ability to combat infectious diseases.<n>The need for post-licensure surveillance systems has grown due to the limited window for safety data collection in clinical trials and early widespread implementation.<n>This study aims to employ Natural Language Processing techniques and Active Learning to rapidly develop a classifier that detects potential vaccine safety issues from emergency department notes.
• Score: 0.5025737475817937
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The rapid development of COVID-19 vaccines has showcased the global communitys ability to combat infectious diseases. However, the need for post-licensure surveillance systems has grown due to the limited window for safety data collection in clinical trials and early widespread implementation. This study aims to employ Natural Language Processing techniques and Active Learning to rapidly develop a classifier that detects potential vaccine safety issues from emergency department notes. ED triage notes, containing expert, succinct vital patient information at the point of entry to health systems, can significantly contribute to timely vaccine safety signal surveillance. While keyword-based classification can be effective, it may yield false positives and demand extensive keyword modifications. This is exacerbated by the infrequency of vaccination-related ED presentations and their similarity to other reasons for ED visits. NLP offers a more accurate and efficient alternative, albeit requiring annotated data, which is often scarce in the medical field. Active learning optimizes the annotation process and the quality of annotated data, which can result in faster model implementation and improved model performance. This work combines active learning, data augmentation, and active learning and evaluation techniques to create a classifier that is used to enhance vaccine safety surveillance from ED triage notes.

Related papers

• Enhancing Vaccine Safety Surveillance: Extracting Vaccine Mentions from Emergency Department Triage Notes Using Fine-Tuned Large Language Models [0.5025737475817937]
  The performance of prompt-engineered models, fine-tuned models, and a rule-based approach was compared.<n>The fine-tuned Llama 3 billion parameter model outperformed other models in its accuracy of extracting vaccine names.
  arXiv  Detail & Related papers  (2025-07-10T09:57:08Z)
• GEMeX-ThinkVG: Towards Thinking with Visual Grounding in Medical VQA via Reinforcement Learning [50.94508930739623]
  Medical visual question answering aims to support clinical decision-making by enabling models to answer natural language questions based on medical images.<n>Current methods still suffer from limited answer reliability and poor interpretability, impairing the ability of clinicians and patients to understand and trust model-generated answers.<n>This work first proposes a Thinking with Visual Grounding dataset wherein the answer generation is decomposed into intermediate reasoning steps.<n>We introduce a novel verifiable reward mechanism for reinforcement learning to guide post-training, improving the alignment between the model's reasoning process and its final answer.
  arXiv  Detail & Related papers  (2025-06-22T08:09:58Z)
• Adversarial Prompt Distillation for Vision-Language Models [63.24270920122456]
  Adversarial Prompt Tuning (APT) applies adversarial training during the process of prompt tuning.<n>APD is a bimodal knowledge distillation framework that enhances APT by integrating it with multi-modal knowledge transfer.<n>Extensive experiments on multiple benchmark datasets demonstrate the superiority of our APD method over the current state-of-the-art APT methods.
  arXiv  Detail & Related papers  (2024-11-22T03:02:13Z)
• Immunogenicity Prediction with Dual Attention Enables Vaccine Target Selection [6.949493332885247]
  We introduce VenusVaccine, a novel deep learning solution for predicting immunogenicity in vaccines.<n>We also compile the most comprehensive immunogenicity dataset to date, encompassing over 7000 antigen sequences, structures, and immunogenicity labels from bacteria, virus, and tumor.<n>Our work provides an effective tool for vaccine design and sets valuable benchmarks for future research.
  arXiv  Detail & Related papers  (2024-10-03T16:33:35Z)
• Utilizing Computer Vision for Continuous Monitoring of Vaccine Side Effects in Experimental Mice [3.0544571370338516]
  We explore the application of computer vision technologies to automate the monitoring of experimental mice for potential side effects after vaccine administration. Preliminary results indicate that computer vision effectively identify subtle changes, signaling possible side effects.
  arXiv  Detail & Related papers  (2024-04-03T23:59:59Z)
• Hierarchical Multi-Label Classification of Online Vaccine Concerns [8.271202196208]
  Vaccine concerns are an ever-evolving target, and can shift quickly as seen during the COVID-19 pandemic. We explore the task of detecting vaccine concerns in online discourse using large language models (LLMs) in a zero-shot setting without the need for expensive training datasets.
  arXiv  Detail & Related papers  (2024-02-01T20:56:07Z)
• Self-Verification Improves Few-Shot Clinical Information Extraction [73.6905567014859]
  Large language models (LLMs) have shown the potential to accelerate clinical curation via few-shot in-context learning. They still struggle with issues regarding accuracy and interpretability, especially in mission-critical domains such as health. Here, we explore a general mitigation framework using self-verification, which leverages the LLM to provide provenance for its own extraction and check its own outputs.
  arXiv  Detail & Related papers  (2023-05-30T22:05:11Z)
• Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification [60.49594822215981]
  This paper presents a classification model for detecting COVID-19 vaccination related search queries. We propose a novel approach of considering dense features as memory tokens that the model can attend to. We show that this new modeling approach enables a significant improvement to the Vaccine Search Insights (VSI) task.
  arXiv  Detail & Related papers  (2022-12-16T13:57:41Z)
• ALLSH: Active Learning Guided by Local Sensitivity and Hardness [98.61023158378407]
  We propose to retrieve unlabeled samples with a local sensitivity and hardness-aware acquisition function. Our method achieves consistent gains over the commonly used active learning strategies in various classification tasks.
  arXiv  Detail & Related papers  (2022-05-10T15:39:11Z)
• Disentangled Learning of Stance and Aspect Topics for Vaccine Attitude Detection in Social Media [40.61499595293957]
  We propose a novel semi-supervised approach for vaccine attitude detection, called VADet. VADet is able to learn disentangled stance and aspect topics, and outperforms existing aspect-based sentiment analysis models on both stance detection and tweet clustering.
  arXiv  Detail & Related papers  (2022-05-06T15:24:33Z)
• Predicting Infectiousness for Proactive Contact Tracing [75.62186539860787]
  Large-scale digital contact tracing is a potential solution to resume economic and social activity while minimizing spread of the virus. Various DCT methods have been proposed, each making trade-offs between privacy, mobility restrictions, and public health. This paper develops and test methods that can be deployed to a smartphone to proactively predict an individual's infectiousness.
  arXiv  Detail & Related papers  (2020-10-23T17:06:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.