Enhancing Health Mention Classification Performance: A Study on Advancements in Parameter Efficient Tuning

• URL: http://arxiv.org/abs/2504.21685v1
• Date: Wed, 30 Apr 2025 14:21:54 GMT
• Title: Enhancing Health Mention Classification Performance: A Study on Advancements in Parameter Efficient Tuning
• Authors: Reem Abdel-Salam, Mary Adewunmi,
• Abstract summary: Health Mention Classification (HMC) plays a critical role in leveraging social media posts for real-time tracking and public health monitoring.<n>We argue that clearer mentions can be achieved through conventional fine-tuning with enhanced parameters of biomedical natural language methods (NLP)<n>In this study, we explore different techniques such as the utilisation of part-of-speech (POS) tagger information, improving on PEFT techniques, and different combinations thereof.
• Score: 4.604003661048267
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Health Mention Classification (HMC) plays a critical role in leveraging social media posts for real-time tracking and public health monitoring. Nevertheless, the process of HMC presents significant challenges due to its intricate nature, primarily stemming from the contextual aspects of health mentions, such as figurative language and descriptive terminology, rather than explicitly reflecting a personal ailment. To address this problem, we argue that clearer mentions can be achieved through conventional fine-tuning with enhanced parameters of biomedical natural language methods (NLP). In this study, we explore different techniques such as the utilisation of part-of-speech (POS) tagger information, improving on PEFT techniques, and different combinations thereof. Extensive experiments are conducted on three widely used datasets: RHDM, PHM, and Illness. The results incorporated POS tagger information, and leveraging PEFT techniques significantly improves performance in terms of F1-score compared to state-of-the-art methods across all three datasets by utilising smaller models and efficient training. Furthermore, the findings highlight the effectiveness of incorporating POS tagger information and leveraging PEFT techniques for HMC. In conclusion, the proposed methodology presents a potentially effective approach to accurately classifying health mentions in social media posts while optimising the model size and training efficiency.

Related papers

• A Novel Hybrid Parameter-Efficient Fine-Tuning Approach for Hippocampus Segmentation and Alzheimer's Disease Diagnosis [12.775565417928895]
  We propose a novel parameter-efficient fine-tuning strategy, termed HyPS, which employs a hybrid parallel and serial architecture. HyPS updates a minimal subset of model parameters, thereby retaining the pre-trained model's original knowledge tructure. In distinguishing Alzheimer's disease from cognitively normal (CN) individuals, HyPS achieved classification accuracies of 83.78% and 64.29%, respectively.
  arXiv  Detail & Related papers  (2024-09-02T00:52:00Z)
• STLLaVA-Med: Self-Training Large Language and Vision Assistant for Medical Question-Answering [58.79671189792399]
  STLLaVA-Med is designed to train a policy model capable of auto-generating medical visual instruction data. We validate the efficacy and data efficiency of STLLaVA-Med across three major medical Visual Question Answering (VQA) benchmarks.
  arXiv  Detail & Related papers  (2024-06-28T15:01:23Z)
• Physical formula enhanced multi-task learning for pharmacokinetics prediction [54.13787789006417]
  A major challenge for AI-driven drug discovery is the scarcity of high-quality data. We develop a formula enhanced mul-ti-task learning (PEMAL) method that predicts four key parameters of pharmacokinetics simultaneously. Our experiments reveal that PEMAL significantly lowers the data demand, compared to typical Graph Neural Networks.
  arXiv  Detail & Related papers  (2024-04-16T07:42:55Z)
• Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary Task Integration [54.76511683427566]
  This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information. A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction. The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures.
  arXiv  Detail & Related papers  (2024-02-16T05:16:20Z)
• Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data [43.48422400822597]
  Large language models (LLMs) are capable of many natural language tasks, yet they are far from perfect. This paper investigates the capacity of LLMs to make inferences about health based on contextual information. We present a comprehensive evaluation of 12 state-of-the-art LLMs with prompting and fine-tuning techniques on four public health datasets.
  arXiv  Detail & Related papers  (2024-01-12T19:40:11Z)
• TriDeNT: Triple Deep Network Training for Privileged Knowledge Distillation in Histopathology [3.2157163136267948]
  We present TriDeNT, a novel self-supervised method for utilising privileged data that is not available during inference to improve performance. We demonstrate the efficacy of this method for a range of different paired data including spatialchemistry, spatial transcriptomics and expert nuclei annotations. In all settings, TriDeNT outperforms other state-of-the-art methods in downstream tasks, with observed improvements of up to 101%.
  arXiv  Detail & Related papers  (2023-12-04T18:43:45Z)
• Learnable Weight Initialization for Volumetric Medical Image Segmentation [66.3030435676252]
  We propose a learnable weight-based hybrid medical image segmentation approach. Our approach is easy to integrate into any hybrid model and requires no external training data. Experiments on multi-organ and lung cancer segmentation tasks demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-06-15T17:55:05Z)
• Incorporating Emotions into Health Mention Classification Task on Social Media [70.23889100356091]
  We present a framework for health mention classification that incorporates affective features. We evaluate our approach on 5 HMC-related datasets from different social media platforms. Our results indicate that HMC models infused with emotional knowledge are an effective alternative.
  arXiv  Detail & Related papers  (2022-12-09T18:38:41Z)
• No Pairs Left Behind: Improving Metric Learning with Regularized Triplet Objective [19.32706951298244]
  We propose a novel formulation of the triplet objective function that improves metric learning without additional sample mining or overhead costs. We show that our method (called No Pairs Left Behind [NPLB]) improves upon the traditional and current state-of-the-art triplet objective formulations.
  arXiv  Detail & Related papers  (2022-10-18T00:56:01Z)
• Automatic airway segmentation from Computed Tomography using robust and efficient 3-D convolutional neural networks [0.0]
  We present a fully automatic and end-to-end optimised airway segmentation method for thoracic computed tomography. We use a simple and low-memory 3D U-Net as backbone, which allows the method to process large 3D image patches. We show that our method can extract highly complete airway trees with few false positive errors.
  arXiv  Detail & Related papers  (2021-03-30T13:21:02Z)
• MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
  We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos. We release a new dataset, MEDICA, for mental health patient engagement detection.
  arXiv  Detail & Related papers  (2020-11-17T15:18:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.