A Large Language Model Outperforms Other Computational Approaches to the High-Throughput Phenotyping of Physician Notes

• URL: http://arxiv.org/abs/2406.14757v1
• Date: Thu, 20 Jun 2024 22:05:34 GMT
• Title: A Large Language Model Outperforms Other Computational Approaches to the High-Throughput Phenotyping of Physician Notes
• Authors: Syed I. Munzir, Daniel B. Hier, Chelsea Oommen, Michael D. Carrithers,
• Abstract summary: This study compares three computational approaches to high- throughput phenotyping. A Large Language Model (LLM) incorporating generative AI, a Natural Language Processing (NLP) approach utilizing deep learning for span categorization, and a hybrid approach combining word vectors with machine learning. The approach that implemented GPT-4 (a Large Language Model) demonstrated superior performance.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: High-throughput phenotyping, the automated mapping of patient signs and symptoms to standardized ontology concepts, is essential to gaining value from electronic health records (EHR) in the support of precision medicine. Despite technological advances, high-throughput phenotyping remains a challenge. This study compares three computational approaches to high-throughput phenotyping: a Large Language Model (LLM) incorporating generative AI, a Natural Language Processing (NLP) approach utilizing deep learning for span categorization, and a hybrid approach combining word vectors with machine learning. The approach that implemented GPT-4 (a Large Language Model) demonstrated superior performance, suggesting that Large Language Models are poised to be the preferred method for high-throughput phenotyping of physician notes.

Related papers

• High Throughput Phenotyping of Physician Notes with Large Language and Hybrid NLP Models [0.0]
  Deep phenotyping is the detailed description of patient signs and symptoms using concepts from an ontology. In this study, we demonstrate that a large language model and a hybrid NLP model can perform high throughput phenotyping on physician notes with high accuracy.
  arXiv  Detail & Related papers  (2024-03-09T14:02:59Z)
• Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs [54.223394825528665]
  We develop an approach that uses lightweight adapter modules to inject structured biomedical knowledge into pre-trained language models. We use two large KGs, the biomedical knowledge system UMLS and the novel biochemical OntoChem, with two prominent biomedical PLMs, PubMedBERT and BioLinkBERT. We show that our methodology leads to performance improvements in several instances while keeping requirements in computing power low.
  arXiv  Detail & Related papers  (2023-12-21T14:26:57Z)
• Generative Input: Towards Next-Generation Input Methods Paradigm [49.98958865125018]
  We propose a novel Generative Input paradigm named GeneInput. It uses prompts to handle all input scenarios and other intelligent auxiliary input functions, optimizing the model with user feedback to deliver personalized results. The results demonstrate that we have achieved state-of-the-art performance for the first time in the Full-mode Key-sequence to Characters(FK2C) task.
  arXiv  Detail & Related papers  (2023-11-02T12:01:29Z)
• An evaluation of GPT models for phenotype concept recognition [0.4715973318447338]
  We examine the performance of the latest Generative Pre-trained Transformer (GPT) models for clinical phenotyping and phenotype annotation. Our results show that, with an appropriate setup, these models can achieve state of the art performance.
  arXiv  Detail & Related papers  (2023-09-29T12:06:55Z)
• PathLDM: Text conditioned Latent Diffusion Model for Histopathology [62.970593674481414]
  We introduce PathLDM, the first text-conditioned Latent Diffusion Model tailored for generating high-quality histopathology images. Our approach fuses image and textual data to enhance the generation process. We achieved a SoTA FID score of 7.64 for text-to-image generation on the TCGA-BRCA dataset, significantly outperforming the closest text-conditioned competitor with FID 30.1.
  arXiv  Detail & Related papers  (2023-09-01T22:08:32Z)
• Enhancing Phenotype Recognition in Clinical Notes Using Large Language Models: PhenoBCBERT and PhenoGPT [11.20254354103518]
  We developed two types of models: PhenoBCBERT, a BERT-based model, and PhenoGPT, a GPT-based model. We found that our methods can extract more phenotype concepts, including novel ones not characterized by HPO.
  arXiv  Detail & Related papers  (2023-08-11T03:40:22Z)
• Customizing General-Purpose Foundation Models for Medical Report Generation [64.31265734687182]
  The scarcity of labelled medical image-report pairs presents great challenges in the development of deep and large-scale neural networks. We propose customizing off-the-shelf general-purpose large-scale pre-trained models, i.e., foundation models (FMs) in computer vision and natural language processing.
  arXiv  Detail & Related papers  (2023-06-09T03:02:36Z)
• Leveraging Pretrained Representations with Task-related Keywords for Alzheimer's Disease Detection [69.53626024091076]
  Alzheimer's disease (AD) is particularly prominent in older adults. Recent advances in pre-trained models motivate AD detection modeling to shift from low-level features to high-level representations. This paper presents several efficient methods to extract better AD-related cues from high-level acoustic and linguistic features.
  arXiv  Detail & Related papers  (2023-03-14T16:03:28Z)
• Better Language Model with Hypernym Class Prediction [101.8517004687825]
  Class-based language models (LMs) have been long devised to address context sparsity in $n$-gram LMs. In this study, we revisit this approach in the context of neural LMs.
  arXiv  Detail & Related papers  (2022-03-21T01:16:44Z)
• Hybrid deep learning methods for phenotype prediction from clinical notes [4.866431869728018]
  This paper proposes a novel hybrid model for automatically extracting patient phenotypes using natural language processing and deep learning models. The proposed hybrid model is based on a neural bidirectional sequence model (BiLSTM or BiGRU) and a Convolutional Neural Network (CNN) for identifying patient's phenotypes in discharge reports.
  arXiv  Detail & Related papers  (2021-08-16T05:57:28Z)
• PhenoTagger: A Hybrid Method for Phenotype Concept Recognition using Human Phenotype Ontology [6.165755812152143]
  PhenoTagger is a hybrid method that combines both dictionary and machine learning-based methods to recognize concepts in unstructured text. Our method is validated with two HPO corpora, and the results show that PhenoTagger compares favorably to previous methods.
  arXiv  Detail & Related papers  (2020-09-17T18:00:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.