Spoken Dialogue System for Medical Prescription Acquisition on Smartphone: Development, Corpus and Evaluation

• URL: http://arxiv.org/abs/2311.03510v1
• Date: Mon, 6 Nov 2023 20:36:55 GMT
• Title: Spoken Dialogue System for Medical Prescription Acquisition on Smartphone: Development, Corpus and Evaluation
• Abstract summary: We present a natural language interface for e-prescribing software in the form of a spoken dialogue system accessible on a smartphone. The system extracts the formal representation of the prescription ready to be checked by the prescribing software.
• Score: 0.11184789007828977
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Hospital information systems (HIS) have become an essential part of healthcare institutions and now incorporate prescribing support software. Prescription support software allows for structured information capture, which improves the safety, appropriateness and efficiency of prescriptions and reduces the number of adverse drug events (ADEs). However, such a system increases the amount of time physicians spend at a computer entering information instead of providing medical care. In addition, any new visiting clinician must learn to manage complex interfaces since each HIS has its own interfaces. In this paper, we present a natural language interface for e-prescribing software in the form of a spoken dialogue system accessible on a smartphone. This system allows prescribers to record their prescriptions verbally, a form of interaction closer to their usual practice. The system extracts the formal representation of the prescription ready to be checked by the prescribing software and uses the dialogue to request mandatory information, correct errors or warn of particular situations. Since, to the best of our knowledge, there is no existing voice-based prescription dialogue system, we present the system developed in a low-resource environment, focusing on dialogue modeling, semantic extraction and data augmentation. The system was evaluated in the wild with 55 participants. This evaluation showed that our system has an average prescription time of 66.15 seconds for physicians and 35.64 seconds for other experts, and a task success rate of 76\% for physicians and 72\% for other experts. All evaluation data were recorded and annotated to form PxCorpus, the first spoken drug prescription corpus that has been made fully available to the community (\url{https://doi.org/10.5281/zenodo.6524162}).

Related papers

• ClinQueryAgent: A Conversational Agent for Population Health Management [7.734229817483146]
  ClinQueryAgent is a system for translating natural language population health questions into executable database queries.<n>We deploy the system via a chat window embedded within an existing population health management platform.<n>It has been used by 128 staff from 15 healthcare practices covering a total of 148,319 patients in the UK's National Health Service.
  arXiv  Detail & Related papers  (2026-04-13T10:07:03Z)
• Natural Language-Assisted Multi-modal Medication Recommendation [97.07805345563348]
  We introduce the Natural Language-Assisted Multi-modal Medication Recommendation(NLA-MMR) The NLA-MMR is a multi-modal alignment framework designed to learn knowledge from the patient view and medication view jointly. In this vein, we employ pretrained language models(PLMs) to extract in-domain knowledge regarding patients and medications.
  arXiv  Detail & Related papers  (2025-01-13T09:51:50Z)
• A GEN AI Framework for Medical Note Generation [3.7444770630637167]
  MediNotes is an advanced generative AI framework designed to automate the creation of SOAP (Subjective, Objective, Assessment, Plan) notes from medical conversations. MediNotes integrates Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Automatic Speech Recognition (ASR) to capture and process both text and voice inputs in real time or from recorded audio.
  arXiv  Detail & Related papers  (2024-09-27T23:05:02Z)
• Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges [30.204295770270416]
  This paper surveys and organizes research works on medical dialog systems. It investigates an initial pool of 325 papers from well-known computer science, and natural language processing conferences and journals. It lists the grand challenges of medical dialog systems, especially of large language models.
  arXiv  Detail & Related papers  (2024-05-17T08:46:15Z)
• A Spoken Drug Prescription Dataset in French for Spoken Language Understanding [0.31317409221921133]
  We present the first spoken medical drug prescriptions corpus, named PxSLU. It contains 4 hours of transcribed and annotated dialogues of drug prescriptions in French acquired through an experiment with 55 participants experts and non-experts in prescriptions.
  arXiv  Detail & Related papers  (2022-07-17T21:18:03Z)
• PoCaP Corpus: A Multimodal Dataset for Smart Operating Room Speech Assistant using Interventional Radiology Workflow Analysis [7.189635716814341]
  This paper presents a new multimodal interventional radiology dataset, called PoCaP (Port Catheter Placement) Corpus. This corpus consists of speech and audio signals in German, X-ray images, and system commands collected from 31 PoCaP interventions by six surgeons.
  arXiv  Detail & Related papers  (2022-06-24T14:39:11Z)
• User-Driven Research of Medical Note Generation Software [49.85146209418244]
  We present three rounds of user studies carried out in the context of developing a medical note generation system. We discuss the participating clinicians' impressions and views of how the system ought to be adapted to be of value to them. We describe a three-week test run of the system in a live telehealth clinical practice.
  arXiv  Detail & Related papers  (2022-05-05T10:18:06Z)
• A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasets [70.32630628211803]
  We propose two frameworks to support automatic medical consultation, namely doctor-patient dialogue understanding and task-oriented interaction. A new large medical dialogue dataset with multi-level fine-grained annotations is introduced. We report a set of benchmark results for each task, which shows the usability of the dataset and sets a baseline for future studies.
  arXiv  Detail & Related papers  (2022-04-19T16:43:21Z)
• Prompt-based Generative Approach towards Multi-Hierarchical Medical Dialogue State Tracking [5.586690662128686]
  The dialogue state tracking (DST) module in the medical dialogue system interprets utterances into a machine-readable structure for downstream tasks. We first define a multi-hierarchical state structure and then propose a Prompt-based Generative Approach. Our approach outperforms other DST methods and is rather effective in the scenario with little data.
  arXiv  Detail & Related papers  (2022-03-18T13:28:27Z)
• Towards more patient friendly clinical notes through language models and ontologies [57.51898902864543]
  We present a novel approach to automated medical text based on word simplification and language modelling. We use a new dataset pairs of publicly available medical sentences and a version of them simplified by clinicians. Our method based on a language model trained on medical forum data generates simpler sentences while preserving both grammar and the original meaning.
  arXiv  Detail & Related papers  (2021-12-23T16:11:19Z)
• CAiRE in DialDoc21: Data Augmentation for Information-Seeking Dialogue System [55.43871578056878]
  In DialDoc21 competition, our system achieved 74.95 F1 score and 60.74 Exact Match score in subtask 1, and 37.72 SacreBLEU score in subtask 2.
  arXiv  Detail & Related papers  (2021-06-07T11:40:55Z)
• MedDG: An Entity-Centric Medical Consultation Dataset for Entity-Aware Medical Dialogue Generation [86.38736781043109]
  We build and release a large-scale high-quality Medical Dialogue dataset related to 12 types of common Gastrointestinal diseases named MedDG. We propose two kinds of medical dialogue tasks based on MedDG dataset. One is the next entity prediction and the other is the doctor response generation. Experimental results show that the pre-train language models and other baselines struggle on both tasks with poor performance in our dataset.
  arXiv  Detail & Related papers  (2020-10-15T03:34:33Z)
• Transforming unstructured voice and text data into insight for paramedic emergency service using recurrent and convolutional neural networks [68.8204255655161]
  Paramedics often have to make lifesaving decisions within a limited time in an ambulance. This study aims to automatically fuse voice and text data to provide tailored situational awareness information to paramedics.
  arXiv  Detail & Related papers  (2020-05-30T06:47:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.