Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges

• URL: http://arxiv.org/abs/2405.10630v1
• Date: Fri, 17 May 2024 08:46:15 GMT
• Title: Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges
• Abstract summary: This paper surveys and organizes research works on medical dialog systems. It investigates an initial pool of 325 papers from well-known computer science, and natural language processing conferences and journals. It lists the grand challenges of medical dialog systems, especially of large language models.
• Score: 30.204295770270416
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper surveys and organizes research works on medical dialog systems, which is an important yet challenging task. Although these systems have been surveyed in the medical community from an application perspective, a systematic review from a rigorous technical perspective has to date remained noticeably absent. As a result, an overview of the categories, methods, and evaluation of medical dialogue systems remain limited and underspecified, hindering the further improvement of this area. To fill this gap, we investigate an initial pool of 325 papers from well-known computer science, and natural language processing conferences and journals, and make an overview. Recently, large language models have shown strong model capacity on downstream tasks, which also reshaped medical dialog systems' foundation. Despite the alluring practical application value, current medical dialogue systems still suffer from problems. To this end, this paper lists the grand challenges of medical dialog systems, especially of large language models.

Related papers

• MedDialogRubrics: A Comprehensive Benchmark and Evaluation Framework for Multi-turn Medical Consultations in Large Language Models [15.91764739198419]
  We present MedDialogRubrics, a novel benchmark comprising 5,200 synthetically constructed patient cases and over 60,000 fine-grained evaluation rubrics.<n>Our framework employs a multi-agent system to synthesize realistic patient records and chief complaints without accessing real-world electronic health records.
  arXiv  Detail & Related papers  (2026-01-06T13:56:33Z)
• Dialogue is Better Than Monologue: Instructing Medical LLMs via Strategical Conversations [74.83732294523402]
  We introduce a novel benchmark that simulates real-world diagnostic scenarios, integrating noise and difficulty levels aligned with USMLE standards. We also explore dialogue-based fine-tuning, which transforms static datasets into conversational formats to better capture iterative reasoning processes. Experiments show that dialogue-tuned models outperform traditional methods, with improvements of $9.64%$ in multi-round reasoning scenarios and $6.18%$ in accuracy in a noisy environment.
  arXiv  Detail & Related papers  (2025-01-29T18:58:48Z)
• Comprehensive and Practical Evaluation of Retrieval-Augmented Generation Systems for Medical Question Answering [70.44269982045415]
  Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) We introduce Medical Retrieval-Augmented Generation Benchmark (MedRGB) that provides various supplementary elements to four medical QA datasets. Our experimental results reveals current models' limited ability to handle noise and misinformation in the retrieved documents.
  arXiv  Detail & Related papers  (2024-11-14T06:19:18Z)
• Building a Chinese Medical Dialogue System: Integrating Large-scale Corpora and Novel Models [2.04367431902848]
  The COVID-19 pandemic underscored major deficiencies in traditional healthcare systems, hastening the advancement of online medical services.<n>Existing studies face two main challenges.<n>First, the scarcity of large-scale, publicly available, domain-specific medical datasets due to privacy concerns.<n>Second, existing methods lack medical knowledge and struggle to accurately understand professional terms and expressions in patient-doctor consultations.
  arXiv  Detail & Related papers  (2024-09-27T00:01:32Z)
• Clinical Insights: A Comprehensive Review of Language Models in Medicine [1.5020330976600738]
  This paper explores the advancements and applications of language models in healthcare, focusing on their clinical use cases. It examines the evolution from early encoder-based systems requiring extensive fine-tuning to state-of-the-art large language and multimodal models capable of integrating text and visual data through in-context learning. The analysis emphasizes locally deployable models, which enhance data privacy and operational autonomy, and their applications in tasks such as text generation, classification, information extraction, and conversational systems.
  arXiv  Detail & Related papers  (2024-08-21T15:59:33Z)
• MedRG: Medical Report Grounding with Multi-modal Large Language Model [42.04042642085121]
  Medical Report Grounding (MedRG) is an end-to-end solution for utilizing a multi-modal Large Language Model to predict key phrase. The experimental results validate the effectiveness of MedRG, surpassing the performance of the existing state-of-the-art medical phrase grounding methods.
  arXiv  Detail & Related papers  (2024-04-10T07:41:35Z)
• MidMed: Towards Mixed-Type Dialogues for Medical Consultation [12.676937863407542]
  Most medical dialogue systems assume that patients have clear goals (medicine querying, surgical operation querying, etc.) before medical consultation. Due to the lack of medical knowledge, it is usually difficult for patients to determine clear goals with all necessary slots. We propose a novel task and create a human-to-human mixed-type medical consultation dialogue corpus, termed MidMed.
  arXiv  Detail & Related papers  (2023-06-05T14:36:31Z)
• PMC-LLaMA: Towards Building Open-source Language Models for Medicine [62.39105735933138]
  Large Language Models (LLMs) have showcased remarkable capabilities in natural language understanding. LLMs struggle in domains that require precision, such as medical applications, due to their lack of domain-specific knowledge. We describe the procedure for building a powerful, open-source language model specifically designed for medicine applications, termed as PMC-LLaMA.
  arXiv  Detail & Related papers  (2023-04-27T18:29:05Z)
• A Survey on Conversational Search and Applications in Biomedicine [0.25782420501870296]
  We predominantly focused on the human interactive characteristics of the ConvSearch systems. We labeled various ConvSearch research problems in knowledge bases, natural language processing, and dialogue management systems. The application is directed toward biomedical and healthcare fields for the utilization of clinical social technology.
  arXiv  Detail & Related papers  (2022-11-28T14:08:53Z)
• User-Driven Research of Medical Note Generation Software [49.85146209418244]
  We present three rounds of user studies carried out in the context of developing a medical note generation system. We discuss the participating clinicians' impressions and views of how the system ought to be adapted to be of value to them. We describe a three-week test run of the system in a live telehealth clinical practice.
  arXiv  Detail & Related papers  (2022-05-05T10:18:06Z)
• A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasets [70.32630628211803]
  We propose two frameworks to support automatic medical consultation, namely doctor-patient dialogue understanding and task-oriented interaction. A new large medical dialogue dataset with multi-level fine-grained annotations is introduced. We report a set of benchmark results for each task, which shows the usability of the dataset and sets a baseline for future studies.
  arXiv  Detail & Related papers  (2022-04-19T16:43:21Z)
• Automatic Evaluation and Moderation of Open-domain Dialogue Systems [59.305712262126264]
  A long standing challenge that bothers the researchers is the lack of effective automatic evaluation metrics. This paper describes the data, baselines and results obtained for the Track 5 at the Dialogue System Technology Challenge 10 (DSTC10)
  arXiv  Detail & Related papers  (2021-11-03T10:08:05Z)
• MedDG: An Entity-Centric Medical Consultation Dataset for Entity-Aware Medical Dialogue Generation [86.38736781043109]
  We build and release a large-scale high-quality Medical Dialogue dataset related to 12 types of common Gastrointestinal diseases named MedDG. We propose two kinds of medical dialogue tasks based on MedDG dataset. One is the next entity prediction and the other is the doctor response generation. Experimental results show that the pre-train language models and other baselines struggle on both tasks with poor performance in our dataset.
  arXiv  Detail & Related papers  (2020-10-15T03:34:33Z)
• Medical Image Registration Using Deep Neural Networks: A Comprehensive Review [1.2425910171551517]
  State-of-the-art literature on medical image registration using deep neural networks is presented. The review is systematic and encompasses all the related works previously published in the field. This review allows a deep understanding and insight for the readers active in the field who are investigating the state-of-the-art and seeking to contribute the future literature.
  arXiv  Detail & Related papers  (2020-02-09T17:22:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.