Prompt-based Generative Approach towards Multi-Hierarchical Medical Dialogue State Tracking

• URL: http://arxiv.org/abs/2203.09946v1
• Date: Fri, 18 Mar 2022 13:28:27 GMT
• Title: Prompt-based Generative Approach towards Multi-Hierarchical Medical Dialogue State Tracking
• Authors: Jun Liu, Tong Ruan, Haofen Wang, Huanhuan Zhang
• Abstract summary: The dialogue state tracking (DST) module in the medical dialogue system interprets utterances into a machine-readable structure for downstream tasks. We first define a multi-hierarchical state structure and then propose a Prompt-based Generative Approach. Our approach outperforms other DST methods and is rather effective in the scenario with little data.
• Score: 5.586690662128686
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The medical dialogue system is a promising application that can provide great convenience for patients. The dialogue state tracking (DST) module in the medical dialogue system which interprets utterances into the machine-readable structure for downstream tasks is particularly challenging. Firstly, the states need to be able to represent compound entities such as symptoms with their body part or diseases with degrees of severity to provide enough information for decision support. Secondly, these named entities in the utterance might be discontinuous and scattered across sentences and speakers. These also make it difficult to annotate a large corpus which is essential for most methods. Therefore, we first define a multi-hierarchical state structure. We annotate and publish a medical dialogue dataset in Chinese. To the best of our knowledge, there are no publicly available ones before. Then we propose a Prompt-based Generative Approach which can generate slot values with multi-hierarchies incrementally using a top-down approach. A dialogue style prompt is also supplemented to utilize the large unlabeled dialogue corpus to alleviate the data scarcity problem. The experiments show that our approach outperforms other DST methods and is rather effective in the scenario with little data.

Related papers

• PneumoLLM: Harnessing the Power of Large Language Model for Pneumoconiosis Diagnosis [16.90918546157292]
  Large language models (LLMs) have exhibits unprecedented ability when conducting multiple tasks in dialogue. We propose a more effective method for harnessing LLMs in diagnosis with fewer learnable parameters. We introduce the contextual multi-token engine and the information emitter module.
  arXiv  Detail & Related papers  (2023-12-06T13:31:52Z)
• Medical Dialogue Generation via Dual Flow Modeling [9.328694317877169]
  Medical dialogue systems (MDS) aim to provide patients with medical services, such as diagnosis and prescription. Previous studies mainly addressed this by extracting the mentioned medical entities as critical dialogue history information. In this work, we argue that it is also essential to capture the transitions of the medical entities and the doctor's dialogue acts in each turn.
  arXiv  Detail & Related papers  (2023-05-29T14:23:34Z)
• Pre-training Multi-party Dialogue Models with Latent Discourse Inference [85.9683181507206]
  We pre-train a model that understands the discourse structure of multi-party dialogues, namely, to whom each utterance is replying. To fully utilize the unlabeled data, we propose to treat the discourse structures as latent variables, then jointly infer them and pre-train the discourse-aware model.
  arXiv  Detail & Related papers  (2023-05-24T14:06:27Z)
• CDialog: A Multi-turn Covid-19 Conversation Dataset for Entity-Aware Dialog Generation [18.047064216849204]
  We release a high-quality multi-turn Medical Dialog dataset relating to Covid-19 disease named CDialog. We propose a novel neural medical dialog system based on the CDialog dataset to advance future research on developing automated medical dialog systems.
  arXiv  Detail & Related papers  (2022-11-16T11:07:34Z)
• Medical Dialogue Response Generation with Pivotal Information Recalling [27.351688914399013]
  We propose a medical response generation model with Pivotal Information Recalling (MedPIR) MedPIR is built on two components, i.e., knowledge-aware dialogue graph encoder and recall-enhanced generator. Experimental results on two large-scale medical dialogue datasets show that MedPIR outperforms the strong baselines in BLEU scores and medical entities F1 measure.
  arXiv  Detail & Related papers  (2022-06-17T08:11:10Z)
• HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data [87.67278915655712]
  We present a new dialogue dataset, HybriDialogue, which consists of crowdsourced natural conversations grounded on both Wikipedia text and tables. The conversations are created through the decomposition of complex multihop questions into simple, realistic multiturn dialogue interactions.
  arXiv  Detail & Related papers  (2022-04-28T00:52:16Z)
• Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation [70.81596088969378]
  Cross-lingual Outline-based Dialogue dataset (termed COD) enables natural language understanding. COD enables dialogue state tracking, and end-to-end dialogue modelling and evaluation in 4 diverse languages.
  arXiv  Detail & Related papers  (2022-01-31T18:11:21Z)
• Towards more patient friendly clinical notes through language models and ontologies [57.51898902864543]
  We present a novel approach to automated medical text based on word simplification and language modelling. We use a new dataset pairs of publicly available medical sentences and a version of them simplified by clinicians. Our method based on a language model trained on medical forum data generates simpler sentences while preserving both grammar and the original meaning.
  arXiv  Detail & Related papers  (2021-12-23T16:11:19Z)
• MEDCOD: A Medically-Accurate, Emotive, Diverse, and Controllable Dialog System [6.902975908146047]
  We present MEDCOD, a Medically-Accurate, Emotive, Diverse, and Controllable Dialog system. It integrates medical domain knowledge with modern deep learning techniques to generate flexible, human-like natural language expressions.
  arXiv  Detail & Related papers  (2021-11-17T20:31:16Z)
• MedDG: An Entity-Centric Medical Consultation Dataset for Entity-Aware Medical Dialogue Generation [86.38736781043109]
  We build and release a large-scale high-quality Medical Dialogue dataset related to 12 types of common Gastrointestinal diseases named MedDG. We propose two kinds of medical dialogue tasks based on MedDG dataset. One is the next entity prediction and the other is the doctor response generation. Experimental results show that the pre-train language models and other baselines struggle on both tasks with poor performance in our dataset.
  arXiv  Detail & Related papers  (2020-10-15T03:34:33Z)
• Rethinking Dialogue State Tracking with Reasoning [76.0991910623001]
  This paper proposes to track dialogue states gradually with reasoning over dialogue turns with the help of the back-end data. Empirical results demonstrate that our method significantly outperforms the state-of-the-art methods by 38.6% in terms of joint belief accuracy for MultiWOZ 2.1.
  arXiv  Detail & Related papers  (2020-05-27T02:05:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.