Enhancing Knowledge Retrieval with Topic Modeling for Knowledge-Grounded Dialogue

• URL: http://arxiv.org/abs/2405.04713v1
• Date: Tue, 07 May 2024 23:32:32 GMT
• Title: Enhancing Knowledge Retrieval with Topic Modeling for Knowledge-Grounded Dialogue
• Authors: Nhat Tran, Diane Litman,
• Abstract summary: We propose an approach that utilizes topic modeling on the knowledge base to further improve retrieval accuracy. We also experiment with a large language model, ChatGPT, to take advantage of the improved retrieval performance.
• Score: 0.6650227510403052
• License:
• Abstract: Knowledge retrieval is one of the major challenges in building a knowledge-grounded dialogue system. A common method is to use a neural retriever with a distributed approximate nearest-neighbor database to quickly find the relevant knowledge sentences. In this work, we propose an approach that utilizes topic modeling on the knowledge base to further improve retrieval accuracy and as a result, improve response generation. Additionally, we experiment with a large language model, ChatGPT, to take advantage of the improved retrieval performance to further improve the generation results. Experimental results on two datasets show that our approach can increase retrieval and generation performance. The results also indicate that ChatGPT is a better response generator for knowledge-grounded dialogue when relevant knowledge is provided.

Related papers

• Mitigating the Negative Impact of Over-association for Conversational Query Production [44.661864532728615]
  Conversational query generation aims at producing search queries from dialogue histories, which are then used to retrieve relevant knowledge from a search engine. Previous models suffer from the data hunger issue, and they tend to both drop important concepts from dialogue histories and generate irrelevant concepts at inference time. We propose effective instance-level weighting strategies for training to mitigate these issues from multiple perspectives.
  arXiv  Detail & Related papers  (2024-09-29T06:19:59Z)
• Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System [40.33178881317882]
  We propose the application of maximal marginal likelihood to train a perceptive retriever by utilizing signals from response generation for supervision. We evaluate our approach on three task-oriented dialogue datasets using T5 and ChatGPT as the backbone models.
  arXiv  Detail & Related papers  (2023-10-13T06:03:47Z)
• PICK: Polished & Informed Candidate Scoring for Knowledge-Grounded Dialogue Systems [59.1250765143521]
  Current knowledge-grounded dialogue systems often fail to align the generated responses with human-preferred qualities. We propose Polished & Informed Candidate Scoring (PICK), a generation re-scoring framework. We demonstrate the effectiveness of PICK in generating responses that are more faithful while keeping them relevant to the dialogue history.
  arXiv  Detail & Related papers  (2023-09-19T08:27:09Z)
• Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy [164.83371924650294]
  We show that strong performance can be achieved by a method we call Iter-RetGen, which synergizes retrieval and generation in an iterative manner. A model output shows what might be needed to finish a task, and thus provides an informative context for retrieving more relevant knowledge. Iter-RetGen processes all retrieved knowledge as a whole and largely preserves the flexibility in generation without structural constraints.
  arXiv  Detail & Related papers  (2023-05-24T16:17:36Z)
• Task Oriented Conversational Modelling With Subjective Knowledge [0.0]
  DSTC-11 proposes a three stage pipeline consisting of knowledge seeking turn detection, knowledge selection and response generation. We propose entity retrieval methods which result in an accurate and faster knowledge search. Preliminary results show a 4 % improvement in exact match score on knowledge selection task.
  arXiv  Detail & Related papers  (2023-03-30T20:23:49Z)
• Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production [98.98161995555485]
  We propose a dialogue model that can access the vast and dynamic information from any search engine for response generation. As the core module, a query producer is used to generate queries from a dialogue context to interact with a search engine. Experiments show that our query producer can achieve R@1 and R@5 rates of 62.4% and 74.8% for retrieving gold knowledge.
  arXiv  Detail & Related papers  (2023-02-16T01:58:10Z)
• RHO ($\rho$): Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding [57.46495388734495]
  This paper presents RHO ($rho$) utilizing the representations of linked entities and relation predicates from a knowledge graph (KG) We propose (1) local knowledge grounding to combine textual embeddings with the corresponding KG embeddings; and (2) global knowledge grounding to equip RHO with multi-hop reasoning abilities via the attention mechanism.
  arXiv  Detail & Related papers  (2022-12-03T10:36:34Z)
• Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters [52.725200145600624]
  We propose KnowExpert to bypass the retrieval process by injecting prior knowledge into the pre-trained language models with lightweight adapters. Experimental results show that KnowExpert performs comparably with the retrieval-based baselines.
  arXiv  Detail & Related papers  (2021-05-13T12:33:23Z)
• Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue [51.513276162736844]
  We propose a sequential latent variable model as the first approach to this matter. The model named sequential knowledge transformer (SKT) can keep track of the prior and posterior distribution over knowledge.
  arXiv  Detail & Related papers  (2020-02-18T11:59:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.