Generative Subgraph Retrieval for Knowledge Graph-Grounded Dialog Generation

• URL: http://arxiv.org/abs/2410.09350v1
• Date: Sat, 12 Oct 2024 03:33:42 GMT
• Title: Generative Subgraph Retrieval for Knowledge Graph-Grounded Dialog Generation
• Authors: Jinyoung Park, Minseok Joo, Joo-Kyung Kim, Hyunwoo J. Kim,
• Abstract summary: We propose Dialog generation with Generative Subgraph Retrieval (DialogGSR) DialogGSR retrieves relevant knowledge subgraphs by directly generating their token sequences on top of language models. It achieves state-of-the-art performance in knowledge graph-grounded dialog generation, as demonstrated on OpenDialKG and KOMODIS datasets.
• Score: 17.437568540883106
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Knowledge graph-grounded dialog generation requires retrieving a dialog-relevant subgraph from the given knowledge base graph and integrating it with the dialog history. Previous works typically represent the graph using an external encoder, such as graph neural networks, and retrieve relevant triplets based on the similarity between single-vector representations of triplets and the dialog history. However, these external encoders fail to leverage the rich knowledge of pretrained language models, and the retrieval process is also suboptimal due to the information bottleneck caused by the single-vector abstraction of the dialog history. In this work, we propose Dialog generation with Generative Subgraph Retrieval (DialogGSR), which retrieves relevant knowledge subgraphs by directly generating their token sequences on top of language models. For effective generative subgraph retrieval, we introduce two key methods: (i) structure-aware knowledge graph linearization with self-supervised graph-specific tokens and (ii) graph-constrained decoding utilizing graph structural proximity-based entity informativeness scores for valid and relevant generative retrieval. DialogGSR achieves state-of-the-art performance in knowledge graph-grounded dialog generation, as demonstrated on OpenDialKG and KOMODIS datasets.

Related papers

• Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation [23.54754465832362]
  In conventional graph neural networks (GNNs) message passing on a graph is independent from text. This training regime leads to a semantic gap between graph knowledge and text. We propose a novel framework for knowledge graph enhanced dialogue generation.
  arXiv  Detail & Related papers  (2023-06-28T13:21:00Z)
• Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generation [58.65698688443091]
  We propose SUbgraph Retrieval-augmented GEneration (SURGE), a framework for generating context-relevant and knowledge-grounded dialogues with Knowledge Graphs (KGs) Our framework first retrieves the relevant subgraph from the KG, and then enforces consistency across facts by perturbing their word embeddings conditioned by the retrieved subgraph. We validate our SURGE framework on OpendialKG and KOMODIS datasets, showing that it generates high-quality dialogues that faithfully reflect the knowledge from KG.
  arXiv  Detail & Related papers  (2023-05-30T08:36:45Z)
• Conversational Semantic Parsing using Dynamic Context Graphs [68.72121830563906]
  We consider the task of conversational semantic parsing over general purpose knowledge graphs (KGs) with millions of entities, and thousands of relation-types. We focus on models which are capable of interactively mapping user utterances into executable logical forms.
  arXiv  Detail & Related papers  (2023-05-04T16:04:41Z)
• Multi-grained Hypergraph Interest Modeling for Conversational Recommendation [75.65483522949857]
  We propose a novel multi-grained hypergraph interest modeling approach to capture user interest beneath intricate historical data. In our approach, we first employ the hypergraph structure to model users' historical dialogue sessions and form a session-based hypergraph, which captures coarse-grained, session-level relations. We further conduct multi-grained hypergraph convolution on the two kinds of hypergraphs, and utilize the enhanced representations to develop interest-aware CRS.
  arXiv  Detail & Related papers  (2023-05-04T13:13:44Z)
• Discovering Dialog Structure Graph for Open-Domain Dialog Generation [51.29286279366361]
  We conduct unsupervised discovery of dialog structure from chitchat corpora. We then leverage it to facilitate dialog generation in downstream systems. We present a Discrete Variational Auto-Encoder with Graph Neural Network (DVAE-GNN), to discover a unified human-readable dialog structure.
  arXiv  Detail & Related papers  (2020-12-31T10:58:37Z)
• GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems [9.560436630775762]
  End-to-end task-oriented dialogue systems aim to generate system responses directly from plain text inputs. One is how to effectively incorporate external knowledge bases (KBs) into the learning framework; the other is how to accurately capture the semantics of dialogue history. We address these two challenges by exploiting the graph structural information in the knowledge base and in the dependency parsing tree of the dialogue.
  arXiv  Detail & Related papers  (2020-10-04T00:04:40Z)
• Dialogue Relation Extraction with Document-level Heterogeneous Graph Attention Networks [21.409522845011907]
  Dialogue relation extraction (DRE) aims to detect the relation between two entities mentioned in a multi-party dialogue. We present a graph attention network-based method for DRE where a graph contains meaningfully connected speaker, entity, entity-type, and utterance nodes. We empirically show that this graph-based approach quite effectively captures the relations between different entity pairs in a dialogue as it outperforms the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-09-10T18:51:48Z)
• Interactive Text Graph Mining with a Prolog-based Dialog Engine [8.663755202726795]
  We design a Prolog-based dialog engine that explores interactively a ranked fact database extracted from a text document. We take advantage of the implicit semantic information that dependency links and WordNet bring in the form of subject-verb-object, is-a and part-of relations.
  arXiv  Detail & Related papers  (2020-07-31T03:29:49Z)
• ORD: Object Relationship Discovery for Visual Dialogue Generation [60.471670447176656]
  We propose an object relationship discovery (ORD) framework to preserve the object interactions for visual dialogue generation. A hierarchical graph convolutional network (HierGCN) is proposed to retain the object nodes and neighbour relationships locally, and then refines the object-object connections globally. Experiments have proved that the proposed method can significantly improve the quality of dialogue by utilising the contextual information of visual relationships.
  arXiv  Detail & Related papers  (2020-06-15T12:25:40Z)
• Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning [73.0598186896953]
  We present two self-supervised tasks learning over raw text with the guidance from knowledge graphs. Building upon entity-level masked language models, our first contribution is an entity masking scheme. In contrast to existing paradigms, our approach uses knowledge graphs implicitly, only during pre-training.
  arXiv  Detail & Related papers  (2020-04-29T14:22:42Z)
• Knowledge-graph based Proactive Dialogue Generation with Improved Meta-Learning [0.0]
  We propose a knowledge graph based proactive dialogue generation model (KgDg) with three components. For knowledge triplets embedding and selection, we formulate it as a problem of sentence embedding to better capture semantic information. Our improved MAML algorithm is capable of learning general features from a limited number of knowledge graphs.
  arXiv  Detail & Related papers  (2020-04-19T08:41:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.