ChatGPT versus Traditional Question Answering for Knowledge Graphs: Current Status and Future Directions Towards Knowledge Graph Chatbots

• URL: http://arxiv.org/abs/2302.06466v1
• Date: Wed, 8 Feb 2023 13:03:27 GMT
• Title: ChatGPT versus Traditional Question Answering for Knowledge Graphs: Current Status and Future Directions Towards Knowledge Graph Chatbots
• Authors: Reham Omar, Omij Mangukiya, Panos Kalnis and Essam Mansour
• Abstract summary: Conversational AI and Question-Answering systems (QASs) for knowledge graphs (KGs) are both emerging research areas. QASs retrieve the most recent information from a KG by understanding and translating the natural language question into a formal query supported by the database engine. Our framework compares two representative conversational models, ChatGPT and Galactica, against KGQAN, the current state-of-the-art QAS.
• Score: 7.2676028986202
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Conversational AI and Question-Answering systems (QASs) for knowledge graphs (KGs) are both emerging research areas: they empower users with natural language interfaces for extracting information easily and effectively. Conversational AI simulates conversations with humans; however, it is limited by the data captured in the training datasets. In contrast, QASs retrieve the most recent information from a KG by understanding and translating the natural language question into a formal query supported by the database engine. In this paper, we present a comprehensive study of the characteristics of the existing alternatives towards combining both worlds into novel KG chatbots. Our framework compares two representative conversational models, ChatGPT and Galactica, against KGQAN, the current state-of-the-art QAS. We conduct a thorough evaluation using four real KGs across various application domains to identify the current limitations of each category of systems. Based on our findings, we propose open research opportunities to empower QASs with chatbot capabilities for KGs. All benchmarks and all raw results are available1 for further analysis.

Related papers

• ConvKGYarn: Spinning Configurable and Scalable Conversational Knowledge Graph QA datasets with Large Language Models [47.27645876623092]
  We present ConvKGYarn, a scalable method for generating up-to-date and conversational KGQA datasets. We showcase its utility by testing LLMs on diverse conversations - exploring model behavior on conversational KGQA sets with different configurations grounded in the same KG fact set.
  arXiv  Detail & Related papers  (2024-08-12T06:48:43Z)
• Deep Bidirectional Language-Knowledge Graph Pretraining [159.9645181522436]
  DRAGON is a self-supervised approach to pretraining a deeply joint language-knowledge foundation model from text and KG at scale. Our model takes pairs of text segments and relevant KG subgraphs as input and bidirectionally fuses information from both modalities.
  arXiv  Detail & Related papers  (2022-10-17T18:02:52Z)
• Contrastive Representation Learning for Conversational Question Answering over Knowledge Graphs [9.979689965471428]
  This paper addresses the task of conversational question answering (ConvQA) over knowledge graphs (KGs) The majority of existing ConvQA methods rely on full supervision signals with a strict assumption of the availability of gold logical forms of queries to extract answers from the KG. We propose a contrastive representation learning-based approach to rank KG paths effectively.
  arXiv  Detail & Related papers  (2022-10-09T23:11:58Z)
• BERT-CoQAC: BERT-based Conversational Question Answering in Context [10.811729691130349]
  We introduce a framework based on a publically available pre-trained language model called BERT for incorporating history turns into the system. Experiment results revealed that our framework is comparable in performance with the state-of-the-art models on the QuAC leader board.
  arXiv  Detail & Related papers  (2021-04-23T03:05:17Z)
• Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Tasks [81.03233931066009]
  It is critical to select a knowledge graph (KG) that is well-aligned with the given task's objective. We show an approach to assess how well a candidate KG can correctly identify and accurately fill in gaps of reasoning for a task. We show this KG-to-task match in 3 phases: knowledge-task identification, knowledge-task alignment, and knowledge-task integration.
  arXiv  Detail & Related papers  (2021-04-20T18:23:45Z)
• QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering [122.84513233992422]
  We propose a new model, QA-GNN, which addresses the problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) We show its improvement over existing LM and LM+KG models, as well as its capability to perform interpretable and structured reasoning.
  arXiv  Detail & Related papers  (2021-04-13T17:32:51Z)
• Towards Data Distillation for End-to-end Spoken Conversational Question Answering [65.124088336738]
  We propose a new Spoken Conversational Question Answering task (SCQA) SCQA aims at enabling QA systems to model complex dialogues flow given the speech utterances and text corpora. Our main objective is to build a QA system to deal with conversational questions both in spoken and text forms.
  arXiv  Detail & Related papers  (2020-10-18T05:53:39Z)
• A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challenges [71.4531144086568]
  Question Answering (QA) over Knowledge Base (KB) aims to automatically answer natural language questions. Researchers have shifted their attention from simple questions to complex questions, which require more KB triples and constraint inference.
  arXiv  Detail & Related papers  (2020-07-26T07:13:32Z)
• Knowledge Graphs and Knowledge Networks: The Story in Brief [0.1933681537640272]
  Knowledge Graphs (KGs) represent real-world noisy raw information in a structured form, capturing relationships between entities. For dynamic real-world applications such as social networks, recommender systems, computational biology, relational knowledge representation has emerged as a challenging research problem. This article attempts to summarize the journey of KG for AI.
  arXiv  Detail & Related papers  (2020-03-07T18:09:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.