Faithful Embeddings for Knowledge Base Queries
- URL: http://arxiv.org/abs/2004.03658v3
- Date: Fri, 29 Jan 2021 03:46:25 GMT
- Title: Faithful Embeddings for Knowledge Base Queries
- Authors: Haitian Sun, Andrew O. Arnold, Tania Bedrax-Weiss, Fernando Pereira,
William W. Cohen
- Abstract summary: deductive closure of an ideal knowledge base (KB) contains exactly the logical queries that the KB can answer.
In practice KBs are both incomplete and over-specified, failing to answer some queries that have real-world answers.
We show that inserting this new QE module into a neural question-answering system leads to substantial improvements over the state-of-the-art.
- Score: 97.5904298152163
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The deductive closure of an ideal knowledge base (KB) contains exactly the
logical queries that the KB can answer. However, in practice KBs are both
incomplete and over-specified, failing to answer some queries that have
real-world answers. \emph{Query embedding} (QE) techniques have been recently
proposed where KB entities and KB queries are represented jointly in an
embedding space, supporting relaxation and generalization in KB inference.
However, experiments in this paper show that QE systems may disagree with
deductive reasoning on answers that do not require generalization or
relaxation. We address this problem with a novel QE method that is more
faithful to deductive reasoning, and show that this leads to better performance
on complex queries to incomplete KBs. Finally we show that inserting this new
QE module into a neural question-answering system leads to substantial
improvements over the state-of-the-art.
Related papers
- FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base
Question Answering [24.394908238940904]
We propose a Fine-to-Coarse Composition framework for KBQA (FC-KBQA) to ensure the generalization ability and executability of the logical expression.
FC-KBQA derives new state-of-the-art performance on GrailQA and WebQSP, and runs 4 times faster than the baseline.
arXiv Detail & Related papers (2023-06-26T14:19:46Z) - Do I have the Knowledge to Answer? Investigating Answerability of
Knowledge Base Questions [25.13991044303459]
We create GrailQAbility, a new benchmark KBQA dataset with unanswerability.
Experimenting with three state-of-the-art KBQA models, we find that all three models suffer a drop in performance.
This underscores the need for further research in making KBQA systems robust to unanswerability.
arXiv Detail & Related papers (2022-12-20T12:00:26Z) - DecAF: Joint Decoding of Answers and Logical Forms for Question
Answering over Knowledge Bases [81.19499764899359]
We propose a novel framework DecAF that jointly generates both logical forms and direct answers.
DecAF achieves new state-of-the-art accuracy on WebQSP, FreebaseQA, and GrailQA benchmarks.
arXiv Detail & Related papers (2022-09-30T19:51:52Z) - QA Is the New KR: Question-Answer Pairs as Knowledge Bases [105.692569000534]
We argue that the proposed type of KB has many of the key advantages of a traditional symbolic KB.
Unlike a traditional KB, this information store is well-aligned with common user information needs.
arXiv Detail & Related papers (2022-07-01T19:09:08Z) - CBR-iKB: A Case-Based Reasoning Approach for Question Answering over
Incomplete Knowledge Bases [39.45030211564547]
We propose a case-based reasoning approach, CBR-iKB, for knowledge base question answering (KBQA) with incomplete-KB as our main focus.
By design, CBR-iKB can seamlessly adapt to changes in KBs without any task-specific training or fine-tuning.
Our method achieves 100% accuracy on MetaQA and establishes new state-of-the-art on multiple benchmarks.
arXiv Detail & Related papers (2022-04-18T20:46:41Z) - Case-based Reasoning for Natural Language Queries over Knowledge Bases [41.54465521439727]
We propose a neuro-symbolic CBR approach for question answering over large knowledge bases.
CBR-KBQA consists of two modules: a non-parametric memory that stores cases and a parametric model.
We show that CBR-KBQA can effectively derive novel combination of relations not presented in case memory.
arXiv Detail & Related papers (2021-04-18T07:50:31Z) - Reasoning Over Virtual Knowledge Bases With Open Predicate Relations [85.19305347984515]
We present the Open Predicate Query Language (OPQL)
OPQL is a method for constructing a virtual Knowledge Base (VKB) trained entirely from text.
We demonstrate that OPQL outperforms prior VKB methods on two different KB reasoning tasks.
arXiv Detail & Related papers (2021-02-14T01:29:54Z) - Question Answering over Knowledge Bases by Leveraging Semantic Parsing
and Neuro-Symbolic Reasoning [73.00049753292316]
We propose a semantic parsing and reasoning-based Neuro-Symbolic Question Answering(NSQA) system.
NSQA achieves state-of-the-art performance on QALD-9 and LC-QuAD 1.0.
arXiv Detail & Related papers (2020-12-03T05:17:55Z) - A Survey on Complex Question Answering over Knowledge Base: Recent
Advances and Challenges [71.4531144086568]
Question Answering (QA) over Knowledge Base (KB) aims to automatically answer natural language questions.
Researchers have shifted their attention from simple questions to complex questions, which require more KB triples and constraint inference.
arXiv Detail & Related papers (2020-07-26T07:13:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.