Complex Query Answering on Eventuality Knowledge Graph with Implicit
Logical Constraints
- URL: http://arxiv.org/abs/2305.19068v2
- Date: Fri, 27 Oct 2023 12:16:14 GMT
- Title: Complex Query Answering on Eventuality Knowledge Graph with Implicit
Logical Constraints
- Authors: Jiaxin Bai, Xin Liu, Weiqi Wang, Chen Luo, Yangqiu Song
- Abstract summary: We propose a new framework to leverage neural methods to answer complex logical queries based on an EVentuality-centric KG.
Complex Eventuality Query Answering (CEQA) considers the implicit logical constraints governing the temporal order and occurrence of eventualities.
We also propose a Memory-Enhanced Query (MEQE) to significantly improve the performance of state-of-the-art neural query encoders on the CEQA task.
- Score: 48.831178420807646
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Querying knowledge graphs (KGs) using deep learning approaches can naturally
leverage the reasoning and generalization ability to learn to infer better
answers. Traditional neural complex query answering (CQA) approaches mostly
work on entity-centric KGs. However, in the real world, we also need to make
logical inferences about events, states, and activities (i.e., eventualities or
situations) to push learning systems from System I to System II, as proposed by
Yoshua Bengio. Querying logically from an EVentuality-centric KG (EVKG) can
naturally provide references to such kind of intuitive and logical inference.
Thus, in this paper, we propose a new framework to leverage neural methods to
answer complex logical queries based on an EVKG, which can satisfy not only
traditional first-order logic constraints but also implicit logical constraints
over eventualities concerning their occurrences and orders. For instance, if we
know that "Food is bad" happens before "PersonX adds soy sauce", then "PersonX
adds soy sauce" is unlikely to be the cause of "Food is bad" due to implicit
temporal constraint. To facilitate consistent reasoning on EVKGs, we propose
Complex Eventuality Query Answering (CEQA), a more rigorous definition of CQA
that considers the implicit logical constraints governing the temporal order
and occurrence of eventualities. In this manner, we propose to leverage theorem
provers for constructing benchmark datasets to ensure the answers satisfy
implicit logical constraints. We also propose a Memory-Enhanced Query Encoding
(MEQE) approach to significantly improve the performance of state-of-the-art
neural query encoders on the CEQA task.
Related papers
- Improving Complex Reasoning over Knowledge Graph with Logic-Aware Curriculum Tuning [89.89857766491475]
We propose a complex reasoning schema over KG upon large language models (LLMs)
We augment the arbitrary first-order logical queries via binary tree decomposition to stimulate the reasoning capability of LLMs.
Experiments across widely used datasets demonstrate that LACT has substantial improvements(brings an average +5.5% MRR score) over advanced methods.
arXiv Detail & Related papers (2024-05-02T18:12:08Z) - Modeling Hierarchical Reasoning Chains by Linking Discourse Units and
Key Phrases for Reading Comprehension [80.99865844249106]
We propose a holistic graph network (HGN) which deals with context at both discourse level and word level, as the basis for logical reasoning.
Specifically, node-level and type-level relations, which can be interpreted as bridges in the reasoning process, are modeled by a hierarchical interaction mechanism.
arXiv Detail & Related papers (2023-06-21T07:34:27Z) - Logical Message Passing Networks with One-hop Inference on Atomic
Formulas [57.47174363091452]
We propose a framework for complex query answering that decomposes the Knowledge Graph embeddings from neural set operators.
On top of the query graph, we propose the Logical Message Passing Neural Network (LMPNN) that connects the local one-hop inferences on atomic formulas to the global logical reasoning.
Our approach yields the new state-of-the-art neural CQA model.
arXiv Detail & Related papers (2023-01-21T02:34:06Z) - Neural-Symbolic Entangled Framework for Complex Query Answering [22.663509971491138]
We propose a Neural and Entangled framework (ENeSy) for complex query answering.
It enables the neural and symbolic reasoning to enhance each other to alleviate the cascading error and KG incompleteness.
ENeSy achieves the SOTA performance on several benchmarks, especially in the setting of the training model only with the link prediction task.
arXiv Detail & Related papers (2022-09-19T06:07:10Z) - Fuzzy Logic based Logical Query Answering on Knowledge Graph [37.039516386710716]
We present FuzzQE, a fuzzy logic based query embedding framework for answering FOL queries over KGs.
FuzzyQE follows fuzzy logic to define logical operators in a principled and learning free manner.
Experiments on two benchmark datasets demonstrate that FuzzQE achieves significantly better performance in answering FOL queries.
arXiv Detail & Related papers (2021-08-05T05:54:00Z) - The Price of Selfishness: Conjunctive Query Entailment for ALCSelf is
2ExpTime-hard [11.193504036335503]
In logic-based knowledge representation, query answering has essentially replaced mere satisfiability checking.
For knowledge bases in the basic description logic ALC, the computational complexity of conjunctive query (CQ) answering is well known to be ExpTime-complete.
We show that even extending ALC by just the Self operator increases the complexity of CQ entailment to 2ExpTime.
arXiv Detail & Related papers (2021-06-29T08:12:03Z) - Logically Consistent Loss for Visual Question Answering [66.83963844316561]
The current advancement in neural-network based Visual Question Answering (VQA) cannot ensure such consistency due to identically distribution (i.i.d.) assumption.
We propose a new model-agnostic logic constraint to tackle this issue by formulating a logically consistent loss in the multi-task learning framework.
Experiments confirm that the proposed loss formulae and introduction of hybrid-batch leads to more consistency as well as better performance.
arXiv Detail & Related papers (2020-11-19T20:31:05Z) - From Checking to Inference: Actual Causality Computations as
Optimization Problems [79.87179017975235]
We present a novel approach to formulate different notions of causal reasoning, over binary acyclic models, as optimization problems.
We show that both notions are efficiently automated. Using models with more than $8000$ variables, checking is computed in a matter of seconds, with MaxSAT outperforming ILP in many cases.
arXiv Detail & Related papers (2020-06-05T10:56:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.