Knowledge Graph Embedding: A Survey from the Perspective of
Representation Spaces
- URL: http://arxiv.org/abs/2211.03536v2
- Date: Sun, 15 Oct 2023 09:41:15 GMT
- Title: Knowledge Graph Embedding: A Survey from the Perspective of
Representation Spaces
- Authors: Jiahang Cao, Jinyuan Fang, Zaiqiao Meng, Shangsong Liang
- Abstract summary: Knowledge graph embedding (KGE) is an increasingly popular technique that aims to represent entities and relations of knowledge graphs into semantic spaces.
This paper provides a systematic review of existing KGE techniques based on representation spaces.
- Score: 32.74939332905963
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Knowledge graph embedding (KGE) is an increasingly popular technique that
aims to represent entities and relations of knowledge graphs into
low-dimensional semantic spaces for a wide spectrum of applications such as
link prediction, knowledge reasoning and knowledge completion. In this paper,
we provide a systematic review of existing KGE techniques based on
representation spaces. Particularly, we build a fine-grained classification to
categorise the models based on three mathematical perspectives of the
representation spaces: (1) Algebraic perspective, (2) Geometric perspective,
and (3) Analytical perspective. We introduce the rigorous definitions of
fundamental mathematical spaces before diving into KGE models and their
mathematical properties. We further discuss different KGE methods over the
three categories, as well as summarise how spatial advantages work over
different embedding needs. By collating the experimental results from
downstream tasks, we also explore the advantages of mathematical space in
different scenarios and the reasons behind them. We further state some
promising research directions from a representation space perspective, with
which we hope to inspire researchers to design their KGE models as well as
their related applications with more consideration of their mathematical space
properties.
Related papers
- A Survey of Geometric Graph Neural Networks: Data Structures, Models and
Applications [67.33002207179923]
This paper presents a survey of data structures, models, and applications related to geometric GNNs.
We provide a unified view of existing models from the geometric message passing perspective.
We also summarize the applications as well as the related datasets to facilitate later research for methodology development and experimental evaluation.
arXiv Detail & Related papers (2024-03-01T12:13:04Z) - A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems [87.30652640973317]
Recent advances in computational modelling of atomic systems represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space.
Geometric Graph Neural Networks have emerged as the preferred machine learning architecture powering applications ranging from protein structure prediction to molecular simulations and material generation.
This paper provides a comprehensive and self-contained overview of the field of Geometric GNNs for 3D atomic systems.
arXiv Detail & Related papers (2023-12-12T18:44:19Z) - Knowledge Graph Embedding: An Overview [42.16033541753744]
We make a comprehensive overview of the current state of research in Knowledge Graph completion.
We focus on two main branches of KG embedding (KGE) design: 1) distance-based methods and 2) semantic matching-based methods.
Next, we delve into CompoundE and CompoundE3D, which draw inspiration from 2D and 3D affine operations.
arXiv Detail & Related papers (2023-09-21T21:52:42Z) - Geometry Interaction Knowledge Graph Embeddings [153.69745042757066]
We propose Geometry Interaction knowledge graph Embeddings (GIE), which learns spatial structures interactively between the Euclidean, hyperbolic and hyperspherical spaces.
Our proposed GIE can capture a richer set of relational information, model key inference patterns, and enable expressive semantic matching across entities.
arXiv Detail & Related papers (2022-06-24T08:33:43Z) - GRAPHYP: A Scientific Knowledge Graph with Manifold Subnetworks of
Communities. Detection of Scholarly Disputes in Adversarial Information
Routes [0.0]
We tackle the understanding of the design of the information space of a cognitive representation of research activities.
We propose a novel graph designed geometric architecture which optimize both the detection of the knowledge manifold of "cognitive communities"
With a methodology for designing "Manifold Subnetworks of Cognitive Communities", GRAPHYP provides a classification of distinct search paths in a research field.
arXiv Detail & Related papers (2022-05-03T06:35:47Z) - Hermitian Symmetric Spaces for Graph Embeddings [0.0]
We learn continuous representations of graphs in spaces of symmetric matrices over C.
These spaces offer a rich geometry that simultaneously admits hyperbolic and Euclidean subspaces.
The proposed models are able to automatically adapt to very dissimilar arrangements without any apriori estimates of graph features.
arXiv Detail & Related papers (2021-05-11T18:14:52Z) - Self-supervised Geometric Perception [96.89966337518854]
Self-supervised geometric perception is a framework to learn a feature descriptor for correspondence matching without any ground-truth geometric model labels.
We show that SGP achieves state-of-the-art performance that is on-par or superior to the supervised oracles trained using ground-truth labels.
arXiv Detail & Related papers (2021-03-04T15:34:43Z) - RelWalk A Latent Variable Model Approach to Knowledge Graph Embedding [50.010601631982425]
This paper extends the random walk model (Arora et al., 2016a) of word embeddings to Knowledge Graph Embeddings (KGEs)
We derive a scoring function that evaluates the strength of a relation R between two entities h (head) and t (tail)
We propose a learning objective motivated by the theoretical analysis to learn KGEs from a given knowledge graph.
arXiv Detail & Related papers (2021-01-25T13:31:29Z) - Motif Learning in Knowledge Graphs Using Trajectories Of Differential
Equations [14.279419014064047]
Knowledge Graph Embeddings (KGEs) have shown promising performance on link prediction tasks.
Many KGEs use the flat geometry which renders them incapable of preserving complex structures.
We propose a neuro differential KGE that embeds nodes of a KG on the trajectories of Ordinary Differential Equations (ODEs)
arXiv Detail & Related papers (2020-10-13T20:53:17Z) - Knowledge Graph Embeddings in Geometric Algebras [14.269860621624392]
We introduce a novel geometric algebra-based KG embedding framework, GeomE.
Our framework subsumes several state-of-the-art KG embedding approaches and is advantageous with its ability of modeling various key relation patterns.
Experimental results on multiple benchmark knowledge graphs show that theproposed approach outperforms existing state-of-the-art models for link prediction.
arXiv Detail & Related papers (2020-10-02T13:36:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.