Lattice-preserving $\mathcal{ALC}$ ontology embeddings with saturation
- URL: http://arxiv.org/abs/2305.07163v3
- Date: Wed, 06 Nov 2024 07:01:54 GMT
- Title: Lattice-preserving $\mathcal{ALC}$ ontology embeddings with saturation
- Authors: Fernando Zhapa-Camacho, Robert Hoehndorf,
- Abstract summary: An order-preserving embedding method is proposed to generate embeddings of OWL representations.
We show that our method outperforms state-the-art theory-of-the-art embedding methods in several knowledge base completion tasks.
- Score: 50.05281461410368
- License:
- Abstract: Generating vector representations (embeddings) of OWL ontologies is a growing task due to its applications in predicting missing facts and knowledge-enhanced learning in fields such as bioinformatics. The underlying semantics of OWL ontologies are expressed using Description Logics (DLs). Initial approaches to generate embeddings relied on constructing a graph out of ontologies, neglecting the semantics of the logic therein. Recent semantic-preserving embedding methods often target lightweight DL languages like $\mathcal{EL}^{++}$, ignoring more expressive information in ontologies. Although some approaches aim to embed more descriptive DLs like $\mathcal{ALC}$, those methods require the existence of individuals, while many real-world ontologies are devoid of them. We propose an ontology embedding method for the $\mathcal{ALC}$ DL language that considers the lattice structure of concept descriptions. We use connections between DL and Category Theory to materialize the lattice structure and embed it using an order-preserving embedding method. We show that our method outperforms state-of-the-art methods in several knowledge base completion tasks. Furthermore, we incoporate saturation procedures that increase the information within the constructed lattices. We make our code and data available at \url{https://github.com/bio-ontology-research-group/catE}.
Related papers
- DELE: Deductive $\mathcal{EL}^{++} \thinspace $ Embeddings for Knowledge Base Completion [45.817946135388176]
Ontology embeddings map classes, relations, and individuals in into $mathbbn$, and within $bbRn$ similarity between entities can be computed.
We show that our embedding methods improve over the baseline embedding in the task of knowledge base or completion.
arXiv Detail & Related papers (2024-11-03T14:00:04Z) - End-to-End Ontology Learning with Large Language Models [11.755755139228219]
Large language models (LLMs) have been applied to solve various subtasks of ontology learning.
We address this gap by OLLM, a general and scalable method for building the taxonomic backbone of an ontology from scratch.
In contrast to standard metrics, our metrics use deep learning techniques to define more robust structural distance measures between graphs.
Our model can be effectively adapted to new domains, like arXiv, needing only a small number of training examples.
arXiv Detail & Related papers (2024-10-31T02:52:39Z) - Enhancing Geometric Ontology Embeddings for $\mathcal{EL}^{++}$ with Negative Sampling and Deductive Closure Filtering [45.817946135388176]
Ontology embeddings map classes, relations, and individuals in into $mathbbn$, and within $bbRn$ similarity between entities can be computed.
We develop novel negative losses that account both for the deductive closure and different types of negatives.
arXiv Detail & Related papers (2024-05-08T07:50:21Z) - SemGrasp: Semantic Grasp Generation via Language Aligned Discretization [53.43801984965309]
This paper presents a novel semantic-based grasp generation method, termed SemGrasp.
We introduce a discrete representation that aligns the grasp space with semantic space, enabling the generation of grasp postures.
A Multimodal Large Language Model (MLLM) is subsequently fine-tuned, integrating object, grasp, and language within a unified semantic space.
arXiv Detail & Related papers (2024-04-04T16:58:26Z) - Dual Box Embeddings for the Description Logic EL++ [16.70961576041243]
Similar to Knowledge Graphs (KGs), Knowledge Graphs are often incomplete, and maintaining and constructing them has proved challenging.
Similar to KGs, a promising approach is to learn embeddings in a latent vector space, while additionally ensuring they adhere to the semantics of the underlying DL.
We propose a novel ontology embedding method named Box$2$EL for the DL EL++, which represents both concepts and roles as boxes.
arXiv Detail & Related papers (2023-01-26T14:13:37Z) - Joint Language Semantic and Structure Embedding for Knowledge Graph
Completion [66.15933600765835]
We propose to jointly embed the semantics in the natural language description of the knowledge triplets with their structure information.
Our method embeds knowledge graphs for the completion task via fine-tuning pre-trained language models.
Our experiments on a variety of knowledge graph benchmarks have demonstrated the state-of-the-art performance of our method.
arXiv Detail & Related papers (2022-09-19T02:41:02Z) - Taxonomy Enrichment with Text and Graph Vector Representations [61.814256012166794]
We address the problem of taxonomy enrichment which aims at adding new words to the existing taxonomy.
We present a new method that allows achieving high results on this task with little effort.
We achieve state-of-the-art results across different datasets and provide an in-depth error analysis of mistakes.
arXiv Detail & Related papers (2022-01-21T09:01:12Z) - Why Settle for Just One? Extending EL++ Ontology Embeddings with
Many-to-Many Relationships [2.599882743586164]
Knowledge Graph embeddings provide a low-dimensional representation of entities and relations of a Knowledge Graph.
Recent efforts in this direction involve learning embeddings for a Description (logical Logic for a description) named EL++.
We provide a simple and effective solution that allows such methods to consider many-to-many relationships while learning embedding representations.
arXiv Detail & Related papers (2021-10-20T13:23:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.