Knowledge Graph Embeddings in the Biomedical Domain: Are They Useful? A Look at Link Prediction, Rule Learning, and Downstream Polypharmacy Tasks

• URL: http://arxiv.org/abs/2305.19979v2
• Date: Thu, 31 Aug 2023 08:02:35 GMT
• Title: Knowledge Graph Embeddings in the Biomedical Domain: Are They Useful? A Look at Link Prediction, Rule Learning, and Downstream Polypharmacy Tasks
• Authors: Aryo Pradipta Gema, Dominik Grabarczyk, Wolf De Wulf, Piyush Borole, Javier Antonio Alfaro, Pasquale Minervini, Antonio Vergari, Ajitha Rajan
• Abstract summary: This study aims to apply state-of-the-art knowledge graph embedding models in the context of a recent biomedical knowledge graph, BioKG. We achieve a three-fold improvement in terms of performance based on the HITS@10 score over previous work on the same biomedical knowledge graph. Results suggest that knowledge learnt from large biomedical knowledge graphs can be transferred to such downstream use cases.
• Score: 12.896135204106423
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Knowledge graphs are powerful tools for representing and organising complex biomedical data. Several knowledge graph embedding algorithms have been proposed to learn from and complete knowledge graphs. However, a recent study demonstrates the limited efficacy of these embedding algorithms when applied to biomedical knowledge graphs, raising the question of whether knowledge graph embeddings have limitations in biomedical settings. This study aims to apply state-of-the-art knowledge graph embedding models in the context of a recent biomedical knowledge graph, BioKG, and evaluate their performance and potential downstream uses. We achieve a three-fold improvement in terms of performance based on the HITS@10 score over previous work on the same biomedical knowledge graph. Additionally, we provide interpretable predictions through a rule-based method. We demonstrate that knowledge graph embedding models are applicable in practice by evaluating the best-performing model on four tasks that represent real-life polypharmacy situations. Results suggest that knowledge learnt from large biomedical knowledge graphs can be transferred to such downstream use cases. Our code is available at https://github.com/aryopg/biokge.

Related papers

• Graph Relation Distillation for Efficient Biomedical Instance Segmentation [80.51124447333493]
  We propose a graph relation distillation approach for efficient biomedical instance segmentation. We introduce two graph distillation schemes deployed at both the intra-image level and the inter-image level. Experimental results on a number of biomedical datasets validate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2024-01-12T04:41:23Z)
• Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs [54.223394825528665]
  We develop an approach that uses lightweight adapter modules to inject structured biomedical knowledge into pre-trained language models. We use two large KGs, the biomedical knowledge system UMLS and the novel biochemical OntoChem, with two prominent biomedical PLMs, PubMedBERT and BioLinkBERT. We show that our methodology leads to performance improvements in several instances while keeping requirements in computing power low.
  arXiv  Detail & Related papers  (2023-12-21T14:26:57Z)
• Multimodal brain age estimation using interpretable adaptive population-graph learning [58.99653132076496]
  We propose a framework that learns a population graph structure optimized for the downstream task. An attention mechanism assigns weights to a set of imaging and non-imaging features. By visualizing the attention weights that were the most important for the graph construction, we increase the interpretability of the graph.
  arXiv  Detail & Related papers  (2023-07-10T15:35:31Z)
• State of the Art and Potentialities of Graph-level Learning [54.68482109186052]
  Graph-level learning has been applied to many tasks including comparison, regression, classification, and more. Traditional approaches to learning a set of graphs rely on hand-crafted features, such as substructures. Deep learning has helped graph-level learning adapt to the growing scale of graphs by extracting features automatically and encoding graphs into low-dimensional representations.
  arXiv  Detail & Related papers  (2023-01-14T09:15:49Z)
• Contrastive Brain Network Learning via Hierarchical Signed Graph Pooling Model [64.29487107585665]
  Graph representation learning techniques on brain functional networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Here, we propose an interpretable hierarchical signed graph representation learning model to extract graph-level representations from brain functional networks. In order to further improve the model performance, we also propose a new strategy to augment functional brain network data for contrastive learning.
  arXiv  Detail & Related papers  (2022-07-14T20:03:52Z)
• Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study [62.376800537374024]
  We study scientific LMs for KG completion, exploring whether we can tap into their latent knowledge to enhance biomedical link prediction. We integrate the LM-based models with KG embedding models, using a router method that learns to assign each input example to either type of model and provides a substantial boost in performance.
  arXiv  Detail & Related papers  (2021-06-17T17:55:33Z)
• Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphs [10.244651735862627]
  We conduct an empirical study based on the real-world task of drug repurposing. We formulate this task as a link prediction problem where both compounds and diseases correspond to entities in a knowledge graph. We propose a new method, PoLo, that combines policy-guided walks based on reinforcement learning with logical rules.
  arXiv  Detail & Related papers  (2021-03-18T16:46:11Z)
• A Literature Review of Recent Graph Embedding Techniques for Biomedical Data [36.446560017794845]
  Many graph-based learning methods have been proposed to analyze such type of data. The main difficulty is how to handle high dimensionality and sparsity of the biomedical graphs. graph embedding methods provide an effective and efficient way to address the above issues.
  arXiv  Detail & Related papers  (2021-01-17T01:53:50Z)
• Biomedical Knowledge Graph Refinement and Completion using Graph Representation Learning and Top-K Similarity Measure [1.4660617536303606]
  This work demonstrates learning discrete representations of the integrated biomedical knowledge graph Chem2Bio2RD. We perform a knowledge graph completion and refinement task using a simple top-K cosine similarity measure between the learned embedding vectors.
  arXiv  Detail & Related papers  (2020-12-18T22:19:57Z)
• Biomedical Knowledge Graph Refinement with Embedding and Logic Rules [29.933066247708638]
  Many studies have demonstrated that reasoning upon the knowledge graph is effective in eliminating such conflicts and noises. This paper proposes a method BioGRER to improve the BioKG's quality. We employ the variational EM algorithm to optimize knowledge graph embedding and logic rule inference.
  arXiv  Detail & Related papers  (2020-12-02T08:55:07Z)
• Benchmark and Best Practices for Biomedical Knowledge Graph Embeddings [8.835844347471626]
  We train several state-of-the-art knowledge graph embedding models on the SNOMED-CT knowledge graph. We make a case for the importance of leveraging the multi-relational nature of knowledge graphs for learning biomedical knowledge representation.
  arXiv  Detail & Related papers  (2020-06-24T14:47:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.