Refining Wikidata Taxonomy using Large Language Models

• URL: http://arxiv.org/abs/2409.04056v1
• Date: Fri, 6 Sep 2024 06:53:45 GMT
• Title: Refining Wikidata Taxonomy using Large Language Models
• Authors: Yiwen Peng, Thomas Bonald, Mehwish Alam,
• Abstract summary: We present WiKC, a new version of Wikidata taxonomy cleaned automatically using a combination of Large Language Models (LLMs) and graph mining techniques. Operations on the taxonomy, such as cutting links or merging classes, are performed with the help of zero-shot prompting on an open-source LLM.
• Score: 2.392329079182226
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Due to its collaborative nature, Wikidata is known to have a complex taxonomy, with recurrent issues like the ambiguity between instances and classes, the inaccuracy of some taxonomic paths, the presence of cycles, and the high level of redundancy across classes. Manual efforts to clean up this taxonomy are time-consuming and prone to errors or subjective decisions. We present WiKC, a new version of Wikidata taxonomy cleaned automatically using a combination of Large Language Models (LLMs) and graph mining techniques. Operations on the taxonomy, such as cutting links or merging classes, are performed with the help of zero-shot prompting on an open-source LLM. The quality of the refined taxonomy is evaluated from both intrinsic and extrinsic perspectives, on a task of entity typing for the latter, showing the practical interest of WiKC.

Related papers

• Automatic Bottom-Up Taxonomy Construction: A Software Application Domain Study [6.0158981171030685]
  Previous research in software application domain classification has faced challenges due to the lack of a proper taxonomy. This study aims to develop a comprehensive software application domain taxonomy by integrating multiple datasources and leveraging ensemble methods.
  arXiv  Detail & Related papers  (2024-09-24T08:55:07Z)
• Chain-of-Layer: Iteratively Prompting Large Language Models for Taxonomy Induction from Limited Examples [34.88498567698853]
  Chain-of-Layer is an incontext learning framework designed to induct from a given set of entities. We show that Chain-of-Layer achieves state-of-the-art performance on four real-world benchmarks.
  arXiv  Detail & Related papers  (2024-02-12T03:05:54Z)
• Using Zero-shot Prompting in the Automatic Creation and Expansion of Topic Taxonomies for Tagging Retail Banking Transactions [0.0]
  This work presents an unsupervised method for constructing and expanding topic using instruction-based fine-tuned LLMs (Large Language Models) To expand an existing taxonomy with new terms, we use zero-shot prompting to find out where to add new nodes. We use the resulting tags to assign tags that characterize merchants from a retail bank dataset.
  arXiv  Detail & Related papers  (2024-01-08T00:27:16Z)
• YAGO 4.5: A Large and Clean Knowledge Base with a Rich Taxonomy [4.80715673060552]
  We extend YAGO 4 with a large part of the Wikidata taxonomy. This yields YAGO 4.5, a new, consistent version of YAGO that adds a rich layer of informative classes.
  arXiv  Detail & Related papers  (2023-08-23T03:03:14Z)
• Taxonomy Enrichment with Text and Graph Vector Representations [61.814256012166794]
  We address the problem of taxonomy enrichment which aims at adding new words to the existing taxonomy. We present a new method that allows achieving high results on this task with little effort. We achieve state-of-the-art results across different datasets and provide an in-depth error analysis of mistakes.
  arXiv  Detail & Related papers  (2022-01-21T09:01:12Z)
• TaxoCom: Topic Taxonomy Completion with Hierarchical Discovery of Novel Topic Clusters [57.59286394188025]
  We propose a novel framework for topic taxonomy completion, named TaxoCom. TaxoCom discovers novel sub-topic clusters of terms and documents. Our comprehensive experiments on two real-world datasets demonstrate that TaxoCom not only generates the high-quality topic taxonomy in terms of term coherency and topic coverage.
  arXiv  Detail & Related papers  (2022-01-18T07:07:38Z)
• Studying Taxonomy Enrichment on Diachronic WordNet Versions [70.27072729280528]
  We explore the possibilities of taxonomy extension in a resource-poor setting and present methods which are applicable to a large number of languages. We create novel English and Russian datasets for training and evaluating taxonomy enrichment models and describe a technique of creating such datasets for other languages.
  arXiv  Detail & Related papers  (2020-11-23T16:49:37Z)
• Octet: Online Catalog Taxonomy Enrichment with Self-Supervision [67.26804972901952]
  We present a self-supervised end-to-end framework, Octet for Online Catalog EnrichmenT. We propose to train a sequence labeling model for term extraction and employ graph neural networks (GNNs) to capture the taxonomy structure. Octet enriches an online catalog in production to 2 times larger in the open-world evaluation.
  arXiv  Detail & Related papers  (2020-06-18T04:53:07Z)
• STEAM: Self-Supervised Taxonomy Expansion with Mini-Paths [53.45704816829921]
  We propose a self-supervised taxonomy expansion model named STEAM. STEAM generates natural self-supervision signals, and formulates a node attachment prediction task. Experiments show STEAM outperforms state-of-the-art methods for taxonomy expansion by 11.6% in accuracy and 7.0% in mean reciprocal rank.
  arXiv  Detail & Related papers  (2020-06-18T00:32:53Z)
• TaxoExpan: Self-supervised Taxonomy Expansion with Position-Enhanced Graph Neural Network [62.12557274257303]
  Taxonomies consist of machine-interpretable semantics and provide valuable knowledge for many web applications. We propose a novel self-supervised framework, named TaxoExpan, which automatically generates a set of query concept, anchor concept> pairs from the existing taxonomy as training data. We develop two innovative techniques in TaxoExpan: (1) a position-enhanced graph neural network that encodes the local structure of an anchor concept in the existing taxonomy, and (2) a noise-robust training objective that enables the learned model to be insensitive to the label noise in the self-supervision data.
  arXiv  Detail & Related papers  (2020-01-26T21:30:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.