Related papers: Evaluating Dependencies in Fact Editing for Language Models: Specificity and Implication Awareness

Evaluating Dependencies in Fact Editing for Language Models: Specificity and Implication Awareness

URL: http://arxiv.org/abs/2312.01858v1
Date: Mon, 4 Dec 2023 12:45:30 GMT
Title: Evaluating Dependencies in Fact Editing for Language Models: Specificity and Implication Awareness
Authors: Zichao Li, Ines Arous, Siva Reddy, Jackie C.K. Cheung
Abstract summary: We aim to ensure that the editing of learned facts respects internal logical constraints, which are known as dependency of knowledge. Existing work on editing LLMs has partially addressed the issue of dependency, when the editing of a fact should apply to its lexical variations without disrupting irrelevant ones. We propose an evaluation protocol with an accompanying question-answering dataset, DepEdit, that provides a comprehensive assessment of the editing process.
Score: 26.589633375359647
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
Abstract: The potential of using a large language model (LLM) as a knowledge base (KB) has sparked significant interest. To manage the knowledge acquired by LLMs, we need to ensure that the editing of learned facts respects internal logical constraints, which are known as dependency of knowledge. Existing work on editing LLMs has partially addressed the issue of dependency, when the editing of a fact should apply to its lexical variations without disrupting irrelevant ones. However, they neglect the dependency between a fact and its logical implications. We propose an evaluation protocol with an accompanying question-answering dataset, DepEdit, that provides a comprehensive assessment of the editing process considering the above notions of dependency. Our protocol involves setting up a controlled environment in which we edit facts and monitor their impact on LLMs, along with their implications based on If-Then rules. Extensive experiments on DepEdit show that existing knowledge editing methods are sensitive to the surface form of knowledge, and that they have limited performance in inferring the implications of edited facts.