Improving Robustness Estimates in Natural Language Explainable AI though Synonymity Weighted Similarity Measures

• URL: http://arxiv.org/abs/2501.01516v1
• Date: Thu, 02 Jan 2025 19:49:04 GMT
• Title: Improving Robustness Estimates in Natural Language Explainable AI though Synonymity Weighted Similarity Measures
• Authors: Christopher Burger,
• Abstract summary: adversarial examples have been prominent in the literature surrounding the effectiveness of XAI. For explanations in natural language, it is natural to use measures found in the domain of information retrieval for use with ranked lists. We show that the standard implementation of these measures are poorly suited for the comparison of explanations in adversarial XAI.
• Score: 0.0
• License:
• Abstract: Explainable AI (XAI) has seen a surge in recent interest with the proliferation of powerful but intractable black-box models. Moreover, XAI has come under fire for techniques that may not offer reliable explanations. As many of the methods in XAI are themselves models, adversarial examples have been prominent in the literature surrounding the effectiveness of XAI, with the objective of these examples being to alter the explanation while maintaining the output of the original model. For explanations in natural language, it is natural to use measures found in the domain of information retrieval for use with ranked lists to guide the adversarial XAI process. We show that the standard implementation of these measures are poorly suited for the comparison of explanations in adversarial XAI and amend them by using information that is discarded, the synonymity of perturbed words. This synonymity weighting produces more accurate estimates of the actual weakness of XAI methods to adversarial examples.

Related papers

• Towards Robust and Accurate Stability Estimation of Local Surrogate Models in Text-based Explainable AI [9.31572645030282]
  In adversarial attacks on explainable AI (XAI) in the NLP domain, the generated explanation is manipulated. Central to this XAI manipulation is the similarity measure used to calculate how one explanation differs from another. This work investigates a variety of similarity measures designed for text-based ranked lists to determine their comparative suitability for use.
  arXiv  Detail & Related papers  (2025-01-03T17:44:57Z)
• The Effect of Similarity Measures on Accurate Stability Estimates for Local Surrogate Models in Text-based Explainable AI [8.23094630594374]
  A poor choice of similarity measure can lead to erroneous conclusions on the efficacy of an XAI method. We investigate a variety of similarity measures designed for text-based ranked lists, including Kendall's Tau, Spearman's Footrule, and Rank-biased Overlap.
  arXiv  Detail & Related papers  (2024-06-22T12:59:12Z)
• Explaining Text Similarity in Transformer Models [52.571158418102584]
  Recent advances in explainable AI have made it possible to mitigate limitations by leveraging improved explanations for Transformers. We use BiLRP, an extension developed for computing second-order explanations in bilinear similarity models, to investigate which feature interactions drive similarity in NLP models. Our findings contribute to a deeper understanding of different semantic similarity tasks and models, highlighting how novel explainable AI methods enable in-depth analyses and corpus-level insights.
  arXiv  Detail & Related papers  (2024-05-10T17:11:31Z)
• Assessing Fidelity in XAI post-hoc techniques: A Comparative Study with Ground Truth Explanations Datasets [0.0]
  XAI methods based on the backpropagation of output information to input yield higher accuracy and reliability. Backpropagation method tends to generate more noisy saliency maps. Findings have significant implications for the advancement of XAI methods.
  arXiv  Detail & Related papers  (2023-11-03T14:57:24Z)
• Explaining Explainability: Towards Deeper Actionable Insights into Deep Learning through Second-order Explainability [70.60433013657693]
  Second-order explainable AI (SOXAI) was recently proposed to extend explainable AI (XAI) from the instance level to the dataset level. We demonstrate for the first time, via example classification and segmentation cases, that eliminating irrelevant concepts from the training set based on actionable insights from SOXAI can enhance a model's performance.
  arXiv  Detail & Related papers  (2023-06-14T23:24:01Z)
• Theoretical Behavior of XAI Methods in the Presence of Suppressor Variables [0.8602553195689513]
  In recent years, the community of 'explainable artificial intelligence' (XAI) has created a vast body of methods to bridge a perceived gap between model 'complexity' and 'interpretability' We show that the majority of the studied approaches will attribute non-zero importance to a non-class-related suppressor feature in the presence of correlated noise.
  arXiv  Detail & Related papers  (2023-06-02T11:41:19Z)
• An Experimental Investigation into the Evaluation of Explainability Methods [60.54170260771932]
  This work compares 14 different metrics when applied to nine state-of-the-art XAI methods and three dummy methods (e.g., random saliency maps) used as references. Experimental results show which of these metrics produces highly correlated results, indicating potential redundancy.
  arXiv  Detail & Related papers  (2023-05-25T08:07:07Z)
• Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI [65.44737844681256]
  A lack of consensus on how to evaluate explainable AI (XAI) hinders the advancement of the field. We argue that one way to close the gap is to develop evaluation methods that account for different user requirements.
  arXiv  Detail & Related papers  (2022-06-22T05:17:33Z)
• Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvement [75.00655434905417]
  Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex machine learning (ML) models. This paper offers a comprehensive overview over techniques that apply XAI practically for improving various properties of ML models. We show empirically through experiments on toy and realistic settings how explanations can help improve properties such as model generalization ability or reasoning.
  arXiv  Detail & Related papers  (2022-03-15T15:44:28Z)
• Data Representing Ground-Truth Explanations to Evaluate XAI Methods [0.0]
  Explainable artificial intelligence (XAI) methods are currently evaluated with approaches mostly originated in interpretable machine learning (IML) research. We propose to represent explanations with canonical equations that can be used to evaluate the accuracy of XAI methods.
  arXiv  Detail & Related papers  (2020-11-18T16:54:53Z)
• Contextualized Perturbation for Textual Adversarial Attack [56.370304308573274]
  Adversarial examples expose the vulnerabilities of natural language processing (NLP) models. This paper presents CLARE, a ContextuaLized AdversaRial Example generation model that produces fluent and grammatical outputs.
  arXiv  Detail & Related papers  (2020-09-16T06:53:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.