When Explainability Meets Privacy: An Investigation at the Intersection of Post-hoc Explainability and Differential Privacy in the Context of Natural Language Processing

• URL: http://arxiv.org/abs/2508.10482v2
• Date: Fri, 15 Aug 2025 13:25:21 GMT
• Title: When Explainability Meets Privacy: An Investigation at the Intersection of Post-hoc Explainability and Differential Privacy in the Context of Natural Language Processing
• Authors: Mahdi Dhaini, Stephen Meisenbacher, Ege Erdogan, Florian Matthes, Gjergji Kasneci,
• Abstract summary: We conduct an empirical investigation into the privacy-explainability trade-off in the context of NLP.<n>Our findings include a view into the intricate relationship between privacy and explainability, which is formed by a number of factors.<n>We highlight the potential for privacy and explainability to co-exist.
• Score: 11.944589034923313
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In the study of trustworthy Natural Language Processing (NLP), a number of important research fields have emerged, including that of explainability and privacy. While research interest in both explainable and privacy-preserving NLP has increased considerably in recent years, there remains a lack of investigation at the intersection of the two. This leaves a considerable gap in understanding of whether achieving both explainability and privacy is possible, or whether the two are at odds with each other. In this work, we conduct an empirical investigation into the privacy-explainability trade-off in the context of NLP, guided by the popular overarching methods of Differential Privacy (DP) and Post-hoc Explainability. Our findings include a view into the intricate relationship between privacy and explainability, which is formed by a number of factors, including the nature of the downstream task and choice of the text privatization and explainability method. In this, we highlight the potential for privacy and explainability to co-exist, and we summarize our findings in a collection of practical recommendations for future work at this important intersection.

Related papers

• Bayesian Adversarial Privacy [0.048998185508205734]
  This work introduces a new quantitative notion of privacy that is both contextual and specific.<n>We argue that it provides a more meaningful notion of privacy than the widely utilised framework of differential privacy.
  arXiv  Detail & Related papers  (2026-03-04T15:46:24Z)
• Token-Level Privacy in Large Language Models [7.4143291213663955]
  We introduce dchi-stencil, a novel token-level privacy-preserving mechanism that integrates contextual and semantic information.<n>By incorporating both semantic and contextual nuances, dchi-stencil achieves a robust balance between privacy and utility.<n>This work highlights the potential of dchi-stencil to set a new standard for privacy-preserving NLP in modern, high-risk applications.
  arXiv  Detail & Related papers  (2025-03-05T16:27:25Z)
• Natural Language Processing of Privacy Policies: A Survey [2.4058538793689497]
  We conduct a literature review by analyzing 109 papers at the intersection of NLP and privacy policies.<n>We provide a brief introduction to privacy policies and discuss various facets of associated problems.<n>We identify the methodologies that can be further enhanced to provide robust privacy policies.
  arXiv  Detail & Related papers  (2025-01-17T17:47:15Z)
• How Private are Language Models in Abstractive Summarization? [36.801842863853715]
  In sensitive domains such as medical and legal, protecting sensitive information is critical.<n>This poses challenges for sharing valuable data such as medical reports and legal cases summaries.<n>It is still an open question to what extent they can provide privacy-preserving summaries from non-private source documents.
  arXiv  Detail & Related papers  (2024-12-16T18:08:22Z)
• Differential Privacy Overview and Fundamental Techniques [63.0409690498569]
  This chapter is meant to be part of the book "Differential Privacy in Artificial Intelligence: From Theory to Practice" It starts by illustrating various attempts to protect data privacy, emphasizing where and why they failed. It then defines the key actors, tasks, and scopes that make up the domain of privacy-preserving data analysis.
  arXiv  Detail & Related papers  (2024-11-07T13:52:11Z)
• A Comparative Analysis of Word-Level Metric Differential Privacy: Benchmarking The Privacy-Utility Trade-off [45.07650884598811]
  We compare seven different algorithms for achieving word-level Differential Privacy. We provide an in-depth analysis of the results with a focus on the privacy-utility trade-off. We suggest concrete steps forward for the research field.
  arXiv  Detail & Related papers  (2024-04-04T09:48:14Z)
• A Survey of Privacy-Preserving Model Explanations: Privacy Risks, Attacks, and Countermeasures [50.987594546912725]
  Despite a growing corpus of research in AI privacy and explainability, there is little attention on privacy-preserving model explanations. This article presents the first thorough survey about privacy attacks on model explanations and their countermeasures.
  arXiv  Detail & Related papers  (2024-03-31T12:44:48Z)
• Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory [82.7042006247124]
  We show that even the most capable AI models reveal private information in contexts that humans would not, 39% and 57% of the time, respectively. Our work underscores the immediate need to explore novel inference-time privacy-preserving approaches, based on reasoning and theory of mind.
  arXiv  Detail & Related papers  (2023-10-27T04:15:30Z)
• Privacy and Fairness in Federated Learning: on the Perspective of Trade-off [58.204074436129716]
  Federated learning (FL) has been a hot topic in recent years. As two crucial ethical notions, the interactions between privacy and fairness are comparatively less studied.
  arXiv  Detail & Related papers  (2023-06-25T04:38:19Z)
• Differential Privacy in Natural Language Processing: The Story So Far [21.844047604993687]
  This paper aims to summarize the vulnerabilities addressed by Differential Privacy. This topic has sparked novel research, which is unified in one basic goal: how can one adapt Differential Privacy to NLP methods?
  arXiv  Detail & Related papers  (2022-08-17T08:15:44Z)
• Differential Privacy and Fairness in Decisions and Learning Tasks: A Survey [50.90773979394264]
  It reviews the conditions under which privacy and fairness may have aligned or contrasting goals. It analyzes how and why DP may exacerbate bias and unfairness in decision problems and learning tasks.
  arXiv  Detail & Related papers  (2022-02-16T16:50:23Z)
• Beyond The Text: Analysis of Privacy Statements through Syntactic and Semantic Role Labeling [12.74252812104216]
  This paper formulates a new task of extracting privacy parameters from a privacy policy, through the lens of Contextual Integrity. We show that traditional NLP tasks, including the recently proposed Question-Answering based solutions, are insufficient to address the privacy parameter extraction problem.
  arXiv  Detail & Related papers  (2020-10-01T20:48:37Z)
• Differentially Private and Fair Deep Learning: A Lagrangian Dual Approach [54.32266555843765]
  This paper studies a model that protects the privacy of the individuals sensitive information while also allowing it to learn non-discriminatory predictors. The method relies on the notion of differential privacy and the use of Lagrangian duality to design neural networks that can accommodate fairness constraints.
  arXiv  Detail & Related papers  (2020-09-26T10:50:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.