A LINDDUN-based Privacy Threat Modeling Framework for GenAI

• URL: http://arxiv.org/abs/2603.06051v1
• Date: Fri, 06 Mar 2026 09:04:32 GMT
• Title: A LINDDUN-based Privacy Threat Modeling Framework for GenAI
• Abstract summary: We introduce a novel domain-specific privacy threat modeling framework to support the privacy threat analysis of GenAI-based applications.<n>The new framework affects three out of the seven privacy threat types of LINDDUN and introduces 100 new GenAI examples to the knowledge base.<n>Its effectiveness is validated on an AI Agent system, which demonstrates that a comprehensive privacy analysis can be supported by the new framework.
• Score: 13.683645364910568
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As generative AI (GenAI) systems become increasingly prevalent across various technological stacks, the question of how such systems handle sensitive and personal data flows becomes increasingly important. Specifically, both the ability to harness and process large swaths of information as well as their stochastic nature raise key concerns related to both security and privacy. Unfortunately, while some of the traditional security threat modeling can effectively identify certain violations, privacy-related issues are often overlooked. To respond to these challenges, we introduce a novel domain-specific privacy threat modeling framework to support the privacy threat analysis of GenAI-based applications. This framework is constructed through a two-pronged approach: (1) a systematic review of the emerging literature on GenAI privacy threats, and (2) a case-driven application to a representative Chatbot system. These efforts yield a foundational GenAI privacy threat modeling framework built on LINDDUN. The new framework affects three out of the seven privacy threat types of LINDDUN and introduces 100 new GenAI examples to the knowledge base. Its effectiveness is validated on an AI Agent system, which demonstrates that a comprehensive privacy analysis can be supported by the new framework.

Related papers

• Emerging Challenges in Threat Modeling for GenAI-Augmented Systems: A View from the Trenches [3.5141073261469202]
  Threat modeling remains a central task in secure software engineering.<n>Traditional threat modeling methods are insufficient to assess emerging GenAI-specific risks.<n>We present the first results from an exploratory assessment of GenAI-aware threat modeling methods in a Small and Medium Enterprise setting.
  arXiv  Detail & Related papers  (2026-07-30T16:08:33Z)
• Neural Gate: Mitigating Privacy Risks in LVLMs via Neuron-Level Gradient Gating [71.55435880263238]
  We introduce Neural Gate, a novel method for mitigating privacy risks through neuron-level model editing.<n>Our method improves a model's privacy safeguards by increasing its rate of refusal for privacy-related questions.
  arXiv  Detail & Related papers  (2026-03-13T03:03:20Z)
• PriMod4AI: Lifecycle-Aware Privacy Threat Modeling for AI Systems using LLM [0.0]
  PriMod4AI is a hybrid privacy threat modeling approach that unifies two structured knowledge sources, a LINDDUN knowledge base representing the established taxonomy, and a model-centric privacy attack knowledge base capturing threats outside LINDDUN.<n>The framework produces justified and taxonomy-grounded threat assessments that integrate both classical and AI-driven perspectives.
  arXiv  Detail & Related papers  (2026-02-04T08:58:19Z)
• SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems [53.51921540246166]
  Retrieval-Augmented Generation (RAG) techniques have become widely popular.<n>RAG involves the coupling of Large Language Models (LLMs) with domain-specific knowledge bases.<n>The proliferation of RAG has sparked concerns about data privacy.
  arXiv  Detail & Related papers  (2026-01-07T14:50:41Z)
• Generative AI for Biosciences: Emerging Threats and Roadmap to Biosecurity [56.331312963880215]
  generative artificial intelligence (GenAI) in the biosciences is transforming biotechnology, medicine, and synthetic biology.<n>This Perspective outlines the current state of GenAI in the biosciences and emerging threat vectors ranging from jailbreak attacks and privacy risks to the dual-use challenges posed by autonomous AI agents.<n>We advocate a multi-layered approach to GenAI safety, including rigorous data filtering, alignment with ethical principles during development, and real-time monitoring to block harmful requests.
  arXiv  Detail & Related papers  (2025-10-13T00:24:41Z)
• Generative AI-Empowered Secure Communications in Space-Air-Ground Integrated Networks: A Survey and Tutorial [107.26005706569498]
  Space-air-ground integrated networks (SAGINs) face unprecedented security challenges due to their inherent characteristics.<n>Generative AI (GAI) is a transformative approach that can safeguard SAGIN security by synthesizing data, understanding semantics, and making autonomous decisions.
  arXiv  Detail & Related papers  (2025-08-04T01:42:57Z)
• An LLM-based Self-Evolving Security Framework for 6G Space-Air-Ground Integrated Networks [49.605335601285496]
  6G space-air-ground integrated networks (SAGINs) offer ubiquitous coverage for various mobile applications.<n>We propose a novel security framework for SAGINs based on Large Language Models (LLMs)<n>Our framework produces highly accurate security strategies that remain robust against a variety of unknown attacks.
  arXiv  Detail & Related papers  (2025-05-06T04:14:13Z)
• Computational Safety for Generative AI: A Signal Processing Perspective [65.268245109828]
  computational safety is a mathematical framework that enables the quantitative assessment, formulation, and study of safety challenges in GenAI.<n>We show how sensitivity analysis and loss landscape analysis can be used to detect malicious prompts with jailbreak attempts.<n>We discuss key open research challenges, opportunities, and the essential role of signal processing in computational AI safety.
  arXiv  Detail & Related papers  (2025-02-18T02:26:50Z)
• Security of and by Generative AI platforms [0.0]
  This whitepaper highlights the dual importance of securing generative AI (genAI) platforms and leveraging genAI for cybersecurity. As genAI technologies proliferate, their misuse poses significant risks, including data breaches, model tampering, and malicious content generation. The whitepaper explores strategies for robust security frameworks around genAI systems, while also showcasing how genAI can empower organizations to anticipate, detect, and mitigate sophisticated cyber threats.
  arXiv  Detail & Related papers  (2024-10-15T15:27:05Z)
• Deepfakes, Misinformation, and Disinformation in the Era of Frontier AI, Generative AI, and Large AI Models [7.835719708227145]
  Deepfakes and the spread of m/disinformation have emerged as formidable threats to the integrity of information ecosystems worldwide. We highlight the mechanisms through which generative AI based on large models (LM-based GenAI) craft seemingly convincing yet fabricated contents. We introduce an integrated framework that combines advanced detection algorithms, cross-platform collaboration, and policy-driven initiatives.
  arXiv  Detail & Related papers  (2023-11-29T06:47:58Z)
• GenAIPABench: A Benchmark for Generative AI-based Privacy Assistants [1.2642388972233845]
  This study introduces GenAIPABench, a benchmark for evaluating Generative AI-based Privacy Assistants (GenAIPAs) GenAIPABench includes: 1) A set of questions about privacy policies and data protection regulations, with annotated answers for various organizations and regulations; 2) Metrics to assess the accuracy, relevance, and consistency of responses; and 3) A tool for generating prompts to introduce privacy documents and varied privacy questions to test system robustness. We evaluated three leading genAI systems ChatGPT-4, Bard, and Bing AI using GenAIPABench to gauge their effectiveness as GenAIPAs.
  arXiv  Detail & Related papers  (2023-09-10T21:15:42Z)
• Target Privacy Threat Modeling for COVID-19 Exposure Notification Systems [8.080564346335542]
  Digital contact tracing (DCT) technology has helped to slow the spread of infectious disease. To support both ethical technology deployment and user adoption, privacy must be at the forefront. With the loss of privacy being a critical threat, thorough threat modeling will help us to strategize and protect privacy as DCT technologies advance.
  arXiv  Detail & Related papers  (2020-09-25T02:09:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.