Differentially Private De-identification of Dutch Clinical Notes: A Comparative Evaluation

• URL: http://arxiv.org/abs/2604.21421v1
• Date: Thu, 23 Apr 2026 08:37:40 GMT
• Title: Differentially Private De-identification of Dutch Clinical Notes: A Comparative Evaluation
• Abstract summary: Methods based on differential privacy (DP) provide formal privacy guarantees.<n>Large language models (LLMs) are increasingly used for text de-identification in the clinical domain.<n>We show that DP mechanisms alone degrade utility substantially, but combining them with linguistic preprocessing, especially LLM-based redaction, significantly improves the privacy-utility trade-off.
• Score: 1.5441165311156937
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Protecting patient privacy in clinical narratives is essential for enabling secondary use of healthcare data under regulations such as GDPR and HIPAA. While manual de-identification remains the gold standard, it is costly and slow, motivating the need for automated methods that combine privacy guarantees with high utility. Most automated text de-identification pipelines employed named entity recognition (NER) to identify protected entities for redaction. Although methods based on differential privacy (DP) provide formal privacy guarantees, more recently also large language models (LLMs) are increasingly used for text de-identification in the clinical domain. In this work, we present the first comparative study of DP, NER, and LLMs for Dutch clinical text de-identification. We investigate these methods separately as well as hybrid strategies that apply NER or LLM preprocessing prior to DP, and assess performance in terms of privacy leakage and extrinsic evaluation (entity and relation classification). We show that DP mechanisms alone degrade utility substantially, but combining them with linguistic preprocessing, especially LLM-based redaction, significantly improves the privacy-utility trade-off.

Related papers

• MedPriv-Bench: Benchmarking the Privacy-Utility Trade-off of Large Language Models in Medical Open-End Question Answering [15.468900582717865]
  We present Med-Bench, first benchmark specifically designed to evaluate privacy clinical utility in open-ended question answering.<n>Our framework utilizes a multi-agent, human-in-the-loop pipeline to synthesize sensitive medical contexts and clinically relevant queries that create realistic privacy pressure.<n>Our findings underscore the necessity of domain-specific benchmarks to validate the safety and efficacy of medical AI systems in privacy-sensitive environments.
  arXiv  Detail & Related papers  (2026-03-15T07:47:35Z)
• How to Train Private Clinical Language Models: A Comparative Study of Privacy-Preserving Pipelines for ICD-9 Coding [0.33148826359547523]
  Large language models trained on clinical text risk exposing sensitive patient information.<n>Despite rapid progress in DP optimisation, it remains unclear which privacy-preserving strategy actually works best.<n>Knowledge distillation from DP-trained teachers outperforms both direct DP-SGD and DP-synthetic data training.
  arXiv  Detail & Related papers  (2025-11-18T21:51:04Z)
• PBa-LLM: Privacy- and Bias-aware NLP using Named-Entity Recognition (NER) [45.870212237420226]
  This work explores the use of Named- Entity Recognition (NER) to facilitate the privacy-preserving training of Large Language Models (LLMs)<n>We propose a framework that uses NER technologies to anonymize sensitive information in text data, such as personal identities or geographic locations.<n>The study involved two language models (BERT and RoBERTa) and six anonymization algorithms (based on Presidio, FLAIR, BERT, and different versions of GPT) applied to a database of 24,000 candidate profiles.
  arXiv  Detail & Related papers  (2025-06-30T14:42:49Z)
• Urania: Differentially Private Insights into AI Use [102.27238986985698]
  $Urania$ provides end-to-end privacy protection by leveraging DP tools such as clustering, partition selection, and histogram-based summarization.<n>Results show the framework's ability to extract meaningful conversational insights while maintaining stringent user privacy.
  arXiv  Detail & Related papers  (2025-06-05T07:00:31Z)
• Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications [4.15598192943552]
  Differential privacy (DP) is a key technique for protecting sensitive patient data in medical deep learning (DL)<n>As clinical models grow more data-dependent, balancing privacy with utility and fairness has become a critical challenge.<n>This scoping review synthesizes recent developments in applying DP to medical DL.
  arXiv  Detail & Related papers  (2025-05-31T18:03:15Z)
• Large Language Model Empowered Privacy-Protected Framework for PHI Annotation in Clinical Notes [28.117944094827596]
  We introduce LPPA, an LLM-powered Privacy-Protected PHI framework for clinical notes.<n>This framework ensures privacy protection and high PHI annotation accuracy.<n>Extensive experiments demonstrate LPPA's effectiveness in accurately de-identifying private information.
  arXiv  Detail & Related papers  (2025-04-22T03:18:36Z)
• Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning [62.224804688233]
  differential privacy (DP) offers a promising solution by ensuring models are 'almost indistinguishable' with or without any particular privacy unit. We study user-level DP motivated by applications where it necessary to ensure uniform privacy protection across users.
  arXiv  Detail & Related papers  (2024-06-20T13:54:32Z)
• Self-Verification Improves Few-Shot Clinical Information Extraction [73.6905567014859]
  Large language models (LLMs) have shown the potential to accelerate clinical curation via few-shot in-context learning. They still struggle with issues regarding accuracy and interpretability, especially in mission-critical domains such as health. Here, we explore a general mitigation framework using self-verification, which leverages the LLM to provide provenance for its own extraction and check its own outputs.
  arXiv  Detail & Related papers  (2023-05-30T22:05:11Z)
• DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4 [80.36535668574804]
  We develop a novel GPT4-enabled de-identification framework (DeID-GPT") Our developed DeID-GPT showed the highest accuracy and remarkable reliability in masking private information from the unstructured medical text. This study is one of the earliest to utilize ChatGPT and GPT-4 for medical text data processing and de-identification.
  arXiv  Detail & Related papers  (2023-03-20T11:34:37Z)
• Privacy-preserving medical image analysis [53.4844489668116]
  We present PriMIA, a software framework designed for privacy-preserving machine learning (PPML) in medical imaging. We show significantly better classification performance of a securely aggregated federated learning model compared to human experts on unseen datasets. We empirically evaluate the framework's security against a gradient-based model inversion attack.
  arXiv  Detail & Related papers  (2020-12-10T13:56:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.