Differentially-Private Text Rewriting reshapes Linguistic Style

• URL: http://arxiv.org/abs/2604.26656v1
• Date: Wed, 29 Apr 2026 13:23:23 GMT
• Title: Differentially-Private Text Rewriting reshapes Linguistic Style
• Abstract summary: Differential Privacy for text matured from disjointed word-level substitutions to contiguous sentence-level rewriting.<n>We find that rewriting under privacy constraints induces a systematic functional mutation of the text's communicative signature.<n>This register-blind sanitization effectively preserves semantic content but structurally homogenizes the nuanced stylistic markers that define human-authored discourse.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Differential Privacy (DP) for text matured from disjointed word-level substitutions to contiguous sentence-level rewriting by leveraging the generative capacity of language models. While this form of text privatization is best suited for balancing formal privacy guarantees with grammatical coherence, its impact on the register identity of text remains largely unexplored. By conducting a multidimensional stylistic profiling of differentially-private rewriting, we demonstrate that the cost of privacy extends far beyond lexical variation. Specifically, we find that rewriting under privacy constraints induces a systematic functional mutation of the text's communicative signature. This shift is characterized by the severe attrition of interactive markers, contextual references, and complex subordination. By comparing autoregressive paraphrasing against bidirectional substitution across a spectrum of privacy budgets, we observe that both architectures force convergence toward a non-involved and non-persuasive register. This register-blind sanitization effectively preserves semantic content but structurally homogenizes the nuanced stylistic markers that define human-authored discourse.

Related papers

• I Am No One: Style-Aware Paraphrasing for Text Anonymization [0.5874782446136914]
  Authorship attribution models can re-identify users from seemingly anonymized text by exploiting stable stylistic fingerprints.<n>We propose a style-aware, prompt-driven anonymization approach that uses pretrained large language models to construct compact stylistic profiles.<n>Our approach reduces authorship attribution F1 by 60-70% while maintaining content quality and readability.
  arXiv  Detail & Related papers  (2026-09-11T02:07:26Z)
• Zero-Shot Privacy-Aware Text Rewriting via Iterative Tree Search [60.197239728279534]
  Large language models (LLMs) in cloud-based services have raised significant privacy concerns.<n>Existing text anonymization and de-identification techniques, such as rule-based redaction and scrubbing, often struggle to balance privacy preservation with text naturalness and utility.<n>We propose a zero-shot, tree-search-based iterative sentence rewriting algorithm that systematically obfuscates or deletes private information while preserving coherence, relevance, and naturalness.
  arXiv  Detail & Related papers  (2025-09-25T07:23:52Z)
• Inspecting the Representation Manifold of Differentially-Private Text [0.0]
  We estimate the intrinsic dimension of paraphrased text across varying privacy budgets.<n>We find that word-level methods severely raise the representation manifold.<n>We suggest that autoregressive generation propagates distortions from unnatural word choices that cascade and inflate the representation space.
  arXiv  Detail & Related papers  (2025-03-19T08:36:58Z)
• Instilling Multi-round Thinking to Text-guided Image Generation [72.2032630115201]
  Single-round generation often overlooks crucial details, particularly in the realm of fine-grained changes like shoes or sleeves. We introduce a new self-supervised regularization, ie, multi-round regularization, which is compatible with existing methods. It builds upon the observation that the modification order generally should not affect the final result.
  arXiv  Detail & Related papers  (2024-01-16T16:19:58Z)
• Disentangling the Linguistic Competence of Privacy-Preserving BERT [0.0]
  Differential Privacy (DP) has been tailored to address the unique challenges of text-to-text privatization. We employ a series of interpretation techniques on the internal representations extracted from BERT trained on perturbed pre-text. Using probing tasks to unpack this dissimilarity, we find evidence that text-to-text privatization affects the linguistic competence across several formalisms.
  arXiv  Detail & Related papers  (2023-10-17T16:00:26Z)
• Don't lose the message while paraphrasing: A study on content preserving style transfer [61.38460184163704]
  Content preservation is critical for real-world applications of style transfer studies. We compare various style transfer models on the example of the formality transfer domain. We conduct a precise comparative study of several state-of-the-art techniques for style transfer.
  arXiv  Detail & Related papers  (2023-08-17T15:41:08Z)
• Improving Joint Speech-Text Representations Without Alignment [92.60384956736536]
  We show that joint speech-text encoders naturally achieve consistent representations across modalities by disregarding sequence length. We argue that consistency losses could forgive length differences and simply assume the best alignment.
  arXiv  Detail & Related papers  (2023-08-11T13:28:48Z)
• Guiding Text-to-Text Privatization by Syntax [0.0]
  Metric Differential Privacy is a generalization of differential privacy tailored to address the unique challenges of text-to-text privatization. We analyze the capability of text-to-text privatization to preserve the grammatical category of words after substitution. We transform the privatization step into a candidate selection problem in which substitutions are directed to words with matching grammatical properties.
  arXiv  Detail & Related papers  (2023-06-02T11:52:21Z)
• DP-BART for Privatized Text Rewriting under Local Differential Privacy [2.45626162429986]
  We propose a new system 'DP-BART' that largely outperforms existing LDP systems. Our approach uses a novel clipping method, iterative pruning, and further training of internal representations which drastically reduces the amount of noise required for DP guarantees.
  arXiv  Detail & Related papers  (2023-02-15T13:07:34Z)
• Marginal Contrastive Correspondence for Guided Image Generation [58.0605433671196]
  Exemplar-based image translation establishes dense correspondences between a conditional input and an exemplar from two different domains. Existing work builds the cross-domain correspondences implicitly by minimizing feature-wise distances across the two domains. We design a Marginal Contrastive Learning Network (MCL-Net) that explores contrastive learning to learn domain-invariant features for realistic exemplar-based image translation.
  arXiv  Detail & Related papers  (2022-04-01T13:55:44Z)
• Semantics-Preserved Distortion for Personal Privacy Protection in Information Management [65.08939490413037]
  This paper suggests a linguistically-grounded approach to distort texts while maintaining semantic integrity. We present two distinct frameworks for semantic-preserving distortion: a generative approach and a substitutive approach. We also explore privacy protection in a specific medical information management scenario, showing our method effectively limits sensitive data memorization.
  arXiv  Detail & Related papers  (2022-01-04T04:01:05Z)
• Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence [59.51720326054546]
  We propose a long text generation model, which can represent the prefix sentences at sentence level and discourse level in the decoding process. Our model can generate more coherent texts than state-of-the-art baselines.
  arXiv  Detail & Related papers  (2021-05-19T07:29:08Z)
• Improving Disentangled Text Representation Learning with Information-Theoretic Guidance [99.68851329919858]
  discrete nature of natural language makes disentangling of textual representations more challenging. Inspired by information theory, we propose a novel method that effectively manifests disentangled representations of text. Experiments on both conditional text generation and text-style transfer demonstrate the high quality of our disentangled representation.
  arXiv  Detail & Related papers  (2020-06-01T03:36:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.