Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal Style
- URL: http://arxiv.org/abs/2604.24444v1
- Date: Mon, 27 Apr 2026 13:11:57 GMT
- Title: Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal Style
- Abstract summary: Post-editing of large language models (LLMs) is a common collaborative writing strategy.<n>We find that post-editing increases stylistic similarity to participants' unassisted writing.<n>We find a gap between perceived stylistic authenticity and model-measured stylistic similarity.
- Score: 21.31042786004255
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Despite the growing use of large language models (LLMs) for writing tasks, users may hesitate to rely on LLMs when personal style is important. Post-editing LLM-generated drafts or translations is a common collaborative writing strategy, but it remains unclear whether users can effectively reshape LLM-generated text to reflect their personal style. We conduct a pre-registered online study ($n=81$) in which participants post-edit LLM-generated drafts for writing tasks where personal style matters to them. Using embedding-based style similarity metrics, we find that post-editing increases stylistic similarity to participants' unassisted writing and reduces similarity to fully LLM-generated output. However, post-edited text still remains stylistically closer in style to LLM text than to participants' unassisted control text, and it exhibits reduced stylistic diversity compared to unassisted human text. We find a gap between perceived stylistic authenticity and model-measured stylistic similarity, with post-edited text often perceived as representative of participants' personal style despite remaining detectable LLM stylistic traces.
Related papers
- SWIM: Student Writing Simulation via Proficiency-Conditioned Generation [54.69949380133243]
This work explores if language models can realistically simulate student writing, and introduce SWIM.<n>We evaluate prompting, supervised fine-tuning, and reinforcement learning methods for writing simulation using automated essay scoring as a measure of profile alignment.<n>Our findings suggest that explicit supervision enables substantially stronger profile alignment than prompting alone, while authentic low-proficiency writing remains challenging to reproduce.
arXiv Detail & Related papers (2026-09-02T23:10:51Z) - Value Over Language Model: Detecting Original Contribution in Writing [23.244156664404205]
We design a framework that measures how much value a person adds on top of what a language model could have easily produced by itself.<n>The method requires no training or labeled data and never scores the document's surface text.<n>It separates human-authored documents from matched LLM-generated documents produced from generic task descriptions.
arXiv Detail & Related papers (2026-09-01T04:21:20Z) - Interpretable Stylistic Variation in Human and LLM Writing Across Genres, Models, and Decoding Strategies [0.34202935599316525]
Large Language Models (LLMs) are now capable of generating highly fluent, human-like text.<n>LLMs enable many applications, but also raise concerns such as large scale spam, phishing, or academic misuse.<n>We perform a large scale analysis of stylistic variation across human-written text and outputs from 11 LLMs.
arXiv Detail & Related papers (2026-04-15T17:31:21Z) - Iterative Critique-Refine Framework for Enhancing LLM Personalization [67.77803308645511]
We present PerFine, a unified, training-free critique-refine framework for personalized text generation.<n>In each iteration, an LLM generator produces a draft conditioned on a retrieved profile, and a critic LLM - also conditioned on the same profile - provides structured feedback on tone, vocabulary, sentence structure, and topicality.<n>Across Yelp, Goodreads, and Amazon datasets, PerFine consistently improves personalization over PGraphRAG.
arXiv Detail & Related papers (2025-10-28T14:36:22Z) - Catch Me If You Can? Not Yet: LLMs Still Struggle to Imitate the Implicit Writing Styles of Everyday Authors [9.921537507947473]
This work presents a comprehensive evaluation of large language models' ability to mimic personal writing styles.<n>We introduce an ensemble of complementary metrics-including authorship attribution, authorship verification, style matching, and AI detection-to robustly assess style imitation.<n>Results show that while LLMs can approximate user styles in structured formats like news and email, they struggle with nuanced, informal writing in blogs and forums.
arXiv Detail & Related papers (2025-09-18T02:18:49Z) - Idiosyncrasies in Large Language Models [54.26923012617675]
We unveil and study idiosyncrasies in Large Language Models (LLMs)<n>We find that fine-tuning text embedding models on LLM-generated texts yields excellent classification accuracy.<n>We leverage LLM as judges to generate detailed, open-ended descriptions of each model's idiosyncrasies.
arXiv Detail & Related papers (2025-02-17T18:59:02Z) - Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Edits [39.00434175773803]
We hired professional writers to edit paragraphs in several creative domains.<n>We curated the LAMP corpus: 1,057 LLM-generated paragraphs edited by professional writers according to our taxonomy.<n>Analysis of LAMP reveals that none of the LLMs used in our study outperform each other in terms of writing quality.
arXiv Detail & Related papers (2024-09-22T16:13:00Z) - Customizing Large Language Model Generation Style using Parameter-Efficient Finetuning [24.263699489328427]
One-size-fits-all large language models (LLMs) are increasingly being used to help people with their writing.
This paper explores whether parameter-efficient finetuning (PEFT) with Low-Rank Adaptation can effectively guide the style of LLM generations.
arXiv Detail & Related papers (2024-09-06T19:25:18Z) - ReMoDetect: Reward Models Recognize Aligned LLM's Generations [55.06804460642062]
Large language models (LLMs) generate human-preferable texts.
In this paper, we identify the common characteristics shared by these models.
We propose two training schemes to further improve the detection ability of the reward model.
arXiv Detail & Related papers (2024-05-27T17:38:33Z) - Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversations [65.29513437838457]
Even if two current turns are the same sentence, their responses might still differ when they are spoken in different styles.
We propose Spoken-LLM framework that can model the linguistic content and the speaking styles.
We train Spoken-LLM using the StyleTalk dataset and devise a two-stage training pipeline to help the Spoken-LLM better learn the speaking styles.
arXiv Detail & Related papers (2024-02-20T07:51:43Z) - Improving Factual Consistency of News Summarization by Contrastive Preference Optimization [65.11227166319546]
Large language models (LLMs) generate summaries that are factually inconsistent with original articles.<n>These hallucinations are challenging to detect through traditional methods.<n>We propose Contrastive Preference Optimization (CPO) to disentangle the LLMs' propensities to generate faithful and fake content.
arXiv Detail & Related papers (2023-10-30T08:40:16Z) - Learning Interpretable Style Embeddings via Prompting LLMs [46.74488355350601]
Style representation learning builds content-independent representations of author style in text.
Current style representation learning uses neural methods to disentangle style from content to create style vectors.
We use prompting to perform stylometry on a large number of texts to create a synthetic dataset and train human-interpretable style representations.
arXiv Detail & Related papers (2023-05-22T04:07:54Z) - DPIC: Decoupling Prompt and Intrinsic Characteristics for LLM Generated Text Detection [56.513637720967566]
Large language models (LLMs) can generate texts that pose risks of misuse, such as plagiarism, planting fake reviews on e-commerce platforms, or creating inflammatory false tweets.
Existing high-quality detection methods usually require access to the interior of the model to extract the intrinsic characteristics.
We propose to extract deep intrinsic characteristics of the black-box model generated texts.
arXiv Detail & Related papers (2023-05-21T17:26:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.