PersonaEdit: Representative Sample Selection for Personalized Model Editing

• URL: http://arxiv.org/abs/2608.27816v1
• Date: Fri, 28 Aug 2026 01:25:29 GMT
• Title: PersonaEdit: Representative Sample Selection for Personalized Model Editing
• Abstract summary: We propose PersonaEdit, a hidden representation clustering strategy that selects representative editing samples through proportional stratified sampling.<n>Experiments show that model editing is effective for personalization, and that our selection strategy preserves most of the performance.
• Score: 9.118615355121934
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Personalization has attracted growing interest in LLM applications, yet existing retrieval-based approaches depend heavily on retrieval quality and degrade in long-term interactions. Model editing, which directly modifies internal model parameters to incorporate new knowledge, has demonstrated effective knowledge modification capabilities in factual knowledge editing tasks and may provide a potential solution for personalization. However, scaling model editing to personalization is non-trivial. Editing large amounts of user data increases computational cost and causes interference among edits, motivating the need for effective sample selection. To address this issue, we propose, PersonaEdit, a hidden representation clustering strategy that selects representative editing samples through proportional stratified sampling. Experiments show that model editing is effective for personalization, and that our selection strategy preserves most of the performance while substantially reducing the number of required editing samples. Beyond standalone editing, we find that combining model editing with retrieval-based prompt augmentation further improves personalization, as edited knowledge and retrieved context provide complementary information. These results demonstrate the potential of model editing as an efficient and scalable approach for LLM personalization.

Related papers

• HP-Edit: A Human-Preference Post-Training Framework for Image Editing [56.02114960634816]
  We propose HP-Edit, a post-training framework for Human Preference-aligned Editing.<n>We also introduce RealPref-50K, a real-world dataset across eight common tasks and balancing common object editing.
  arXiv  Detail & Related papers  (2026-04-21T12:29:50Z)
• KEditVis: A Visual Analytics System for Knowledge Editing of Large Language Models [40.75210566048808]
  We present KEditVis, a novel visual analytics system designed to assist users in gaining a deeper understanding of knowledge editing.<n>With KEditVis, users can select appropriate layers as the editing target, explore the reasons behind ineffective edits, and perform more targeted and effective edits.
  arXiv  Detail & Related papers  (2026-03-31T12:45:46Z)
• One Adapts to Any: Meta Reward Modeling for Personalized LLM Alignment [55.86333374784959]
  We argue that addressing these constraints requires a paradigm shift from fitting data to learn user preferences to learn the process of preference adaptation.<n>We propose Meta Reward Modeling (MRM), which reformulates personalized reward modeling as a meta-learning problem.<n>We show that MRM enhances few-shot personalization, improves user robustness, and consistently outperforms baselines.
  arXiv  Detail & Related papers  (2026-01-26T17:55:52Z)
• Towards Effective Model Editing for LLM Personalization [36.236438676571034]
  We conceptualize personalization as a model editing task and introduce Personalization Editing.<n>This framework applies localized edits guided by clustered preference representations.<n>It achieves higher editing accuracy and greater computational efficiency than fine-tuning.
  arXiv  Detail & Related papers  (2025-12-15T18:58:15Z)
• InComeS: Integrating Compression and Selection Mechanisms into LLMs for Efficient Model Editing [86.17245523439514]
  In-context learning is a promising editing method by comprehending edit information through context encoding.<n>This method is constrained by the limited context window of large language models.<n>We propose InComeS, a flexible framework that enhances LLMs' ability to process editing contexts.
  arXiv  Detail & Related papers  (2025-05-28T09:20:18Z)
• PIXELS: Progressive Image Xemplar-based Editing with Latent Surgery [10.594261300488546]
  We introduce a novel framework for progressive exemplar-driven editing with off-the-shelf diffusion models, dubbed PIXELS.<n>PIXELS provides granular control over edits, allowing adjustments at the pixel or region level.<n>We demonstrate that PIXELS delivers high-quality edits efficiently, leading to a notable improvement in quantitative metrics as well as human evaluation.
  arXiv  Detail & Related papers  (2025-01-16T20:26:30Z)
• Bridging Personalization and Control in Scientific Personalized Search [53.7152408217116]
  We introduce a model for personalized search that enables users to control personalized rankings proactively.<n>Our model, CtrlCE, is a novel cross-encoder model augmented with an editable memory built from users' historical interactions.
  arXiv  Detail & Related papers  (2024-11-05T03:55:25Z)
• Is Bigger Edit Batch Size Always Better? -- An Empirical Study on Model Editing with Llama-3 [2.569159339315845]
  This study presents a targeted model editing analysis focused on the latest large language model, Llama-3. We identify the most effective layers for targeted edits through an evaluation that encompasses up to 4096 edits.
  arXiv  Detail & Related papers  (2024-05-01T17:50:37Z)
• The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapse [58.0132400208411]
  Even a single edit can trigger model collapse, manifesting as significant performance degradation in various benchmark tasks. benchmarking Large Language Models after each edit is impractically time-consuming and resource-intensive. We have utilized GPT-3.5 to develop a new dataset, HardEdit, based on hard cases.
  arXiv  Detail & Related papers  (2024-02-15T01:50:38Z)
• Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue [122.20016030723043]
  We evaluate the side effects of model editing on large language models (LLMs) Our analysis reveals that the side effects are caused by model editing altering the original model weights excessively. To mitigate this, a method named RECT is proposed to regularize the edit update weights.
  arXiv  Detail & Related papers  (2024-01-09T18:03:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.