PREFER: Personalized Review Summarization with Online Preference Learning

• URL: http://arxiv.org/abs/2605.05911v1
• Date: Thu, 07 May 2026 09:20:47 GMT
• Title: PREFER: Personalized Review Summarization with Online Preference Learning
• Abstract summary: Current e-commerce summarization systems produce generic, static summaries that fail to account for the fact that different users care about different product characteristics.<n>We propose an online learning framework that generates personalized summaries for each user.<n>Our system iteratively refines its understanding of user preferences by incorporating feedback directly from the generated summaries over time.
• Score: 3.8233569758620054
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Product reviews significantly influence purchasing decisions on e-commerce platforms. However, the sheer volume of reviews can overwhelm users, obscuring the information most relevant to their specific needs. Current e-commerce summarization systems typically produce generic, static summaries that fail to account for the fact that (i) different users care about different product characteristics, and (ii) these preferences may evolve with interactions. To address the challenge of unknown latent preferences, we propose an online learning framework that generates personalized summaries for each user. Our system iteratively refines its understanding of user preferences by incorporating feedback directly from the generated summaries over time. We provide a case study using the Amazon Reviews'23 dataset, showing in controlled simulations that online preference learning improves alignment with target user interests while maintaining summary quality.

Related papers

• Learning from Online User Feedback for Shopping Agents [54.03311028861336]
  Large language model-based shopping agents are increasingly deployed in real-world e-commerce platforms.<n>Existing approaches rely on offline training signals, such as user-item interactions or synthetic preference data.<n>We propose LOFA, a framework that enables shopping agents to learn directly from real online interaction logs without human annotation.
  arXiv  Detail & Related papers  (2026-08-12T03:24:44Z)
• Preference-Aware Rubric Learning for Personalized Evaluation [59.539429430690156]
  Existing evaluation methods fail to capture user-specific preferences embedded in long-term interaction histories.<n>We propose Personalized Evaluation as Learning, a paradigm that formulates personalized evaluation as a learning problem rather than a static judgment.<n>Experiments show that PARL consistently induces high-fidelity rubrics that reliably identify user-aligned responses and generalize across users.
  arXiv  Detail & Related papers  (2026-05-29T17:00:55Z)
• When to Ask a Question: Understanding Communication Strategies in Generative AI Tools [7.445350484328613]
  We show how generative AI systems should balance inference and elicitation, characterizing the optimal amount of information to solicit before content generation.<n>We show that information elicitation can mitigate the systematic biases of preference inference, enabling the design of generative tools that better incorporate diverse user perspectives.
  arXiv  Detail & Related papers  (2026-05-11T20:58:09Z)
• Improving User Experience with Personalized Review Ranking and Summarization [0.0]
  This research proposes a personalized framework that integrates review ranking and abstractive summarization to enhance decision-making efficiency.<n>A user study with 70 participants demonstrated that the personalized approach improved satisfaction, perceived relevance, and decision-making confidence.
  arXiv  Detail & Related papers  (2025-10-28T13:16:28Z)
• Personalized Reasoning: Just-In-Time Personalization and Why LLMs Fail At It [81.50711040539566]
  Current large language model (LLM) development treats task-solving and preference alignment as separate challenges.<n>We introduce PREFDISCO, an evaluation methodology that transforms static benchmarks into interactive personalization tasks.<n>Our framework creates scenarios where identical questions require different reasoning chains depending on user context.
  arXiv  Detail & Related papers  (2025-09-30T18:55:28Z)
• Multi-agents based User Values Mining for Recommendation [52.26100802380767]
  We propose a zero-shot multi-LLM collaborative framework for effective and accurate user value extraction.<n>We apply text summarization techniques to condense item content while preserving essential meaning.<n>To mitigate hallucinations, we introduce two specialized agent roles: evaluators and supervisors.
  arXiv  Detail & Related papers  (2025-05-02T04:01:31Z)
• A Survey of Personalized Large Language Models: Progress and Future Directions [86.45576419251302]
  Large Language Models (LLMs) excel in handling general knowledge tasks, yet struggle with user-specific personalization.<n> Personalized Large Language Models (PLLMs) tackle these challenges by leveraging individual user data.<n>PLLMs can significantly enhance user satisfaction and have broad applications in conversational agents, systems, emotion recognition, medical assistants, and more.
  arXiv  Detail & Related papers  (2025-02-17T07:58:31Z)
• ComPO: Community Preferences for Language Model Personalization [122.54846260663922]
  ComPO is a method to personalize preference optimization in language models. We collect and release ComPRed, a question answering dataset with community-level preferences from Reddit.
  arXiv  Detail & Related papers  (2024-10-21T14:02:40Z)
• Review-based Recommender Systems: A Survey of Approaches, Challenges and Future Perspectives [11.835903510784735]
  Review-based recommender systems have emerged as a significant sub-field in this domain.<n>We present a categorization of these systems and summarize the state-of-the-art methods, analyzing their unique features, effectiveness, and limitations.<n>We propose potential directions for future research, including the integration of multimodal data, multi-criteria rating information, and ethical considerations.
  arXiv  Detail & Related papers  (2024-05-09T05:45:18Z)
• AaKOS: Aspect-adaptive Knowledge-based Opinion Summarization [5.4138734778206]
  The rapid growth of information on the Internet has led to an overwhelming amount of opinions and comments on various activities, products, and services. This makes it difficult and time-consuming for users to process all the available information when making decisions. We propose an Aspect-adaptive Knowledge-based Opinion Summarization model for product reviews.
  arXiv  Detail & Related papers  (2023-05-26T03:44:35Z)
• Towards Personalized Answer Generation in E-Commerce via Multi-Perspective Preference Modeling [62.049330405736406]
  Product Question Answering (PQA) on E-Commerce platforms has attracted increasing attention as it can act as an intelligent online shopping assistant. It is insufficient to provide the same "completely summarized" answer to all customers, since many customers are more willing to see personalized answers with customized information only for themselves. We propose a novel multi-perspective user preference model for generating personalized answers in PQA.
  arXiv  Detail & Related papers  (2021-12-27T07:51:49Z)
• User-Inspired Posterior Network for Recommendation Reason Generation [53.035224183349385]
  Recommendation reason generation plays a vital role in attracting customers' attention as well as improving user experience. We propose a user-inspired multi-source posterior transformer (MSPT), which induces the model reflecting the users' interests. Experimental results show that our model is superior to traditional generative models.
  arXiv  Detail & Related papers  (2021-02-16T02:08:52Z)
• E-commerce Query-based Generation based on User Review [1.484852576248587]
  We propose a novel seq2seq based text generation model to generate answers to user's question based on reviews posted by previous users. Given a user question and/or target sentiment polarity, we extract aspects of interest and generate an answer that summarizes previous relevant user reviews.
  arXiv  Detail & Related papers  (2020-11-11T04:58:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.