Refining Text Generation for Realistic Conversational Recommendation via Direct Preference Optimization

• URL: http://arxiv.org/abs/2508.19918v3
• Date: Fri, 29 Aug 2025 02:12:05 GMT
• Title: Refining Text Generation for Realistic Conversational Recommendation via Direct Preference Optimization
• Authors: Manato Tajiri, Michimasa Inaba,
• Abstract summary: Conversational Recommender Systems (CRSs) aim to elicit user preferences via natural dialogue to provide suitable item recommendations.<n>Current CRSs often deviate from realistic human interactions by rapidly recommending items in brief sessions.<n>This work addresses this gap by leveraging Large Language Models (LLMs) to generate dialogue summaries from dialogue history and item recommendation information.
• Score: 0.8594140167290097
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Conversational Recommender Systems (CRSs) aim to elicit user preferences via natural dialogue to provide suitable item recommendations. However, current CRSs often deviate from realistic human interactions by rapidly recommending items in brief sessions. This work addresses this gap by leveraging Large Language Models (LLMs) to generate dialogue summaries from dialogue history and item recommendation information from item description. This approach enables the extraction of both explicit user statements and implicit preferences inferred from the dialogue context. We introduce a method using Direct Preference Optimization (DPO) to ensure dialogue summary and item recommendation information are rich in information crucial for effective recommendations. Experiments on two public datasets validate our method's effectiveness in fostering more natural and realistic conversational recommendation processes. Our implementation is publicly available at: https://github.com/UEC-InabaLab/Refining-LLM-Text

Related papers

• STEP: Stepwise Curriculum Learning for Context-Knowledge Fusion in Conversational Recommendation [18.833994388759326]
  We introduce STEP, a conversational recommender centered on pre-trained language models.<n> STEP combines curriculum-guided context-knowledge fusion with lightweight task-specific prompt tuning.<n> Experimental results show that STEP outperforms mainstream methods in the precision of recommendation and dialogue quality in two public datasets.
  arXiv  Detail & Related papers  (2025-08-14T14:08:21Z)
• Beyond Whole Dialogue Modeling: Contextual Disentanglement for Conversational Recommendation [22.213312621287482]
  This paper proposes a novel model to introduce contextual disentanglement for improving conversational recommender systems.<n>DisenCRS employs a dual disentanglement framework, including self-supervised contrastive disentanglement and counterfactual inference disentanglement.<n> Experimental results on two widely used public datasets demonstrate that DisenCRS significantly outperforms existing conversational recommendation models.
  arXiv  Detail & Related papers  (2025-04-24T10:33:26Z)
• Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Action [12.637812936971049]
  We present Conversational Sales (CSALES), a novel task that integrates preference elicitation, recommendation and persuasion within a unified conversational framework.<n>We also propose CSI, a conversational sales agent that proactively infers contextual user profiles and strategically selects actions through conversation.
  arXiv  Detail & Related papers  (2025-03-28T15:49:52Z)
• Collaborative Retrieval for Large Language Model-based Conversational Recommender Systems [65.75265303064654]
  Conversational recommender systems (CRS) aim to provide personalized recommendations via interactive dialogues with users.<n>Large language models (LLMs) enhance CRS with their superior understanding of context-aware user preferences.<n>We propose CRAG, Collaborative Retrieval Augmented Generation for LLM-based CRS.
  arXiv  Detail & Related papers  (2025-02-19T22:47:40Z)
• SumRec: A Framework for Recommendation using Open-Domain Dialogue [4.552428235927528]
  This study proposes a novel framework SumRec for recommending information from open-domain chat dialogue. The SumRec framework employs a large language model (LLM) to generate a summary of the speaker information from a dialogue. The speaker and item information are then input into a score estimation model, generating a recommendation score.
  arXiv  Detail & Related papers  (2024-02-07T02:06:48Z)
• Parameter-Efficient Conversational Recommender System as a Language Processing Task [52.47087212618396]
  Conversational recommender systems (CRS) aim to recommend relevant items to users by eliciting user preference through natural language conversation. Prior work often utilizes external knowledge graphs for items' semantic information, a language model for dialogue generation, and a recommendation module for ranking relevant items. In this paper, we represent items in natural language and formulate CRS as a natural language processing task.
  arXiv  Detail & Related papers  (2024-01-25T14:07:34Z)
• Improving Conversational Recommendation Systems via Counterfactual Data Simulation [73.4526400381668]
  Conversational recommender systems (CRSs) aim to provide recommendation services via natural language conversations. Existing CRS approaches often suffer from the issue of insufficient training due to the scarcity of training data. We propose a CounterFactual data simulation approach for CRS, named CFCRS, to alleviate the issue of data scarcity in CRSs.
  arXiv  Detail & Related papers  (2023-06-05T12:48:56Z)
• Talk the Walk: Synthetic Data Generation for Conversational Music Recommendation [62.019437228000776]
  We present TalkWalk, which generates realistic high-quality conversational data by leveraging encoded expertise in widely available item collections. We generate over one million diverse conversations in a human-collected dataset.
  arXiv  Detail & Related papers  (2023-01-27T01:54:16Z)
• Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion [77.21442487537139]
  Conversational recommender systems (CRS) aim to recommend high-quality items to users through interactive conversations. First, the conversation data itself lacks of sufficient contextual information for accurately understanding users' preference. Second, there is a semantic gap between natural language expression and item-level user preference.
  arXiv  Detail & Related papers  (2020-07-08T11:14:23Z)
• Towards Conversational Recommendation over Multi-Type Dialogs [78.52354759386296]
  We propose a new task of conversational recommendation over multi-type dialogs, where the bots can proactively and naturally lead a conversation from a non-recommendation dialog to a recommendation dialog. To facilitate the study of this task, we create a human-to-human Chinese dialog dataset emphDuRecDial (about 10k dialogs, 156k utterances) In each dialog, the recommender proactively leads a multi-type dialog to approach recommendation targets and then makes multiple recommendations with rich interaction behavior.
  arXiv  Detail & Related papers  (2020-05-08T11:01:21Z)
• Reward Constrained Interactive Recommendation with Natural Language Feedback [158.8095688415973]
  We propose a novel constraint-augmented reinforcement learning (RL) framework to efficiently incorporate user preferences over time. Specifically, we leverage a discriminator to detect recommendations violating user historical preference. Our proposed framework is general and is further extended to the task of constrained text generation.
  arXiv  Detail & Related papers  (2020-05-04T16:23:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.