When and How to Ask: Dynamic Preference Elicitation Strategies for Conversational Recommendation

• URL: http://arxiv.org/abs/2607.06765v1
• Date: Tue, 07 Jul 2026 19:54:00 GMT
• Title: When and How to Ask: Dynamic Preference Elicitation Strategies for Conversational Recommendation
• Abstract summary: We conduct a systematic investigation of preference elicitation strategies from a stage-aware perspective.<n>We introduce InPE, a dataset enriched with fine-grained annotations for elicitation necessity and strategy selection.<n>Extensive offline evaluation on our dataset indicates that context-aware preference elicitation strategies are beneficial for conversational recommendation.
• Score: 14.76143686519353
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conversational Recommender Systems (CRSs) are interactive systems that use multi-turn natural language dialogue to understand evolving user preferences and provide personalized recommendations. To achieve this goal, CRSs rely on preference elicitation strategies to actively gather informative preference cues from users; however, the timing and selection of these strategies during a conversation remain largely unexplored. While many existing studies emphasize eliciting explicit item attributes and tend to adopt relatively static elicitation strategies, the use of item-based preference elicitation and how it varies across different dialogue stages remains less explored. In this work, we conduct a systematic investigation of preference elicitation strategies from a stage-aware perspective. We provide empirical evidence that optimal preference elicitation strategies are stage-dependent and context-sensitive: attribute-based inquiries are effective in early stages, while item-based strategies become superior as preferences refine. To support this paradigm, we introduce InPE, a dataset enriched with fine-grained annotations for elicitation necessity and strategy selection. With this dataset, we propose COPE (COnversational Preference Elicitation via Mixture of Experts), a novel architecture for strategy modeling. Extensive offline evaluation on our dataset indicates that context-aware preference elicitation strategies are beneficial for conversational recommendation. In addition, the analysis of the predicted strategies uncovers consistent stage-wise tendencies in dialogue progression, providing empirical evidence of common interaction patterns in conversational recommendation systems. Our dataset is available at https://github.com/juanfacabian/InPE.

Related papers

• Towards Effective Structured Context Modeling for Conversational Recommender Systems via Dual-node Monte Carlo Tree Search [78.39993606731646]
  We propose DREAMS, a novel tree-structured context modeling framework that captures user preference evolution throughout multi-turn interactions.<n> DREAMS supports the two fundamental objectives of Conversational Recommendation Systems (CRSs): preference elicitation and preference exploitation.
  arXiv  Detail & Related papers  (2026-09-01T03:02:58Z)
• Preference Tree Optimization: Enhancing Goal-Oriented Dialogue with Look-Ahead Simulations [2.4615755100550984]
  This research proposes a novel framework called Preference Tree Optimization (PTO)<n>PTO is designed to iteratively improve agent models in goal-oriented dialogue systems.<n>We leverage virtual patients and an oracle evaluator to simulate conversations and generate rich preference datasets.
  arXiv  Detail & Related papers  (2026-08-12T13:48:30Z)
• Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning [66.52010873968383]
  We introduce a conversational agent that interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training.<n>The experimental results across four widely used conversational benchmarks demonstrate the effectiveness of our methods.
  arXiv  Detail & Related papers  (2026-01-19T14:55:54Z)
• Towards Context-aware Reasoning-enhanced Generative Searching in E-commerce [61.03081096959132]
  We propose a context-aware reasoning-enhanced generative search framework for better textbfunderstanding the complicated context.<n>Our approach achieves superior performance compared with strong baselines, validating its effectiveness for search-based recommendation.
  arXiv  Detail & Related papers  (2025-10-19T16:46:11Z)
• Reinforced Strategy Optimization for Conversational Recommender Systems via Network-of-Experts [63.412646471177645]
  We propose a novel Reinforced Strategy Optimization (RSO) method for Conversational Recommender Systems (CRSs)<n>RSO decomposes the process of generating strategy-driven response decisions into the macro-level strategy planning and micro-level strategy adaptation.<n>Experiments show that RSO significantly improves interaction performance compared to state-of-the-art baselines.
  arXiv  Detail & Related papers  (2025-09-30T11:12:01Z)
• PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agents [16.819463022406627]
  We propose PRINCIPLES: a synthetic strategy memory for proactive dialogue agents.<n> PRINCIPLES is derived through offline self-play simulations and serves as reusable knowledge that guides strategy planning.<n>We evaluate PRINCIPLES in both emotional support and persuasion domains, demonstrating consistent improvements over strong baselines.
  arXiv  Detail & Related papers  (2025-09-22T07:53:59Z)
• What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context [56.590259941275434]
  RecPO is a preference optimization framework for sequential recommendation.<n>It exploits adaptive reward margins based on inferred preference hierarchies and temporal signals.<n>It mirrors key characteristics of human decision-making: favoring timely satisfaction, maintaining coherent preferences, and exercising discernment under shifting contexts.
  arXiv  Detail & Related papers  (2025-06-02T21:09:29Z)
• Preference-based learning for news headline recommendation [46.32599797180165]
  This study explores strategies for optimizing news headline recommendations through preference-based learning.<n>Using real-world data of user interactions with French-language online news posts, we learn a headline recommender agent under a contextual bandit setting.
  arXiv  Detail & Related papers  (2025-05-31T12:57:56Z)
• Towards a Unified View of Preference Learning for Large Language Models: A Survey [88.66719962576005]
  Large Language Models (LLMs) exhibit remarkably powerful capabilities. One of the crucial factors to achieve success is aligning the LLM's output with human preferences. We decompose all the strategies in preference learning into four components: model, data, feedback, and algorithm.
  arXiv  Detail & Related papers  (2024-09-04T15:11:55Z)
• Conversational Recommendation: Theoretical Model and Complexity Analysis [6.084774669743511]
  We present a theoretical, domain-independent model of conversational recommendation. We show that finding an efficient conversational strategy is NP-hard. We also show that catalog characteristics can strongly influence the efficiency of individual conversational strategies.
  arXiv  Detail & Related papers  (2021-11-10T09:05:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.