Curr-RLCER:Curriculum Reinforcement Learning For Coherence Explainable Recommendation
- URL: http://arxiv.org/abs/2604.05341v1
- Date: Tue, 07 Apr 2026 02:25:36 GMT
- Title: Curr-RLCER:Curriculum Reinforcement Learning For Coherence Explainable Recommendation
- Abstract summary: Curr-RLCER is a reinforcement learning framework for explanation coherent recommendation with dynamic rating alignment.<n>It employs curriculum learning, transitioning from basic predictions to open-ended recommendation explanation generation.<n>The experimental results on three explainable recommendation datasets indicate that the proposed framework is effective.
- Score: 5.971765441013208
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Explainable recommendation systems (RSs) are designed to explicitly uncover the rationale of each recommendation, thereby enhancing the transparency and credibility of RSs. Previous methods often jointly predicted ratings and generated explanations, but overlooked the incoherence of such two objectives. To address this issue, we propose Curr-RLCER, a reinforcement learning framework for explanation coherent recommendation with dynamic rating alignment. It employs curriculum learning, transitioning from basic predictions (i.e., click through rating-CTR, selection-based rating) to open-ended recommendation explanation generation. In particular, the rewards of each stage are designed for progressively enhancing the stability of RSs. Furthermore, a coherence-driven reward mechanism is also proposed to enforce the coherence between generated explanations and predicted ratings, supported by a specifically designed evaluation scheme. The extensive experimental results on three explainable recommendation datasets indicate that the proposed framework is effective. Codes and datasets are available at https://github.com/pxcstart/Curr-RLCER.
Related papers
- Rethinking Reward Supervision: Rubric-Conditioned Self-Distillation [60.55792673956761]
We propose textbfRubric-Conditioned Self-Distillation, a framework that incorporates rubrics as structured, fine-grained feedback for on-policy self-distillation.<n>We evaluate on a diverse suite of science reasoning benchmarks and results show that rubric-conditioned self-distillation effectively converts rubric-level criteria into token-level guidance.
arXiv Detail & Related papers (2026-06-17T17:54:04Z) - TRACE: A Unified Rollout Budget Allocation Framework for Efficient Agentic Reinforcement Learning [52.67756371231985]
Reinforcement learning with verifiable rewards (RLVR) is a promising approach for enhancing reasoning and agentic behavior in large language models.<n>We introduce Tree Rollout Allocation for Contrastive Exploration (TRACE), a unified rollout allocation framework.<n>Technically, TRACE allocates rollout budget to both prompt roots and intermediate prefixes that are most likely to yield mixed terminal rewards.
arXiv Detail & Related papers (2026-06-09T17:16:03Z) - Reinforced Preference Optimization for Reasoning-Augmented Recommendations [34.99578717556569]
We introduce RPORec, a reinforced preference optimization framework for Recommender systems.<n>RPORec unifies an LLM backbone's reasoning ability with a dedicated recommendation head (Rechead) for precise item retrieval.<n>Extensive experiments on public benchmarks and large-scale online deployments show that RPORec consistently outperforms state-of-the-art LLM-based recommendation methods.
arXiv Detail & Related papers (2026-05-21T03:56:42Z) - From Top-1 to Top-K: A Reproducibility Study and Benchmarking of Counterfactual Explanations for Recommender Systems [3.5498952876443917]
Counterfactual explanations (CEs) provide an intuitive way to understand recommender systems.<n>Existing CE methods for recommender systems have been evaluated using different datasets, recommenders, metrics, and explanation formats.<n>Our paper systematically reproduces, re-evaluates, and re-implements eleven state-of-the-art CE methods for recommender systems.
arXiv Detail & Related papers (2026-04-21T16:48:13Z) - Shielded RecRL: Explanation Generation for Recommender Systems without Ranking Degradation [0.17188280334580197]
Shielded RecRL is a reinforcement learning approach to generate personalized explanations for recommender systems.<n>Our results show that Shielded RecRL enhances user-facing aspects of recommendations through rich, personalized explanations without degrading core recommendation accuracy.
arXiv Detail & Related papers (2025-10-14T16:37:48Z) - Towards Comprehensible Recommendation with Large Language Model Fine-tuning [41.218487308635126]
We propose a novel Content Understanding from a Collaborative Perspective framework (CURec) for recommendation systems.<n>Curec generates collaborative-aligned content features for more comprehensive recommendations.<n>Experiments on public benchmarks demonstrate the superiority of CURec over existing methods.
arXiv Detail & Related papers (2025-08-11T03:55:31Z) - RAG-Zeval: Towards Robust and Interpretable Evaluation on RAG Responses through End-to-End Rule-Guided Reasoning [64.46921169261852]
RAG-Zeval is a novel end-to-end framework that formulates faithfulness and correctness evaluation as a rule-guided reasoning task.<n>Our approach trains evaluators with reinforcement learning, facilitating compact models to generate comprehensive and sound assessments.<n>Experiments demonstrate RAG-Zeval's superior performance, achieving the strongest correlation with human judgments.
arXiv Detail & Related papers (2025-05-28T14:55:33Z) - Revisiting Reciprocal Recommender Systems: Metrics, Formulation, and Method [60.364834418531366]
We propose five new evaluation metrics that comprehensively and accurately assess the performance of RRS.
We formulate the RRS from a causal perspective, formulating recommendations as bilateral interventions.
We introduce a reranking strategy to maximize matching outcomes, as measured by the proposed metrics.
arXiv Detail & Related papers (2024-08-19T07:21:02Z) - Concept -- An Evaluation Protocol on Conversational Recommender Systems with System-centric and User-centric Factors [68.68418801681965]
We propose a new and inclusive evaluation protocol, Concept, which integrates both system- and user-centric factors.
Our protocol, Concept, serves a dual purpose. First, it provides an overview of the pros and cons in current CRS models.
Second, it pinpoints the problem of low usability in the "omnipotent" ChatGPT and offers a comprehensive reference guide for evaluating CRS.
arXiv Detail & Related papers (2024-04-04T08:56:48Z) - Set-to-Sequence Ranking-based Concept-aware Learning Path Recommendation [49.85548436111153]
We propose a novel framework named Set-to-Sequence Ranking-based Concept-aware Learning Path Recommendation (SRC)
SRC formulates the recommendation task under a set-to-sequence paradigm.
We conduct extensive experiments on two real-world public datasets and one industrial dataset.
arXiv Detail & Related papers (2023-06-07T08:24:44Z) - Towards Explainable Conversational Recommender Systems [44.26020239452129]
Explanations in recommender systems have demonstrated benefits in helping the user understand the rationality of the recommendations.
In the conversational environment, multiple contextualized explanations need to be generated.
We propose ten evaluation perspectives based on concepts from conventional recommender systems together with the characteristics of recommender systems.
arXiv Detail & Related papers (2023-05-27T07:36:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.