Enhancing Sequential Recommender with Large Language Models for Joint Video and Comment Recommendation

• URL: http://arxiv.org/abs/2403.13574v2
• Date: Wed, 23 Jul 2025 13:55:50 GMT
• Title: Enhancing Sequential Recommender with Large Language Models for Joint Video and Comment Recommendation
• Authors: Bowen Zheng, Zihan Lin, Enze Liu, Chen Yang, Enyang Bai, Cheng Ling, Wayne Xin Zhao, Ji-Rong Wen,
• Abstract summary: We propose a novel recommendation approach called LSVCR to jointly perform personalized video and comment recommendation.<n>Our approach comprises two key components: sequential recommendation (SR) model and supplemental large language model (LLM) recommender.<n>In particular, we attain a cumulative gain of 4.13% in comment watch time.
• Score: 77.42486522565295
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Nowadays, reading or writing comments on captivating videos has emerged as a critical part of the viewing experience on online video platforms. However, existing recommender systems primarily focus on users' interaction behaviors with videos, neglecting comment content and interaction in user preference modeling. In this paper, we propose a novel recommendation approach called LSVCR that utilizes user interaction histories with both videos and comments to jointly perform personalized video and comment recommendation. Specifically, our approach comprises two key components: sequential recommendation (SR) model and supplemental large language model (LLM) recommender. The SR model functions as the primary recommendation backbone (retained in deployment) of our method for efficient user preference modeling. Concurrently, we employ a LLM as the supplemental recommender (discarded in deployment) to better capture underlying user preferences derived from heterogeneous interaction behaviors. In order to integrate the strengths of the SR model and the supplemental LLM recommender, we introduce a two-stage training paradigm. The first stage, personalized preference alignment, aims to align the preference representations from both components, thereby enhancing the semantics of the SR model. The second stage, recommendation-oriented fine-tuning, involves fine-tuning the alignment-enhanced SR model according to specific objectives. Extensive experiments in both video and comment recommendation tasks demonstrate the effectiveness of LSVCR. Moreover, online A/B testing on KuaiShou platform verifies the practical benefits of our approach. In particular, we attain a cumulative gain of 4.13% in comment watch time.

Related papers

• End-to-End Personalization: Unifying Recommender Systems with Large Language Models [0.0]
  We propose a novel hybrid recommendation framework that combines Graph Attention Networks (GATs) with Large Language Models (LLMs)<n>LLMs are first used to enrich user and item representations by generating semantically meaningful profiles based on metadata such as titles, genres, and overviews.<n>We evaluate our model on benchmark datasets, including MovieLens 100k and 1M, where it consistently outperforms strong baselines.
  arXiv  Detail & Related papers  (2025-08-02T22:46:50Z)
• Enhancing Live Broadcast Engagement: A Multi-modal Approach to Short Video Recommendations Using MMGCN and User Preferences [0.0]
  This paper develops a short video recommendation system that incorporates Multi-modal Graph Convolutional Networks (MMGCN) with user preferences.<n>In order to provide personalized recommendations tailored to individual interests, the proposed system takes into account user interaction data, video content features, and contextual information.<n>Three datasets are used to evaluate the effectiveness of the system: Kwai, TikTok, and MovieLens.
  arXiv  Detail & Related papers  (2025-06-29T04:50:52Z)
• LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendation [49.78419076215196]
  Sequential recommendation aims to predict users' future interactions by modeling collaborative filtering (CF) signals from historical behaviors of similar users or items.<n>Traditional sequential recommenders rely on ID-based embeddings, which capture CF signals through high-order co-occurrence patterns.<n>Recent advances in large language models (LLMs) have motivated text-based recommendation approaches that derive item representations from textual descriptions.<n>We argue that an ideal embedding model should seamlessly integrate CF signals with rich semantic representations to improve both in-domain and out-of-domain recommendation performance.
  arXiv  Detail & Related papers  (2025-06-16T13:27:06Z)
• REGEN: A Dataset and Benchmarks with Natural Language Critiques and Narratives [4.558818396613368]
  We extend the Amazon Product Reviews dataset by inpainting two key natural language features. The narratives include product endorsements, purchase explanations, and summaries of user preferences.
  arXiv  Detail & Related papers  (2025-03-14T23:47:46Z)
• OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignment [9.99840965933561]
  We propose OneRec, which replaces the cascaded learning framework with a unified generative model. OneRec includes: 1) an encoder-decoder structure, which encodes the user's historical behavior sequences and gradually decodes the videos that the user may be interested in.
  arXiv  Detail & Related papers  (2025-02-26T09:25:10Z)
• Collaborative Retrieval for Large Language Model-based Conversational Recommender Systems [65.75265303064654]
  Conversational recommender systems (CRS) aim to provide personalized recommendations via interactive dialogues with users.<n>Large language models (LLMs) enhance CRS with their superior understanding of context-aware user preferences.<n>We propose CRAG, Collaborative Retrieval Augmented Generation for LLM-based CRS.
  arXiv  Detail & Related papers  (2025-02-19T22:47:40Z)
• Contrastive Learning for Cold Start Recommendation with Adaptive Feature Fusion [2.2194815687410627]
  This paper proposes a cold start recommendation model that integrates contrastive learning. The model dynamically adjusts the weights of key features through an adaptive feature selection module. It integrates user attributes, item meta-information, and contextual features by combining a multimodal feature fusion mechanism.
  arXiv  Detail & Related papers  (2025-02-05T23:15:31Z)
• Interactive Visualization Recommendation with Hier-SUCB [52.11209329270573]
  We propose an interactive personalized visualization recommendation (PVisRec) system that learns on user feedback from previous interactions. For more interactive and accurate recommendations, we propose Hier-SUCB, a contextual semi-bandit in the PVisRec setting.
  arXiv  Detail & Related papers  (2025-02-05T17:14:45Z)
• RecLM: Recommendation Instruction Tuning [17.780484832381994]
  We propose a model-agnostic recommendation instruction-tuning paradigm that seamlessly integrates large language models with collaborative filtering.<n>Our proposed $underlineRec$ommendation enhances the capture of user preference diversity through a carefully designed reinforcement learning reward function.
  arXiv  Detail & Related papers  (2024-12-26T17:51:54Z)
• Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward [118.65089648651308]
  This paper introduces a novel framework that utilizes detailed video captions as a proxy of video content. We show that applying this tailored reward through DPO significantly improves the performance of video LMMs on video Question Answering (QA) tasks.
  arXiv  Detail & Related papers  (2024-04-01T17:28:16Z)
• On Generative Agents in Recommendation [58.42840923200071]
  Agent4Rec is a user simulator in recommendation based on Large Language Models. Each agent interacts with personalized recommender models in a page-by-page manner.
  arXiv  Detail & Related papers  (2023-10-16T06:41:16Z)
• VideolandGPT: A User Study on a Conversational Recommender System [0.14495144578817493]
  We introduce VideolandGPT, a recommender system for a Video-on-Demand (VOD) platform, Videoland, which uses ChatGPT to select from a predetermined set of contents. We evaluate ranking metrics, user experience, and fairness of recommendations, comparing a personalised and a non-personalised version of the system.
  arXiv  Detail & Related papers  (2023-09-07T11:24:47Z)
• Latent User Intent Modeling for Sequential Recommenders [92.66888409973495]
  Sequential recommender models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform. Most sequential recommenders however lack a higher-level understanding of user intents, which often drive user behaviors online. Intent modeling is thus critical for understanding users and optimizing long-term user experience.
  arXiv  Detail & Related papers  (2022-11-17T19:00:24Z)
• Constrained Reinforcement Learning for Short Video Recommendation [18.492477839791274]
  Short videos on social media platforms pose new challenges to optimize recommender systems. We propose a two-stage reinforcement learning approach based on actor-critic framework. Our approach has been fully launched in the production system to optimize user experiences.
  arXiv  Detail & Related papers  (2022-05-26T09:36:20Z)
• Fast Multi-Step Critiquing for VAE-based Recommender Systems [27.207067974031805]
  We present M&Ms-VAE, a novel variational autoencoder for recommendation and explanation. We train the model under a weak supervision scheme to simulate both fully and partially observed variables. We then leverage the generalization ability of a trained M&Ms-VAE model to embed the user preference and the critique separately.
  arXiv  Detail & Related papers  (2021-05-03T12:26:09Z)
• Self-Supervised Reinforcement Learning for Recommender Systems [77.38665506495553]
  We propose self-supervised reinforcement learning for sequential recommendation tasks. Our approach augments standard recommendation models with two output layers: one for self-supervised learning and the other for RL. Based on such an approach, we propose two frameworks namely Self-Supervised Q-learning(SQN) and Self-Supervised Actor-Critic(SAC)
  arXiv  Detail & Related papers  (2020-06-10T11:18:57Z)
• MetaSelector: Meta-Learning for Recommendation with User-Level Adaptive Model Selection [110.87712780017819]
  We propose a meta-learning framework to facilitate user-level adaptive model selection in recommender systems. We conduct experiments on two public datasets and a real-world production dataset.
  arXiv  Detail & Related papers  (2020-01-22T16:05:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.