EmbSum: Leveraging the Summarization Capabilities of Large Language Models for Content-Based Recommendations

• URL: http://arxiv.org/abs/2405.11441v2
• Date: Mon, 19 Aug 2024 08:50:54 GMT
• Title: EmbSum: Leveraging the Summarization Capabilities of Large Language Models for Content-Based Recommendations
• Authors: Chiyu Zhang, Yifei Sun, Minghao Wu, Jun Chen, Jie Lei, Muhammad Abdul-Mageed, Rong Jin, Angli Liu, Ji Zhu, Sem Park, Ning Yao, Bo Long,
• Abstract summary: We introduce EmbSum, a framework that enables offline pre-computations of users and candidate items. The model's ability to generate summaries of user interests serves as a valuable by-product, enhancing its usefulness for personalized content recommendations.
• Score: 38.44534579040017
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Content-based recommendation systems play a crucial role in delivering personalized content to users in the digital world. In this work, we introduce EmbSum, a novel framework that enables offline pre-computations of users and candidate items while capturing the interactions within the user engagement history. By utilizing the pretrained encoder-decoder model and poly-attention layers, EmbSum derives User Poly-Embedding (UPE) and Content Poly-Embedding (CPE) to calculate relevance scores between users and candidate items. EmbSum actively learns the long user engagement histories by generating user-interest summary with supervision from large language model (LLM). The effectiveness of EmbSum is validated on two datasets from different domains, surpassing state-of-the-art (SoTA) methods with higher accuracy and fewer parameters. Additionally, the model's ability to generate summaries of user interests serves as a valuable by-product, enhancing its usefulness for personalized content recommendations.

Related papers

• LLM-assisted Explicit and Implicit Multi-interest Learning Framework for Sequential Recommendation [50.98046887582194]
  We propose an explicit and implicit multi-interest learning framework to model user interests on two levels: behavior and semantics. The proposed EIMF framework effectively and efficiently combines small models with LLM to improve the accuracy of multi-interest modeling.
  arXiv  Detail & Related papers  (2024-11-14T13:00:23Z)
• UserSumBench: A Benchmark Framework for Evaluating User Summarization Approaches [25.133460380551327]
  Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and are invaluable for personalization applications. However, the development of new summarization techniques is hindered by the lack of ground-truth labels, the inherent subjectivity of user summaries, and human evaluation.
  arXiv  Detail & Related papers  (2024-08-30T01:56:57Z)
• InteraRec: Screenshot Based Recommendations Using Multimodal Large Language Models [0.6926105253992517]
  We introduce a sophisticated and interactive recommendation framework denoted as InteraRec. InteraRec captures high-frequency screenshots of web pages as users navigate through a website. We demonstrate the effectiveness of InteraRec in providing users with valuable and personalized offerings.
  arXiv  Detail & Related papers  (2024-02-26T17:47:57Z)
• Breaking the Barrier: Utilizing Large Language Models for Industrial Recommendation Systems through an Inferential Knowledge Graph [19.201697767418597]
  We propose a novel Large Language Model based Complementary Knowledge Enhanced Recommendation System (LLM-KERec) It extracts unified concept terms from item and user information to capture user intent transitions and adapt to new items. Extensive experiments conducted on three industry datasets demonstrate the significant performance improvement of our model compared to existing approaches.
  arXiv  Detail & Related papers  (2024-02-21T12:22:01Z)
• SPAR: Personalized Content-Based Recommendation via Long Engagement Attention [43.04717491985609]
  Leveraging users' long engagement histories is essential for personalized content recommendations. We introduce a content-based recommendation framework, SPAR, which effectively tackles the challenges of holistic user interest extraction. Our framework outperforms existing state-of-the-art (SoTA) methods.
  arXiv  Detail & Related papers  (2024-02-16T10:36:38Z)
• MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation [61.45986275328629]
  We propose MISSRec, a multi-modal pre-training and transfer learning framework for sequential recommendation. On the user side, we design a Transformer-based encoder-decoder model, where the contextual encoder learns to capture the sequence-level multi-modal user interests. On the candidate item side, we adopt a dynamic fusion module to produce user-adaptive item representation.
  arXiv  Detail & Related papers  (2023-08-22T04:06:56Z)
• Latent User Intent Modeling for Sequential Recommenders [92.66888409973495]
  Sequential recommender models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform. Most sequential recommenders however lack a higher-level understanding of user intents, which often drive user behaviors online. Intent modeling is thus critical for understanding users and optimizing long-term user experience.
  arXiv  Detail & Related papers  (2022-11-17T19:00:24Z)
• GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce [13.142842265419262]
  Our goal is to build general representation (embedding) for each user and each product item across Alibaba's businesses. Inspired by the BERT model in natural language processing (NLP) domain, we propose a GUIM (General User Item embedding with Mixture of representation) model. We utilize mixture of representation (MoR) as a novel representation form to model the diverse interests of each user.
  arXiv  Detail & Related papers  (2022-07-02T06:27:54Z)
• PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterest [54.56236567783225]
  PinnerSage is an end-to-end recommender system that represents each user via multi-modal embeddings. We conduct several offline and online A/B experiments to show that our method significantly outperforms single embedding methods.
  arXiv  Detail & Related papers  (2020-07-07T17:13:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.