GR-LLMs: Recent Advances in Generative Recommendation Based on Large Language Models

• URL: http://arxiv.org/abs/2507.06507v2
• Date: Mon, 14 Jul 2025 07:46:11 GMT
• Title: GR-LLMs: Recent Advances in Generative Recommendation Based on Large Language Models
• Authors: Zhen Yang, Haitao Lin, Jiawei xue, Ziji Zhang,
• Abstract summary: Generative Recommendations (GRs) have undergone substantial advancements, especially in leveraging the powerful sequence modeling and reasoning capabilities of Large Language Models (LLMs) to enhance overall recommendation performance.<n>LLMs-based GRs are forming a new paradigm that is distinctly different from discriminative recommendations, showing strong potential to replace traditional recommendation systems heavily dependent on complex hand-crafted features.
• Score: 13.550887796404943
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the past year, Generative Recommendations (GRs) have undergone substantial advancements, especially in leveraging the powerful sequence modeling and reasoning capabilities of Large Language Models (LLMs) to enhance overall recommendation performance. LLM-based GRs are forming a new paradigm that is distinctly different from discriminative recommendations, showing strong potential to replace traditional recommendation systems heavily dependent on complex hand-crafted features. In this paper, we provide a comprehensive survey aimed at facilitating further research of LLM-based GRs. Initially, we outline the general preliminaries and application cases of LLM-based GRs. Subsequently, we introduce the main considerations when LLM-based GRs are applied in real industrial scenarios. Finally, we explore promising directions for LLM-based GRs. We hope that this survey contributes to the ongoing advancement of the GR domain.

Related papers

• Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs [69.10441885629787]
  Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge.<n>It falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches often hallucinate or mis-ground facts.<n>This survey synthesizes both strands under a unified reasoning-retrieval perspective.
  arXiv  Detail & Related papers  (2025-07-13T03:29:41Z)
• General-Reasoner: Advancing LLM Reasoning Across All Domains [64.70599911897595]
  Reinforcement learning (RL) has recently demonstrated strong potential in enhancing the reasoning capabilities of large language models (LLMs)<n>We propose General-Reasoner, a novel training paradigm designed to enhance LLM reasoning capabilities across diverse domains.<n>We train a series of models and evaluate them on a wide range of datasets covering wide domains like physics, chemistry, finance, electronics etc.
  arXiv  Detail & Related papers  (2025-05-20T17:41:33Z)
• Alleviating LLM-based Generative Retrieval Hallucination in Alipay Search [14.769809465812587]
  Generative retrieval (GR) has revolutionized document retrieval with the advent of large language models (LLMs)<n>We propose an optimized GR framework designed to alleviate retrieval hallucination.<n>We employ LLMs to assess and reason GR retrieved query-document (q-d) pairs, and then distill the reasoning data as transferred knowledge to the GR model.
  arXiv  Detail & Related papers  (2025-03-27T02:36:48Z)
• Generative Large Recommendation Models: Emerging Trends in LLMs for Recommendation [85.52251362906418]
  This tutorial explores two primary approaches for integrating large language models (LLMs)<n>It provides a comprehensive overview of generative large recommendation models, including their recent advancements, challenges, and potential research directions.<n>Key topics include data quality, scaling laws, user behavior mining, and efficiency in training and inference.
  arXiv  Detail & Related papers  (2025-02-19T14:48:25Z)
• Large Language Model Enhanced Recommender Systems: A Survey [31.31030891846837]
  This paper presents a survey of the latest research efforts aimed at leveraging Large Language Model (LLM) to enhance recommender systems (RS)<n>We identify a critical shift in the field with the move towards incorporating LLM into the online system, notably by avoiding their use during inference.
  arXiv  Detail & Related papers  (2024-12-18T02:07:21Z)
• Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyond [41.08716571288641]
  We introduce a novel taxonomy that originates from the intrinsic essence of recommendation. We propose a three-tier structure that more accurately reflects the developmental progression of recommendation systems.
  arXiv  Detail & Related papers  (2024-10-10T08:22:04Z)
• Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation [51.8188846284153]
  Attributed Text Generation (ATG) is proposed to enhance credibility and verifiability in RAG systems.<n>This paper proposes ReClaim, a fine-grained ATG method that alternates the generation of references and answers step by step.<n>With extensive experiments, we verify the effectiveness of ReClaim in extensive settings, achieving a citation accuracy rate of 90%.
  arXiv  Detail & Related papers  (2024-07-01T20:47:47Z)
• Large Language Models for Generative Recommendation: A Survey and Visionary Discussions [41.00546572485054]
  Large language models (LLM) have the potential to reshape many other fields, e.g., recommender systems (RS) This survey reviews the progress, methods, and future directions of LLM-based generative recommendation.
  arXiv  Detail & Related papers  (2023-09-03T12:33:47Z)
• LLMRec: Benchmarking Large Language Models on Recommendation Task [54.48899723591296]
  The application of Large Language Models (LLMs) in the recommendation domain has not been thoroughly investigated. We benchmark several popular off-the-shelf LLMs on five recommendation tasks, including rating prediction, sequential recommendation, direct recommendation, explanation generation, and review summarization. The benchmark results indicate that LLMs displayed only moderate proficiency in accuracy-based tasks such as sequential and direct recommendation.
  arXiv  Detail & Related papers  (2023-08-23T16:32:54Z)
• A Survey on Large Language Models for Recommendation [77.91673633328148]
  Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) This survey presents a taxonomy that categorizes these models into two major paradigms, respectively Discriminative LLM for Recommendation (DLLM4Rec) and Generative LLM for Recommendation (GLLM4Rec)
  arXiv  Detail & Related papers  (2023-05-31T13:51:26Z)
• Sparks of Artificial General Recommender (AGR): Early Experiments with ChatGPT [33.424692414746836]
  An AGR comprises both conversationality and universality to engage in natural dialogues and generate recommendations across various domains. We propose ten fundamental principles that an AGR should adhere to, each with its corresponding testing protocols. We assess whether ChatGPT, a sophisticated LLM, can comply with the proposed principles by engaging in recommendation-oriented dialogues with the model while observing its behavior.
  arXiv  Detail & Related papers  (2023-05-08T07:28:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.