Restoring Collaborative Signals in Semantic-ID Generative Recommendation via Personalized Natural Language

• URL: http://arxiv.org/abs/2607.27682v1
• Date: Thu, 30 Jul 2026 04:58:22 GMT
• Title: Restoring Collaborative Signals in Semantic-ID Generative Recommendation via Personalized Natural Language
• Abstract summary: LLM-based generative recommendation models cast recommendation as autoregressively generating an item's semantic-ID (SID)<n>This setting verbalizes the model's knowledge poorly, and text and SID tokens live in misaligned embedding spaces.<n>We propose a framework, guided by personalized natural language, that adds hierarchical collaborative cues as the model generates.
• Score: 14.28332940068789
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Making LLM-based generative recommendation models stronger and more personalized through natural language and explicit reasoning is a widely anticipated yet still unsolved goal. Such models cast recommendation as autoregressively generating an item's semantic-ID (SID), a short tuple of discrete codes, so that recommending well reduces to emitting the right SID. In this setting the model verbalizes its knowledge poorly, and text and SID tokens live in misaligned embedding spaces. Deep reasoning therefore rarely turns into a correct SID, and enabling explicit "thinking" often gives no gain or even hurts. The deeper cause is that a compact SID cannot hold content and collaborative signal at once: the two compete, and collaboration loses. Because a mis-predicted SID is a wrong recommendation, this caps accuracy directly. Costly multi-round training barely helps, and few methods try to supply the missing signal at inference time. What is missing is a reliable channel that carries collaborative signal into SID generation. We therefore propose a framework, guided by personalized natural language, that adds hierarchical collaborative cues as the model generates, without altering the backbone or retraining the SIDs. Rather than mapping language onto SIDs directly, it uses language to attach analyzable links between collaborative patterns and their audiences, restoring the collaborative signal that SIDs miss. The result is consistent gains in recommendation accuracy, grounding generation in collaborative structure at inference time rather than relying on explicit reasoning or retraining.

Related papers

• Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation [28.83516611687355]
  We propose Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation (LGRID)<n>LGRID introduces a generative disentanglement paradigm through an Encode -> Disentangle -> Align -> Quantize pipeline.<n> Experiments on Kuaishou and Foursquare show that LGRID consistently outperforms strong SID baselines.
  arXiv  Detail & Related papers  (2026-07-30T09:52:18Z)
• CogRec: Structure-Cognitive Fast-and-Slow Reasoning for Generative Recommendation [29.663400191042996]
  CogRec is a structure-cognitive fast-and-slow reasoning framework.<n>CogRec augments the vertical SID hierarchy with intra-layer semantic graphs and item-level neighborhoods.<n> SID Routing represents recommendation reasoning through layer-wise Match, LateralJump, and Explore operations.
  arXiv  Detail & Related papers  (2026-07-27T13:19:55Z)
• DREAM: Dynamic Refinement of Early Assignment Mappings [7.781421530363403]
  Current methods assign each item a single static identifier through offline tokenization before sufficient user feedback is observed.<n>We identify this one-shot commitment as the fundamental cold-start bottleneck in SID-based generative recommendation.<n>We propose DREAM, a three-stage framework that resolves this flaw through progressive refinement.
  arXiv  Detail & Related papers  (2026-06-05T06:21:01Z)
• Mitigating Collaborative Semantic ID Staleness in Generative Retrieval [0.0]
  Generative retrieval with Semantic IDs (SIDs) assigns each item a discrete identifier and treats retrieval as a sequence generation problem.<n>As interaction patterns drift over time, SIDs become stale, i.e., their collaborative semantics no longer match recent logs.<n>We propose a lightweight, model-agnostic SID alignment update.
  arXiv  Detail & Related papers  (2026-04-14T20:06:48Z)
• Reasoning over Semantic IDs Enhances Generative Recommendation [56.83043583765322]
  We propose a two-stage framework that elicits reasoning over SIDs by strengthening SID--language alignment.<n> SIDReasoner further improves recommendation reasoning through outcome-driven reinforced optimization.<n>Our experiments on three real-world datasets demonstrate the effectiveness of our reasoning-augmented SID-based generative recommendation.
  arXiv  Detail & Related papers  (2026-03-24T13:31:48Z)
• Differentiable Semantic ID for Generative Recommendation [65.83703273297492]
  Generative recommendation provides a novel paradigm in which each item is represented by a discrete semantic ID (SID) learned from rich content.<n>In practice, SIDs are typically optimized only for content reconstruction rather than recommendation accuracy.<n>A natural approach is to make semantic indexing differentiable so that recommendation gradients can directly influence SID learning.<n>We propose DIGER, a first step toward effective differentiable semantic IDs for generative recommendation.
  arXiv  Detail & Related papers  (2026-01-27T15:34:11Z)
• The Best of the Two Worlds: Harmonizing Semantic and Hash IDs for Sequential Recommendation [51.62815306481903]
  We propose textbfname, a novel framework that harmonizes the SID and HID. Specifically, we devise a dual-branch modeling architecture that enables the model to capture both the multi-granular semantics within SID while preserving the unique collaborative identity of HID.<n>Experiments on three real-world datasets show that name balances recommendation quality for both head and tail items while surpassing the existing baselines.
  arXiv  Detail & Related papers  (2025-12-11T07:50:53Z)
• DiffGRM: Diffusion-based Generative Recommendation Model [63.35379395455103]
  Generative recommendation (GR) is an emerging paradigm that represents each item via a tokenizer as an n-digit semantic ID (SID)<n>We propose DiffGRM, a diffusion-based GR model that replaces the autoregressive decoder with a masked discrete diffusion model (MDM)<n> Experiments show consistent gains over strong generative and discriminative recommendation baselines on multiple datasets.
  arXiv  Detail & Related papers  (2025-10-21T03:23:32Z)
• EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration [60.47645731801866]
  Large language models (LLMs) are increasingly leveraged as foundational backbones in advanced recommender systems.<n>LLMs are pre-trained linguistic semantics but learn collaborative semantics from scratch via the llm-Backbone.<n>We propose EAGER-LLM, a decoder-only generative recommendation framework that integrates endogenous and endogenous behavioral and semantic information in a non-intrusive manner.
  arXiv  Detail & Related papers  (2025-02-20T17:01:57Z)
• Learnable Item Tokenization for Generative Recommendation [113.80559032128065]
  We propose LETTER (a LEarnable Tokenizer for generaTivE Recommendation), which integrates hierarchical semantics, collaborative signals, and code assignment diversity.<n> LETTER incorporates Residual Quantized VAE for semantic regularization, a contrastive alignment loss for collaborative regularization, and a diversity loss to mitigate code assignment bias.
  arXiv  Detail & Related papers  (2024-05-12T15:49:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.