EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment

• URL: http://arxiv.org/abs/2608.14011v1
• Date: Fri, 14 Aug 2026 06:59:12 GMT
• Title: EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment
• Abstract summary: Generative recommendation autoregressively generates the semantic IDs of the target item, unifying preference modeling and index retrieval within the shared token space.<n>Recent attempts have introduced Multi-Token Prediction (MTP), yet they primarily inherit its efficiency merit, leaving its potential as dense supervision unexplored.<n>We propose EchoRec, which empowers MTP with cycle-consistent holistic preference alignment across multi-horizon for generative recommendation.
• Score: 57.08595331216049
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative recommendation autoregressively generates the semantic IDs of the target item, unifying preference modeling and index retrieval within the shared token space. Recent attempts have introduced Multi-Token Prediction (MTP) into this field, yet they primarily inherit its efficiency merit, leaving its potential as dense supervision unexplored. Unlocking this potential hinges on whether future behaviors qualify as informative supervision. Our analysis reveals that future behaviors carry a semantic echo of the current one far above that of random pairs, which nevertheless decays along horizons under intent transitions, making them informative yet order-dependent signals. Motivated by this, we propose EchoRec, which empowers MTP with cycle-consistent holistic preference alignment across multi-horizon for generative recommendation. It comprises two synergistic modules. Horizon-aware Preference Generation (HPG) sequentially chains lightweight auxiliary branches upon the base recommender, where each branch conditions on its predecessor to respect preference evolution. Verifiable Holistic-Preference Alignment (VHA) further consolidates them into the holistic preference and echoes it back through cycle-consistent projectors to suppress spurious alignment, with theoretical guarantees that exclude the rank-collapse form of spurious alignment under an invertible transport, enabling the holistic preference to be retained in the decoding representation. All auxiliary components serve as disposable scaffolding discarded at inference, introducing negligible online serving overhead. Extensive experiments on three datasets demonstrate the superiority of our EchoRec, together with its naturally acquired multi-item generation ability. Our code and datasets will be available upon acceptance.

Related papers

• Collaborative Memory Augmentation for Generative Recommendation [49.76630658239287]
  We propose textbfOMEGA, a cOllaborative MEmory augmentation framework for Generative recommendAtion.<n>We first introduce a latent context compression method that utilizes learnable query tokens to distill sequential user behavior into compact representations.<n>These compressed representations are aggregated into a collaborative memory bank, serving as an explicit repository of global behavioral patterns.
  arXiv  Detail & Related papers  (2026-08-02T15:34:43Z)
• Hierarchical Residual Policy Optimization for Generative Recommendations [46.030303420508254]
  We propose a post-training framework that converts item-level outcomes into dense, token-aligned learning signals.<n>Experiments on a public dataset and an online A/B test in a large-scale commercial system show consistent gains in session-level utility and key business metrics.
  arXiv  Detail & Related papers  (2026-08-01T16:33:15Z)
• Guess Where You Go: Generative Next Point-of-Interest Recommendation in Amap [12.259216278301743]
  We propose an end-to-end industrial framework that integrates semantic identifier (SID) generation with generative Point-of-Interest (POI) recommendation.<n>Gwhere is deployed in Amap's homepage service under high-concurrency and low-latency constraints.<n>Long-term online A/B tests show improvements of 5.83% in P-CTR and 6.20% in U-CTR over the production baseline.
  arXiv  Detail & Related papers  (2026-07-13T15:44:06Z)
• HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation [57.802158017741824]
  HoloRec is an endogenous chain-of-thought recommendation mechanism that unifies representation, reasoning, and generation.<n> Experiments on multiple public recommendation datasets demonstrate that HoloRec consistently outperforms baselines.
  arXiv  Detail & Related papers  (2026-06-13T14:52:03Z)
• RAGR: Review-Augmented Generative Recommendation [61.29879991713178]
  Review-Augmented Generative Recommendation (RAGR) is a novel GR framework that incorporates review feedback directly into the generative user sequence.<n>RAGR yields consistent and significant gains over strong GR backbones across all metrics.
  arXiv  Detail & Related papers  (2026-05-17T05:21:23Z)
• Asymmetric Generative Recommendation via Multi-Expert Projection and Multi-Faceted Hierarchical Quantization [39.92412918837748]
  AsymRec is an asymmetric continuous-discrete framework that decouples input and output representations.<n>It consistently outperforms state-of-the-art generative recommenders by an average of 15.8 %.
  arXiv  Detail & Related papers  (2026-05-14T07:55:43Z)
• Empowering Contrastive Federated Sequential Recommendation with LLMs [13.016120865205258]
  Federated sequential recommendation (FedSeqRec) aims to perform next-item prediction while keeping user data decentralised.<n>We propose textbfLUMOS, a parameter-isolated FedSeqRec architecture that integrates large language models (LLMs) as emphlocal semantic generators.
  arXiv  Detail & Related papers  (2026-02-10T00:47:43Z)
• Generative Chain of Behavior for User Trajectory Prediction [21.55902608247895]
  Generative Chain of Behavior (GCB) is a generative framework that models user interactions as an autoregressive chain of semantic behaviors over multiple future steps.<n>GCB consistently outperforms state-of-the-art sequential recommenders in multi-step accuracy and trajectory consistency.
  arXiv  Detail & Related papers  (2026-01-26T06:57:31Z)
• MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation [61.45986275328629]
  We propose MISSRec, a multi-modal pre-training and transfer learning framework for sequential recommendation. On the user side, we design a Transformer-based encoder-decoder model, where the contextual encoder learns to capture the sequence-level multi-modal user interests. On the candidate item side, we adopt a dynamic fusion module to produce user-adaptive item representation.
  arXiv  Detail & Related papers  (2023-08-22T04:06:56Z)
• Sequential Recommendation with Controllable Diversification: Representation Degeneration and Diversity [59.24517649169952]
  We argue that the representation degeneration issue is the root cause of insufficient recommendation diversity in existing SR methods. We propose a novel Singular sPectrum sMoothing regularization for Recommendation (SPMRec), which acts as a controllable surrogate to alleviate the degeneration.
  arXiv  Detail & Related papers  (2023-06-21T02:42:37Z)
• Sequential Recommendation via Stochastic Self-Attention [68.52192964559829]
  Transformer-based approaches embed items as vectors and use dot-product self-attention to measure the relationship between items. We propose a novel textbfSTOchastic textbfSelf-textbfAttention(STOSA) to overcome these issues. We devise a novel Wasserstein Self-Attention module to characterize item-item position-wise relationships in sequences.
  arXiv  Detail & Related papers  (2022-01-16T12:38:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.