TSGR: Taobao Search Generative Retrieval

• URL: http://arxiv.org/abs/2607.18796v2
• Date: Wed, 22 Jul 2026 08:19:23 GMT
• Title: TSGR: Taobao Search Generative Retrieval
• Abstract summary: We propose a unified generative retrieval framework that incorporates value awareness into both item representation and candidate ranking.<n>$textbfT$aobao $textbfS$earch $textbfG$enerative $textbfR$etrieval ($textbfTSGR$)<n>$textbfVRM$ that is built upon and jointly optimized with the GR, enabling a single model to seamlessly serve as both retriever and pre-ranker.
• Score: 32.4338892898415
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative retrieval (GR) has demonstrated strong promise for industrial e-commerce search by training a single autoregressive model to directly generate the Semantic IDs (SIDs) of target items. However, existing GR systems are primarily optimized for semantic matching and remain insensitive to item business value: SID construction is value-unaware, and candidates are ranked without access to item side-info. Consequently, high-value items are often missed or deprioritized at the retrieval stage, limiting downstream business impact. This limitation is particularly critical in industrial settings such as Taobao Search, where business objectives are central to system design. To address this, we propose $\textbf{T}$aobao $\textbf{S}$earch $\textbf{G}$enerative $\textbf{R}$etrieval ($\textbf{TSGR}$), a unified generative retrieval framework that incorporates value awareness into both item representation and candidate ranking. 1) For item representation, TSGR introduces $\textbf{Query-aware Parallel SID (QP-SID)}$, which encodes query-conditioned value orderings into the SID construction by building parallel codebooks derived from query-item statistics, so that higher-value and query-relevant items are assigned better token indices. 2) For candidate ranking, we introduce a $\textbf{Value-aware Ranking Module (VRM)}$ that is built upon and jointly optimized with the GR, enabling a single model to seamlessly serve as both retriever and pre-ranker without a dedicated pre-ranking stage. A progressive training pipeline further aligns the model with semantic relevance, user preferences, and business objectives. Offline experiments show that TSGR achieves a 9.16\% improvement in HR@1000, and online A/B tests further validate its effectiveness, yielding gains of +0.43\% in IPV, +1.12\% in Transaction Count, and +1.64\% in GMV. TSGR has been fully deployed in production.

Related papers

• VARG: Value-Aware and Ranking-Aligned Generative Retrieval for Dynamic E-commerce Search [7.64283018838172]
  VARG is a generative retrieval system for Tmall App search that directly admits generated item candidates to the existing final ranker.<n>Three-stage supervised fine-tuning progressively learns item-to-identifier mappings, query-semantic retrieval, and personalized retrieval.<n>Prefix-GRPO combines gated rewards based on output legality, user behavior, ranker advantage, and search relevance with prefix-aware token weighting to align candidate generation with business value and ranking objectives.
  arXiv  Detail & Related papers  (2026-09-13T12:59:04Z)
• It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning [3.106071998555287]
  CoGR trains generators to construct retrieval representations on both query and item sides.<n>Each generator produces a compact set of keywords, which are matched directly through an inverted index.<n>CoGR achieves the best performance on both an internal APP Marketplace dataset and the public WANDS benchmark.
  arXiv  Detail & Related papers  (2026-09-01T03:17:02Z)
• Preference Shapes Relevance: Cross-component Hierarchical Semantic Alignment for Personalized Generative Retrieval [37.821022474615994]
  Generative Retrieval (GR) has emerged as a promising paradigm by mapping queries directly to Semantic IDs (SIDs) with powerful representation capabilities for candidate items.<n>Existing SIDs derived solely from item content create a semantic gap, failing to align dynamic query intents with static item representations.<n>We present a novel personalized GR framework that models user behavior by synergizing discrete SIDs for structural guidance and continuous representations for fine-grained semantic refinement.
  arXiv  Detail & Related papers  (2026-08-31T10:30:22Z)
• ICEGR: An Intent-Coherent End-to-End Generative Retrieval Framework for E-commerce Search [26.387550337217125]
  Generative Retrieval (GR) is promising for e-commerce search.<n>Existing methods struggle to maintain query-intent consistency throughout the training pipeline.<n>We propose ICEGR, an Intent-Coherent End-to-End Generative Retrieval Framework for E-commerce Search.
  arXiv  Detail & Related papers  (2026-08-30T08:28:58Z)
• Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL [8.046510111008638]
  Generative retrieval offers a promising alternative by unifying the fragmented multi-stage retrieval process into a single end-to-end model.<n>We propose a retrieval framework tailored for real-world recall scenarios, positioning generative retrieval as a recall-stage supplement rather than an end-to-end replacement.
  arXiv  Detail & Related papers  (2026-05-14T06:27:46Z)
• PAR$^2$-RAG: Planned Active Retrieval and Reasoning for Multi-Hop Question Answering [57.89576196160413]
  Large language models (LLMs) remain brittle on multi-hop question answering (MHQA)<n>We propose textbfPlanned Active Retrieval and Reasoning RAG (PAR$2$-RAG), a two-stage framework that separates emphcoverage from emphcommitment.
  arXiv  Detail & Related papers  (2026-03-30T23:52:54Z)
• Multi-Step Semantic Reasoning in Generative Retrieval [50.65947993017158]
  Generative retrieval (GR) models encode a corpus within model parameters and generate relevant document identifiers for a given query.<n>Existing GR models struggle with complex queries in numerical contexts, such as those involving semantic reasoning over financial reports.<n>We propose ReasonGR, a framework designed to enhance multi-step semantic reasoning in numerical contexts within GR.
  arXiv  Detail & Related papers  (2026-03-12T18:38:50Z)
• TeaRAG: A Token-Efficient Agentic Retrieval-Augmented Generation Framework [62.66056331998838]
  TeaRAG is a token-efficient agentic RAG framework capable of compressing both retrieval content and reasoning steps.<n>Our reward function evaluates the knowledge sufficiency by a knowledge matching mechanism, while penalizing excessive reasoning steps.
  arXiv  Detail & Related papers  (2025-11-07T16:08:34Z)
• Understanding Generative Recommendation with Semantic IDs from a Model-scaling View [57.471604518714535]
  Generative Recommendation (GR) tries to unify rich item semantics and collaborative filtering signals.<n>One popular modern approach is to use semantic IDs (SIDs) to represent items in an autoregressive user interaction sequence modeling setup.<n>We show that SID-based GR shows significant bottlenecks while scaling up the model.<n>We revisit another GR paradigm that directly uses large language models (LLMs) as recommenders.
  arXiv  Detail & Related papers  (2025-09-29T21:24:17Z)
• FORGE: Forming Semantic Identifiers for Generative Retrieval in Industrial Datasets [64.51403245281547]
  FORGE is a benchmark for FOrming semantic identifieR in Generative rEtrieval with industrial datasets.<n>For real-world applications, FORGE introduces an offline pretraining schema that reduces online convergence by half.
  arXiv  Detail & Related papers  (2025-09-25T08:44:22Z)
• OneSearch: A Preliminary Exploration of the Unified End-to-End Generative Framework for E-commerce Search [43.94443394870866]
  OneSearch is the first industrial-deployed end-to-end generative framework for e-commerce search.<n>OneSearch reduces operational expenditure by 75.40% and improves Model FLOPs Utilization from 3.26% to 27.32%.<n>The system has been successfully deployed across multiple search scenarios in Kuaishou, serving millions of users.
  arXiv  Detail & Related papers  (2025-09-03T11:50:04Z)
• ImpRAG: Retrieval-Augmented Generation with Implicit Queries [34.72864597562907]
  ImpRAG is a query-free RAG system that integrates retrieval and generation into a unified model.<n>We show that ImpRAG achieves 3.6-11.5 improvements in exact match scores on unseen tasks with diverse formats.
  arXiv  Detail & Related papers  (2025-06-02T21:38:21Z)
• CART: A Generative Cross-Modal Retrieval Framework with Coarse-To-Fine Semantic Modeling [53.97609687516371]
  Cross-modal retrieval aims to search for instances, which are semantically related to the query through the interaction of different modal data.<n>Traditional solutions utilize a single-tower or dual-tower framework to explicitly compute the score between queries and candidates.<n>We propose a generative cross-modal retrieval framework (CART) based on coarse-to-fine semantic modeling.
  arXiv  Detail & Related papers  (2024-06-25T12:47:04Z)
• Distillation Enhanced Generative Retrieval [96.69326099136289]
  Generative retrieval is a promising new paradigm in text retrieval that generates identifier strings of relevant passages as the retrieval target. In this work, we identify a viable direction to further enhance generative retrieval via distillation and propose a feasible framework, named DGR. We conduct experiments on four public datasets, and the results indicate that DGR achieves state-of-the-art performance among the generative retrieval methods.
  arXiv  Detail & Related papers  (2024-02-16T15:48:24Z)
• Recommender Systems with Generative Retrieval [58.454606442670034]
  We propose a novel generative retrieval approach, where the retrieval model autoregressively decodes the identifiers of the target candidates. To that end, we create semantically meaningful of codewords to serve as a Semantic ID for each item. We show that recommender systems trained with the proposed paradigm significantly outperform the current SOTA models on various datasets.
  arXiv  Detail & Related papers  (2023-05-08T21:48:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.