SID-Coord: Coordinating Semantic IDs for ID-based Ranking in Short-Video Search

• URL: http://arxiv.org/abs/2604.10471v1
• Date: Sun, 12 Apr 2026 05:51:35 GMT
• Title: SID-Coord: Coordinating Semantic IDs for ID-based Ranking in Short-Video Search
• Abstract summary: We propose SID-Coord, a lightweight Semantic ID framework that incorporates discrete, trainable semantic IDs directly into ID-based ranking models.<n>Instead of treating semantic signals as auxiliary dense features, SID-Coord represents semantics as structured identifiers.<n>Online A/B experiments in a real-world production environment show statistically significant improvements.
• Score: 9.72713305999446
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large-scale short-video search ranking models are typically trained on sparse co-occurrence signals over hashed item identifiers (HIDs). While effective at memorizing frequent interactions, such ID-based models struggle to generalize to long-tailed items with limited exposure. This memorization-generalization trade-off remains a longstanding challenge in such industrial systems. We propose SID-Coord, a lightweight Semantic ID framework that incorporates discrete, trainable semantic IDs (SIDs) directly into ID-based ranking models. Instead of treating semantic signals as auxiliary dense features, SID-Coord represents semantics as structured identifiers and coordinates HID-based memorization with SID-based generalization within a unified modeling framework. To enable effective coordination, SID-Coord introduces three components: (1) an attention-based fusion module over hierarchical SIDs to capture multi-level semantics, (2) a target-aware HID-SID gating mechanism that adaptively balances memorization and generalization, and (3) a SID-driven interest alignment module that models the semantic similarity distribution between target items and user histories. SID-Coord can be integrated into existing production ranking systems without modifying the backbone model. Online A/B experiments in a real-world production environment show statistically significant improvements, with a +0.664% gain in long-play rate in search and a +0.369% increase in search playback duration.

Related papers

• HF-SID: High-Fidelity Semantic IDs for Generative Retrieval in Location-Based Services [6.767079940213956]
  Generative retrieval has attracted increasing attention in Location-Based Services (LBS), where each Point-of-Interest (POI) is represented as a Semantic ID (SID)<n>We propose HF-SID, which restores geographic, numerical, and structural fidelity at the representation stage, before any information is committed to a discrete code.<n>Because these mechanisms enrich the representation rather than lengthen the representation, HF-SID uses a 3-token identifier SID at no extra decoding cost.
  arXiv  Detail & Related papers  (2026-08-31T09:05:09Z)
• TopoGR: Revealing and Preserving Latent Structure of Semantic ID in Generative Recommendation [25.345503799250476]
  TopoGR is a topology-preserving generative recommendation framework based on Bit-decomposable Semantic ID( Binary SID)<n>We show that TopoGR consistently outperforms existing state-of-the-art baselines in recommendation performance.
  arXiv  Detail & Related papers  (2026-07-28T02:45:33Z)
• Beyond Fixed Depths and Widths: Optimizing Textual Decoding Tries in LLM-based Generative Recommendation [59.20704286413859]
  We propose a novel framework that co-designs textual term IDs and their underlying decoding trie.<n> BONSAI achieves up to a 21.6% relative improvement over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-07-18T04:31:02Z)
• Conditional Memory Enhanced Item Representation for Generative Recommendation [46.59623438612085]
  Generative recommendation (GR) has emerged as a promising paradigm that predicts target items by autoregressively generating their semantic identifiers (SID)<n>Most GR methods follow a quantization-representation-generation pipeline, first assigning each item a SID, then constructing input representations from SID-token embeddings, and finally predicting the target SID through autoregressive generation.<n>We propose ComeIR, a Conditional Memory enhanced Item Representation framework that reconstructs SID-token embeddings into item-aware inputs and restores the token granularity during SID decoding.
  arXiv  Detail & Related papers  (2026-05-12T02:56:59Z)
• Semantic IDs for Recommender Systems at Snapchat: Use Cases, Technical Challenges, and Design Choices [39.95009019603262]
  We discuss practical technical challenges we encountered while applying Semantic IDs (SIDs) at Snapchat.<n>SIDs have drastically smaller cardinality than the atomic counterpart, and induce semantic clustering in the ID space.<n>We apply SIDs as auxiliary features for ranking models, and also explore SIDs as additional retrieval sources in different ML applications.
  arXiv  Detail & Related papers  (2026-04-05T03:46:52Z)
• IntRR: A Framework for Integrating SID Redistribution and Length Reduction [14.327886721362647]
  We propose IntRR, a novel framework that integrates objective-aligned SID Redistribution and structural Length Reduction.<n>IntRR yields substantial improvements over representative generative baselines, achieving superior performance in both recommendation accuracy and efficiency.
  arXiv  Detail & Related papers  (2026-02-24T09:09:40Z)
• End-to-End Semantic ID Generation for Generative Advertisement Recommendation [33.453121305193434]
  We propose a Unified SID generation framework for generative advertisement recommendation.<n>Specifically, we jointly optimize embeddings and SIDs in an end-to-end manner from raw advertising data.<n>Experiments demonstrate that UniSID consistently outperforms state-of-the-art SID generation methods.
  arXiv  Detail & Related papers  (2026-02-11T02:38:26Z)
• The Best of the Two Worlds: Harmonizing Semantic and Hash IDs for Sequential Recommendation [51.62815306481903]
  We propose textbfname, a novel framework that harmonizes the SID and HID. Specifically, we devise a dual-branch modeling architecture that enables the model to capture both the multi-granular semantics within SID while preserving the unique collaborative identity of HID.<n>Experiments on three real-world datasets show that name balances recommendation quality for both head and tail items while surpassing the existing baselines.
  arXiv  Detail & Related papers  (2025-12-11T07:50:53Z)
• Enhancing Embedding Representation Stability in Recommendation Systems with Semantic ID [29.560370412849874]
  This paper introduces Semantic ID prefix ngram, a novel token parameterization technique that significantly improves the performance of the original Semantic ID.<n>We show that Semantic ID prefix ngram not only addresses embedding instability but also significantly improves tail id modeling, reduces overfitting, and mitigates representation shifts.<n>We also report our experience of integrating Semantic ID into Meta production Ads Ranking system, leading to notable performance gains and enhanced prediction stability in live deployments.
  arXiv  Detail & Related papers  (2025-04-02T21:28:38Z)
• Order-agnostic Identifier for Large Language Model-based Generative Recommendation [94.37662915542603]
  Items are assigned identifiers for Large Language Models (LLMs) to encode user history and generate the next item.<n>Existing approaches leverage either token-sequence identifiers, representing items as discrete token sequences, or single-token identifiers, using ID or semantic embeddings.<n>We propose SETRec, which leverages semantic tokenizers to obtain order-agnostic multi-dimensional tokens.
  arXiv  Detail & Related papers  (2025-02-15T15:25:38Z)
• VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identification [51.89551385538251]
  We propose VILLS (Video-Image Learning to Learn Semantics), a self-supervised method that jointly learns spatial and temporal features from images and videos. VILLS first designs a local semantic extraction module that adaptively extracts semantically consistent and robust spatial features. Then, VILLS designs a unified feature learning and adaptation module to represent image and video modalities in a consistent feature space.
  arXiv  Detail & Related papers  (2023-11-27T19:30:30Z)
• Language Models As Semantic Indexers [78.83425357657026]
  We introduce LMIndexer, a self-supervised framework to learn semantic IDs with a generative language model. We show the high quality of the learned IDs and demonstrate their effectiveness on three tasks including recommendation, product search, and document retrieval.
  arXiv  Detail & Related papers  (2023-10-11T18:56:15Z)
• Towards Precise Intra-camera Supervised Person Re-identification [54.86892428155225]
  Intra-camera supervision (ICS) for person re-identification (Re-ID) assumes that identity labels are independently annotated within each camera view. Lack of inter-camera labels makes the ICS Re-ID problem much more challenging than the fully supervised counterpart. Our approach performs even comparable to state-of-the-art fully supervised methods in two of the datasets.
  arXiv  Detail & Related papers  (2020-02-12T11:56:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.