SIDInspector: A Mapping-First Diagnostic Resource for Semantic-ID Tokenizers

• URL: http://arxiv.org/abs/2606.10375v1
• Date: Tue, 09 Jun 2026 03:36:31 GMT
• Title: SIDInspector: A Mapping-First Diagnostic Resource for Semantic-ID Tokenizers
• Abstract summary: tool is a mapping-first diagnostic resource for sid tokenizer artifacts.<n>tool reports inspectable artifact profiles before downstream leaderboard scores.
• Score: 11.601609455691644
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Semantic-ID (\sid) tokenizers are increasingly reused as standalone artifacts in generative recommendation: an exported item-to-code mapping becomes the address space that a later sequence generator must use. These mappings rarely come with a common inspection interface, so coverage gaps, full-code aliasing, behaviorally weak prefixes, tail compression, and prefix fan-out are often found only after downstream training. We present \tool, a mapping-first diagnostic resource for \sid tokenizer artifacts. \tool defines a small adapter contract over item mappings, metadata, interactions, and optional generator traces; validates the contract; and reports mapping-level probes for utilization, aliasing, neighborhood alignment, popularity allocation, and structural cost, with hooks for temporal churn and generator traces. \tool reports inspectable artifact profiles before downstream leaderboard scores. The released resource covers four tokenizer artifact lines: a same-item GRID/RQ-KMeans-style and ReSID/GAOQ contrast on 23,742 Musical items, plus released LETTER and LC-Rec item-index artifacts. In the Musical contrast, the GRID-style feature-text export has 3,749 unique full codes and a 0.977 full-code aliasing rate, while ReSID/GAOQ is aliasing-free in its exported mapping. Yet the strongest prefix--co-occurrence alignment comes from a deterministic category-prefix control, not from either learned export row (0.447 versus 0.154 and 0.055--0.080), showing that addressability and behaviorally meaningful prefixes should be inspected separately. Cross-domain, fixed-reranker, and mechanism-probe checks support the same diagnostic direction: prefix alignment is a candidate-exposure signal, while final ranking quality remains a downstream model question.

Related papers

• Secret MCP: Evidence-Bounded and Context-Isolated Design Specification Generation from Web Screenshots [0.0]
  Secret MCP produces one auditable design specification per public web reference.<n>Document structure, interaction logic, responsive rules, and provenance needed to distinguish observation from guesswork.
  arXiv  Detail & Related papers  (2026-08-24T14:32:52Z)
• Rethinking Item Tokenization in Generative Recommenders: From Fixed Atoms to Semantic Subwords [50.621722853036005]
  In generative recommender systems, items are typically tokenized into fixed-length semantic ID sequences for autoregressive next-item prediction.<n>For user-context modeling, this fine-grained representation triggers Intra-item Attention Overload.<n>We propose Semantic Subword Tokenization (SST), which represents historical items as variable-length semantic subwords.
  arXiv  Detail & Related papers  (2026-08-24T02:42:51Z)
• SIDScope: A Diagnostic Resource for Semantic-ID Interfaces in Generative Recommendation [4.419168310735208]
  SIDScope is a source-traced diagnostic resource for semantic-ID mapping decisions.<n>It normalizes item-to-code artifacts, verifies provenance and joins, profiles mapping structure, compares paired revisions, and accounts for path-to-item outcomes in generated traces.
  arXiv  Detail & Related papers  (2026-08-19T10:35:12Z)
• Generative Semantic Segmentation via an Observable Semantic-Image Interface and Hierarchical Generator Evidence Alignment [1.6199400106794555]
  Generative semantic segmentation exposes structured predictions as images, but direct color decoding is susceptible to color drift and boundary mixing.<n>We present Semantic Prism, a conditional semantic-image generation-and-refinement framework with inference.
  arXiv  Detail & Related papers  (2026-08-12T01:00:04Z)
• UniProbe: A Learnable Token-Level Hallucination Detector for Large VLMs using Multi-Structural Internal Representations [61.85916280854257]
  Large Vision-Language Models (LVLMs) achieve impressive visual reasoning and dialogue capabilities, yet frequently hallucinate content unsupported by the visual input.<n>We introduce textbfUniProbe, a lightweight, unified, learnable detector that models a frozen LVLM's heterogeneous computational trace from a single forward pass.
  arXiv  Detail & Related papers  (2026-08-11T12:01:59Z)
• One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting [51.09550363815034]
  Scene text spotting requires high-precision alignment between textual recognition and spatial localization.<n>We propose Single-Patch Text Spotting (SPaTS), a vision-centric framework that routes each text instance through a single anchor visual token.<n>We show that SPaTS consistently and significantly outperforms both frontier closed-source MLLMs and OCR MLLMs.
  arXiv  Detail & Related papers  (2026-07-30T09:17:48Z)
• When Does Explicit View Routing Work? A Controlled Study of Multi-View Graph-Text Alignment [0.5721241882795979]
  Graph-text retrieval typically maps a graph and its description to a single embedding, even when a query concerns only one semantic aspect.<n>We show that architectural channelization, not necessarily semantic routing, can be resolved.
  arXiv  Detail & Related papers  (2026-07-29T23:49:37Z)
• View-Aware Semantic Alignment for Aerial-Ground Person Re-Identification [43.69772242567068]
  ViSA is a view-aware framework that achieves cross-view semantic consistency.<n>ViSA consistently achieves superior performance, with a notable 10.06% mAP improvement on the challenging CARGO cross-view protocol.
  arXiv  Detail & Related papers  (2026-05-18T10:32:26Z)
• Discrimination Is Generation: Unifying Ranking and Retrieval from a Tokenizer Perspective [14.332200648147863]
  We propose DIG (textbfDiscrimination textbfIs textbfGeneration), which embeds the tokenizer inside a discriminative ranking model for end-to-end training.<n> Experiments on three public benchmarks and two industrial datasets demonstrate that DIG simultaneously improves ranking, retrieval, and unified retrieval-ranking quality.
  arXiv  Detail & Related papers  (2026-05-14T13:59:29Z)
• LARGER: Lexically Anchored Repository Graph Exploration and Retrieval [9.90137784523552]
  repository-level coding agents must first localize the files and symbols relevant to a task.<n>Existing approaches often require separate graph tools or stages that fragment the agent's interaction loop.<n>We introduce LARGER, a lexically anchored active-set retrieval framework that starts from lexical matches, aligns them to graph anchors, and performs confidence-filtered local expansion within the agent's existing search loop.
  arXiv  Detail & Related papers  (2026-05-08T05:03:46Z)
• CapsID: Soft-Routed Variable-Length Semantic IDs for Generative Recommendation [6.439016735163573]
  Generative recommendation maps each item to a sequence of Semantic IDs (SIDs) and recasts retrieval as autoregressive token generation.<n> CAPSID replaces hard residual quantization with capsule routing.<n>On Amazon Beauty, Sports, Toys, and a 35M-item proprietary industrial catalog, CAPSID+SEMANTICBPE improves Recall at 10 by 9.6% on average over ReSID.
  arXiv  Detail & Related papers  (2026-05-06T16:33:13Z)
• AIFIND: Artifact-Aware Interpreting Fine-Grained Alignment for Incremental Face Forgery Detection [23.80607349547519]
  We propose AIFIND, Artifact-Aware Interpreting Fine-Grained Alignment for Incremental Face Forgery Detection.<n>We use semantic anchors to stabilize incremental learning.
  arXiv  Detail & Related papers  (2026-04-17T16:17:12Z)
• RAID: Retrieval-Augmented Anomaly Detection [67.48358323718817]
  RAID is a retrieval-augmented UAD framework designed for noise-resilient anomaly detection and localization.<n> RAID retrieves class-, semantic-, and instance-level representations from a hierarchical vector database.<n> RAID achieves state-of-the-art performance across full-shot, few-shot, and multi-dataset settings on MVTec, VisA, MPDD, and BTAD benchmarks.
  arXiv  Detail & Related papers  (2026-02-23T08:54:27Z)
• DiffGRM: Diffusion-based Generative Recommendation Model [63.35379395455103]
  Generative recommendation (GR) is an emerging paradigm that represents each item via a tokenizer as an n-digit semantic ID (SID)<n>We propose DiffGRM, a diffusion-based GR model that replaces the autoregressive decoder with a masked discrete diffusion model (MDM)<n> Experiments show consistent gains over strong generative and discriminative recommendation baselines on multiple datasets.
  arXiv  Detail & Related papers  (2025-10-21T03:23:32Z)
• LESS: Label-Efficient and Single-Stage Referring 3D Segmentation [55.06002976797879]
  Referring 3D is a visual-language task that segments all points of the specified object from a 3D point cloud described by a sentence of query. We propose a novel Referring 3D pipeline, Label-Efficient and Single-Stage, dubbed LESS, which is only under the supervision of efficient binary mask. We achieve state-of-the-art performance on ScanRefer dataset by surpassing the previous methods about 3.7% mIoU using only binary labels.
  arXiv  Detail & Related papers  (2024-10-17T07:47:41Z)
• SegVG: Transferring Object Bounding Box to Segmentation for Visual Grounding [56.079013202051094]
  We present SegVG, a novel method transfers the box-level annotation as signals to provide an additional pixel-level supervision for Visual Grounding. This approach allows us to iteratively exploit the annotation as signals for both box-level regression and pixel-level segmentation.
  arXiv  Detail & Related papers  (2024-07-03T15:30:45Z)
• Weakly-Supervised Salient Object Detection via Scribble Annotations [54.40518383782725]
  We propose a weakly-supervised salient object detection model to learn saliency from scribble labels. We present a new metric, termed saliency structure measure, to measure the structure alignment of the predicted saliency maps. Our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-the-art models.
  arXiv  Detail & Related papers  (2020-03-17T12:59:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.