Diversed Model Discovery via Structured Table Discovery

• URL: http://arxiv.org/abs/2605.22766v1
• Date: Thu, 21 May 2026 17:28:01 GMT
• Title: Diversed Model Discovery via Structured Table Discovery
• Abstract summary: We present StructuredSemanticSearch, a table-driven model search framework built on the ModelTables benchmark.<n>Given a query, StructuredSemanticSearch combines a semantic baseline for task alignment with a structure-aware pipeline that discovers query-related model-card tables.<n>For evaluation, we introduce a nugget-based, auditable protocol that extracts compact evidence items from model cards, matches queries to condition- or intent-specific nuggets, and measures evidence coverage and diversity over retrieved model-card candidate sets.
• Score: 2.1861855606506526
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Model cards describe model behavior through a mixture of textual descriptions and structured artifacts, including performance, configuration, and dataset tables. Existing model search systems rely predominantly on semantic similarity over text, which can produce homogeneous result sets and limit exploration of alternatives. We argue that model search is inherently comparative: users want models that are task-aligned yet differentiated in measurable ways. We hypothesize that this balance requires retrieval over condensed, high-quality evidence rather than verbose descriptions, and much of that evidence is concentrated in structured tables. We present StructuredSemanticSearch, a table-driven model search framework built on the ModelTables benchmark. Given a query, StructuredSemanticSearch combines a semantic baseline for task alignment with a structure-aware pipeline that discovers query-related model-card tables using table discovery operators such as unionability, joinability, and keyword search. Retrieved tables are mapped back to model cards under a controlled top-k budget, enabling fair comparison between text-based and table-based retrieval. Beyond retrieval, StructuredSemanticSearch adapts table integration to the model-table domain through orientation-aware integration, producing compact integrated views of tables from partially overlapping and sometimes transposed evidence tables. For evaluation, we introduce a nugget-based, auditable protocol that extracts compact evidence items from model cards, matches queries to condition- or intent-specific nuggets, and measures evidence coverage and diversity over retrieved model-card candidate sets. This protocol also provides a scalable path toward approximate, evidence-based labeling in dynamic model lakes. Experiments on 597 model-recommendation queries show improved nugget coverage for the structure-aware pipeline than semantic baseline

Related papers

• Choosing a Text Embedding Model: A Practical Benchmarking and Decision Framework [0.0]
  This report develops a practical, evidence-based framework for embedding model selection.<n>It evaluates T3EM, a commercial API-based embedding model, against a broad set of open-source alternatives on English-language retrieval tasks.
  arXiv  Detail & Related papers  (2026-07-26T07:13:33Z)
• RACT: Retrieval Augmented Column-Table Learning and Prediction for Multi-Table Schema Matching [0.13999481573773068]
  RACT learning and prediction is used to exploit referential context for holistic schema matching.<n> constraining the column search space via top-t tables improves both average matching precision and completeness by up to +70%.
  arXiv  Detail & Related papers  (2026-06-05T21:08:40Z)
• TopBench: A Benchmark for Implicit Prediction and Reasoning over Tabular Question Answering [80.93487993878836]
  A common class of real-world queries is implicitly predictive, requiring the inference of unobserved answers from historical patterns rather than mere retrieval.<n>These queries introduce two challenges: recognizing latent intent and reliable predictive reasoning over massive tables.<n>We introduce TopBench, a benchmark consisting of 779 samples across four sub-tasks, ranging from single-point prediction to decision making, treatment effect analysis, and complex reasoning.
  arXiv  Detail & Related papers  (2026-04-30T16:22:51Z)
• DTBench: A Synthetic Benchmark for Document-to-Table Extraction [19.499877109720945]
  Document-to-table (Doc2Table) extraction derives structured tables from unstructured documents under a target schema.<n>Existing benchmarks neither explicitly distinguish nor comprehensively cover the diverse capabilities required in Doc2Table extraction.<n>We present DTBench, a synthetic benchmark that adopts a proposed two-level taxonomy of Doc2Table capabilities.
  arXiv  Detail & Related papers  (2026-02-14T14:52:36Z)
• ModelTables: A Corpus of Tables about Models [7.843042548609869]
  We present ModelTables, a benchmark of tables in Model Lakes that captures structured semantics of performance and configuration.<n>Compared with open data lake tables, model tables are smaller yet exhibit inter table relationships.<n>We present one extensive empirical use case for the benchmark which is table search.
  arXiv  Detail & Related papers  (2025-12-18T02:51:46Z)
• Same Content, Different Representations: A Controlled Study for Table QA [15.896655757672441]
  Table Question Answering (Table QA) in real-world settings must operate over both structured databases and semi-structured tables containing textual fields.<n>Existing benchmarks are tied to fixed data formats and have not systematically examined how representation itself affects model performance.<n>We present the first controlled study that isolates the role of table representation by holding content constant while varying structure.
  arXiv  Detail & Related papers  (2025-09-26T22:33:19Z)
• Bridging Queries and Tables through Entities in Table Retrieval [70.13748256886288]
  Entities are well-studied in the context of text retrieval, but there is a noticeable lack of research on their applications in table retrieval.<n>We propose an entity-enhanced training framework and design an interaction paradigm based on entity representations.<n>Our proposed framework is plug-and-play and flexible, making it easy to integrate into existing table retriever training processes.
  arXiv  Detail & Related papers  (2025-04-09T03:16:33Z)
• Tailoring Table Retrieval from a Field-aware Hybrid Matching Perspective [70.13748256886288]
  Table retrieval is less explored compared to text retrieval.<n>Different table fields have varying matching preferences.<n>We introduce a Table-tailored HYbrid Matching rEtriever (THYME)
  arXiv  Detail & Related papers  (2025-03-04T03:57:10Z)
• Query-oriented Data Augmentation for Session Search [71.84678750612754]
  We propose query-oriented data augmentation to enrich search logs and empower the modeling. We generate supplemental training pairs by altering the most important part of a search context. We develop several strategies to alter the current query, resulting in new training data with varying degrees of difficulty.
  arXiv  Detail & Related papers  (2024-07-04T08:08:33Z)
• CART: A Generative Cross-Modal Retrieval Framework with Coarse-To-Fine Semantic Modeling [53.97609687516371]
  Cross-modal retrieval aims to search for instances, which are semantically related to the query through the interaction of different modal data.<n>Traditional solutions utilize a single-tower or dual-tower framework to explicitly compute the score between queries and candidates.<n>We propose a generative cross-modal retrieval framework (CART) based on coarse-to-fine semantic modeling.
  arXiv  Detail & Related papers  (2024-06-25T12:47:04Z)
• Table Retrieval May Not Necessitate Table-specific Model Design [83.27735758203089]
  We focus on the task of table retrieval, and ask: "is table-specific model design necessary for table retrieval?" Based on an analysis on a table-based portion of the Natural Questions dataset (NQ-table), we find that structure plays a negligible role in more than 70% of the cases. We then experiment with three modules to explicitly encode table structures, namely auxiliary row/column embeddings, hard attention masks, and soft relation-based attention biases. None of these yielded significant improvements, suggesting that table-specific model design may not be necessary for table retrieval.
  arXiv  Detail & Related papers  (2022-05-19T20:35:23Z)
• AutoRC: Improving BERT Based Relation Classification Models via Architecture Search [50.349407334562045]
  BERT based relation classification (RC) models have achieved significant improvements over the traditional deep learning models. No consensus can be reached on what is the optimal architecture. We design a comprehensive search space for BERT based RC models and employ neural architecture search (NAS) method to automatically discover the design choices.
  arXiv  Detail & Related papers  (2020-09-22T16:55:49Z)
• Leveraging Schema Labels to Enhance Dataset Search [20.63182827636973]
  We propose a novel schema label generation model which generates possible schema labels based on dataset table content. We incorporate the generated schema labels into a mixed ranking model which considers the relevance between the query and dataset metadata. Experiments show that our approach can effectively improve the precision and NDCG scores of the dataset retrieval task.
  arXiv  Detail & Related papers  (2020-01-27T22:41:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.