SAVeD: Semantic Aware Version Discovery
- URL: http://arxiv.org/abs/2511.17298v1
- Date: Fri, 21 Nov 2025 15:11:15 GMT
- Title: SAVeD: Semantic Aware Version Discovery
- Abstract summary: SAVeD is a contrastive learning-based framework for identifying versions of structured datasets.<n>Our experiments span five canonical datasets from the Semantic Versioning in Databases Benchmark.
- Score: 6.220725124423482
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Our work introduces SAVeD (Semantically Aware Version Detection), a contrastive learning-based framework for identifying versions of structured datasets without relying on metadata, labels, or integration-based assumptions. SAVeD addresses a common challenge in data science of repeated labor due to a difficulty of similar work or transformations on datasets. SAVeD employs a modified SimCLR pipeline, generating augmented table views through random transformations (e.g., row deletion, encoding perturbations). These views are embedded via a custom transformer encoder and contrasted in latent space to optimize semantic similarity. Our model learns to minimize distances between augmented views of the same dataset and maximize those between unrelated tables. We evaluate performance using validation accuracy and separation, defined respectively as the proportion of correctly classified version/non-version pairs on a hold-out set, and the difference between average similarities of versioned and non-versioned tables (defined by a benchmark, and not provided to the model). Our experiments span five canonical datasets from the Semantic Versioning in Databases Benchmark, and demonstrate substantial gains post-training. SAVeD achieves significantly higher accuracy on completely unseen tables in, and a significant boost in separation scores, confirming its capability to distinguish semantically altered versions. Compared to untrained baselines and prior state-of-the-art dataset-discovery methods like Starmie, our custom encoder achieves competitive or superior results.
Related papers
- Understanding Autonomous Driving Datasets by Describing Differences between Image Subsets in Natural Language [4.923151020110198]
This paper studies set difference captioning: given two subsets of images, the goal is to produce a natural-language hypothesis describing differences between the target and reference set.<n>We adapt the method to autonomous driving by focusing on object-centric patches derived from object detection.<n>Low-concentration experiments assess the suitability of set-difference-captioning approaches to sparse, real-world differences.
arXiv Detail & Related papers (2026-09-03T11:15:23Z) - ControlledShifts: Towards Standardizing Robustness Evaluation in Trajectory Prediction Under Distribution Shifts [12.370065954075299]
Trajectory prediction is central to safety in autonomous driving.<n>Many methods attempt to mitigate distribution shift degradation through data-centric or test-time adaptation approaches.<n>We introduce ControlledShifts, a framework that systematically re-splits existing trajectory datasets into in-distribution and out-of-distribution partitions.
arXiv Detail & Related papers (2026-08-18T15:16:52Z) - SAS: Semantic-aware Sampling for Generative Dataset Distillation [55.27114962330541]
We introduce a semantic-aware perspective for dataset distillation by leveraging Contrastive Language-Image Pretraining (CLIP) as a semantic prior for post-sampling.<n>Our goal is to obtain distilled datasets that are not only compact but also semantically class-discriminative and diverse.
arXiv Detail & Related papers (2026-05-18T08:05:46Z) - TabSHAP [5.3259362673757735]
Large Language Models are emerging as powerful alternatives to traditional tree-based models.<n>Existing methods often rely on global linear proxies or scalar probability shifts that fail to capture the model's full probabilistic uncertainty.<n>We introduce TabSHAP, a model-agnostic interpretability framework designed to directly attribute local query decision logic.
arXiv Detail & Related papers (2026-04-22T22:04:45Z) - Explainable Semantic Textual Similarity via Dissimilar Span Detection [53.32175252285023]
We introduce the task of Dissimilar Span Detection (DSD), which aims to identify semantically differing spans between pairs of texts.<n>This can help users understand which particular words or tokens negatively affect the similarity score, or be used to improve performance in STS-dependent downstream tasks.
arXiv Detail & Related papers (2026-03-22T11:32:31Z) - SITUATE -- Synthetic Object Counting Dataset for VLM training [0.0]
We present SITUATE, a novel dataset designed for training and evaluating Vision Language Models.<n>The dataset bridges the gap between simple 2D datasets like VLMCountBench and often ambiguous real-life datasets like TallyQA.
arXiv Detail & Related papers (2026-01-26T16:17:53Z) - Linguistic and Argument Diversity in Synthetic Data for Function-Calling Agents [5.105255387565864]
We propose a method that generates synthetic datasets via general-purpose diversity metrics across both queries and arguments.<n>We show a superiority over baselines in terms of diversity, while keeping comparable correctness.<n>We achieve an $7.4%$ increase in accuracy on the BFCL benchmark compared to similar counterparts.
arXiv Detail & Related papers (2026-01-25T13:20:33Z) - Bridging the Semantic Gap for Categorical Data Clustering via Large Language Models [64.58262227709842]
ARISE (Attention-weighted Representation with Integrated Semantic Embeddings) is presented.<n>It builds semantic-aware representations that complement the metric space of categorical data for accurate clustering.<n>Experiments on eight benchmark datasets demonstrate consistent improvements over seven representative counterparts.
arXiv Detail & Related papers (2026-01-03T11:37:46Z) - CAE: Character-Level Autoencoder for Non-Semantic Relational Data Grouping [0.9595254895337946]
This paper introduces a novel Character-Level Autoencoder (CAE) approach that automatically identifies and groups semantically identical columns in non-semantic relational datasets.<n>Unlike conventional Natural Language Processing (NLP) models that struggle with limitations in semantic interpretability, our approach operates at the character level with fixed dictionary constraints.<n>By maintaining a fixed dictionary size, our method significantly reduces both memory requirements and training time, enabling efficient processing of large-scale industrial data environments.
arXiv Detail & Related papers (2025-11-10T22:07:22Z) - TSVC:Tripartite Learning with Semantic Variation Consistency for Robust Image-Text Retrieval [11.874979105806243]
Cross-modal retrieval maps data under different modality via semantic relevance.<n>Existing approaches implicitly assume that data pairs are well-aligned and ignore the widely existing annotation noise.<n>We introduce a Tripartite learning with Semantic Variation Consistency (TSVC) for robust image-text retrieval.
arXiv Detail & Related papers (2025-01-19T04:05:08Z) - The SVHN Dataset Is Deceptive for Probabilistic Generative Models Due to
a Distribution Mismatch [12.542073306638988]
The Street View House Numbers dataset is a popular benchmark dataset in deep learning.
We warn that the official split into training set and test set of the SVHN dataset are not drawn from the same distribution.
We propose to mix and re-split the official training and test set when SVHN is used for tasks other than classification.
arXiv Detail & Related papers (2023-10-30T15:38:31Z) - Aligning benchmark datasets for table structure recognition [10.323063834827416]
Benchmark datasets for table structure recognition (TSR) must be carefully processed to ensure they are consistently.
In this work, we show that aligning these benchmarks$x$removing errors and inconsistency between them$x$improves performance significantly.
Overall we believe our work has significant implications for benchmark processing performance and potentially other tasks as well.
arXiv Detail & Related papers (2023-03-01T18:20:24Z) - SUN: Exploring Intrinsic Uncertainties in Text-to-SQL Parsers [61.48159785138462]
This paper aims to improve the performance of text-to-dependence by exploring the intrinsic uncertainties in the neural network based approaches (called SUN)
Extensive experiments on five benchmark datasets demonstrate that our method significantly outperforms competitors and achieves new state-of-the-art results.
arXiv Detail & Related papers (2022-09-14T06:27:51Z) - Detection Hub: Unifying Object Detection Datasets via Query Adaptation
on Language Embedding [137.3719377780593]
A new design (named Detection Hub) is dataset-aware and category-aligned.
It mitigates the dataset inconsistency and provides coherent guidance for the detector to learn across multiple datasets.
The categories across datasets are semantically aligned into a unified space by replacing one-hot category representations with word embedding.
arXiv Detail & Related papers (2022-06-07T17:59:44Z) - Comparing Test Sets with Item Response Theory [53.755064720563]
We evaluate 29 datasets using predictions from 18 pretrained Transformer models on individual test examples.
We find that Quoref, HellaSwag, and MC-TACO are best suited for distinguishing among state-of-the-art models.
We also observe span selection task format, which is used for QA datasets like QAMR or SQuAD2.0, is effective in differentiating between strong and weak models.
arXiv Detail & Related papers (2021-06-01T22:33:53Z) - A comprehensive comparative evaluation and analysis of Distributional
Semantic Models [61.41800660636555]
We perform a comprehensive evaluation of type distributional vectors, either produced by static DSMs or obtained by averaging the contextualized vectors generated by BERT.
The results show that the alleged superiority of predict based models is more apparent than real, and surely not ubiquitous.
We borrow from cognitive neuroscience the methodology of Representational Similarity Analysis (RSA) to inspect the semantic spaces generated by distributional models.
arXiv Detail & Related papers (2021-05-20T15:18:06Z) - Hyperparameter Optimization with Differentiable Metafeatures [5.586191108738563]
We propose a cross dataset surrogate model called Differentiable Metafeature-based Surrogate (DMFBS)
In contrast to existing models, DMFBS i) integrates a differentiable metafeature extractor and ii) is optimized using a novel multi-task loss.
We compare DMFBS against several recent models for HPO on three large meta-datasets and show that it consistently outperforms all of them with an average 10% improvement.
arXiv Detail & Related papers (2021-02-07T11:06:31Z) - Evaluating Models' Local Decision Boundaries via Contrast Sets [119.38387782979474]
We propose a new annotation paradigm for NLP that helps to close systematic gaps in the test data.
We demonstrate the efficacy of contrast sets by creating them for 10 diverse NLP datasets.
Although our contrast sets are not explicitly adversarial, model performance is significantly lower on them than on the original test sets.
arXiv Detail & Related papers (2020-04-06T14:47:18Z) - Meta-Learned Confidence for Few-shot Learning [60.6086305523402]
A popular transductive inference technique for few-shot metric-based approaches, is to update the prototype of each class with the mean of the most confident query examples.
We propose to meta-learn the confidence for each query sample, to assign optimal weights to unlabeled queries.
We validate our few-shot learning model with meta-learned confidence on four benchmark datasets.
arXiv Detail & Related papers (2020-02-27T10:22:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.