Beyond Statistical Co-occurrence: Unlocking Intrinsic Semantics for Tabular Data Clustering
- URL: http://arxiv.org/abs/2604.10865v1
- Date: Mon, 13 Apr 2026 00:25:22 GMT
- Title: Beyond Statistical Co-occurrence: Unlocking Intrinsic Semantics for Tabular Data Clustering
- Abstract summary: This paper proposes Tabular-Augmented Contrastive Clustering (TagCC) to bridge the gap between dataset-specific statistics and intrinsic semantic knowledge.<n>TagCC distills underlying data semantics into textual anchors via semantic-aware transformation.<n>It is jointly optimized with a clustering objective, ensuring that the learned representations are both semantically coherent and clustering-friendly.
- Score: 52.97486694817375
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep Clustering (DC) has emerged as a powerful tool for tabular data analysis in real-world domains like finance and healthcare. However, most existing methods rely on data-level statistical co-occurrence to infer the latent metric space, often overlooking the intrinsic semantic knowledge encapsulated in feature names and values. As a result, semantically related concepts like `Flu' and `Cold' are often treated as symbolic tokens, causing conceptually related samples to be isolated. To bridge the gap between dataset-specific statistics and intrinsic semantic knowledge, this paper proposes Tabular-Augmented Contrastive Clustering (TagCC), a novel framework that anchors statistical tabular representations to open-world textual concepts. Specifically, TagCC utilizes Large Language Models (LLMs) to distill underlying data semantics into textual anchors via semantic-aware transformation. Through Contrastive Learning (CL), the framework enriches the statistical tabular representations with the open-world semantics encapsulated in these anchors. This CL framework is jointly optimized with a clustering objective, ensuring that the learned representations are both semantically coherent and clustering-friendly. Extensive experiments on benchmark datasets demonstrate that TagCC significantly outperforms its counterparts.
Related papers
- GRACE: LLM-Grounded Semantic Metric Spaces for Scalable Mixed-Data Clustering [19.352298911016668]
GRACE is a framework for scalable mixed-data clustering.<n>It maps heterogeneous values into knowledge-informed descriptions.<n>It achieves superior clustering accuracy and conceptual interpretability over 11 competing methods.
arXiv Detail & Related papers (2026-08-08T03:14:50Z) - Enhancing Tabular Learners with Context-Aware Semantic Embeddings [1.6381263995389714]
We propose a novel framework that bridges the gap between the semantic understanding of Large Language Models (LLMs) and the statistical capabilities of tabular learners.<n>Case utilizes a contextualization strategy: we pre-fill the KV cache of a custom-trained Gemma 3-based Tabular Language Model with a representative sample of rows to establish a persistent anchor of the dataset's semantics.
arXiv Detail & Related papers (2026-08-04T12:29:37Z) - Bridging the Semantic Gap for Categorical Data Clustering via Large Language Models [64.58262227709842]
ARISE (Attention-weighted Representation with Integrated Semantic Embeddings) is presented.<n>It builds semantic-aware representations that complement the metric space of categorical data for accurate clustering.<n>Experiments on eight benchmark datasets demonstrate consistent improvements over seven representative counterparts.
arXiv Detail & Related papers (2026-01-03T11:37:46Z) - CAE: Character-Level Autoencoder for Non-Semantic Relational Data Grouping [0.9595254895337946]
This paper introduces a novel Character-Level Autoencoder (CAE) approach that automatically identifies and groups semantically identical columns in non-semantic relational datasets.<n>Unlike conventional Natural Language Processing (NLP) models that struggle with limitations in semantic interpretability, our approach operates at the character level with fixed dictionary constraints.<n>By maintaining a fixed dictionary size, our method significantly reduces both memory requirements and training time, enabling efficient processing of large-scale industrial data environments.
arXiv Detail & Related papers (2025-11-10T22:07:22Z) - Exploring Partial Multi-Label Learning via Integrating Semantic Co-occurrence Knowledge [30.05176623784069]
Partial multi-label learning aims to extract knowledge from incompletely annotated data.<n>Core challenge lies in accurately identifying the ambiguous relationships between labels and instances.<n>We propose Semantic Co-occurrence Insight Network (SCINet), a novel and effective framework for partial multi-label learning.
arXiv Detail & Related papers (2025-07-08T13:53:28Z) - Imputation-free and Alignment-free: Incomplete Multi-view Clustering Driven by Consensus Semantic Learning [65.75756724642932]
In incomplete multi-view clustering, missing data induce prototype shifts within views and semantic inconsistencies across views.<n>We propose an IMVC framework, imputation- and alignment-free for consensus semantics learning (FreeCSL)<n>FreeCSL achieves more confident and robust assignments on IMVC task, compared to state-of-the-art competitors.
arXiv Detail & Related papers (2025-05-16T12:37:10Z) - CTG-KrEW: Generating Synthetic Structured Contextually Correlated Content by Conditional Tabular GAN with K-Means Clustering and Efficient Word Embedding [12.072052949955385]
Conditional Tabular Generative Adversarial Networks (CTGAN) are attractive for their ability to efficiently create synthetic data.
We introduce a novel framework, CTGKrEW, which is adept at generating realistic synthetic data where attributes are collections of semantically and contextually coherent words.
CTGKrEW also takes around 99% less CPU time and 33% less memory footprints than the conventional approach.
arXiv Detail & Related papers (2024-09-03T05:53:57Z) - Federated Contrastive Learning for Personalized Semantic Communication [55.46383524190467]
We design a federated contrastive learning framework aimed at supporting personalized semantic communication.
FedCL enables collaborative training of local semantic encoders across multiple clients and a global semantic decoder owned by the base station.
To tackle the semantic imbalance issue arising from heterogeneous datasets across distributed clients, we employ contrastive learning to train a semantic centroid generator.
arXiv Detail & Related papers (2024-06-13T14:45:35Z) - Semantic Equitable Clustering: A Simple and Effective Strategy for Clustering Vision Tokens [57.37893387775829]
We introduce a fast and balanced clustering method, named Semantic Equitable Clustering (SEC)<n>SEC clusters tokens based on their global semantic relevance in an efficient, straightforward manner.<n>We propose a versatile vision backbone, SECViT, to serve as a vision language connector.
arXiv Detail & Related papers (2024-05-22T04:49:00Z) - mCL-NER: Cross-Lingual Named Entity Recognition via Multi-view
Contrastive Learning [54.523172171533645]
Cross-lingual named entity recognition (CrossNER) faces challenges stemming from uneven performance due to the scarcity of multilingual corpora.
We propose Multi-view Contrastive Learning for Cross-lingual Named Entity Recognition (mCL-NER)
Our experiments on the XTREME benchmark, spanning 40 languages, demonstrate the superiority of mCL-NER over prior data-driven and model-based approaches.
arXiv Detail & Related papers (2023-08-17T16:02:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.