ClusBench: The Clustering Benchmark Data Resource You've All Been Waiting For (?)
- URL: http://arxiv.org/abs/2606.10673v1
- Date: Tue, 09 Jun 2026 10:27:01 GMT
- Title: ClusBench: The Clustering Benchmark Data Resource You've All Been Waiting For (?)
- Abstract summary: We describe the production and curation of close to 3000 synthetic data sets, derived from more than 200 publicly available data sets.<n>By fitting a flexible non-parametric distribution to each base data set we are able to retain much of the nuance in real-world data.
- Score: 2.741266294612775
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Although some very common test beds exist for assessing the performance of clustering methods, large scale benchmarking is typically limited to relatively simplistic simulation set-ups. Here we describe the production and curation of close to 3000 synthetic data sets, derived from more than 200 publicly available data sets; the majority of which arose from real-world applications. By fitting a flexible non-parametric distribution to each base data set we are able to retain much of the nuance in real-world data which is difficult to reproduce in standard simulations, while also producing data sets whose sizes are sometimes substantially greater than the data sets from which they are derived. The synthetic data sets, plus an accompanying R package, are available for download from https://github.com/DavidHofmeyr/ClusBench.
Related papers
- MacrOData: New Benchmarks of Thousands of Datasets for Tabular Outlier Detection [25.690005491942884]
Outlier detection on tabular data underpins numerous real-world applications.<n>The prominent OD benchmark AdBench is the de facto standard in the literature, yet comprises only 57 datasets.<n>We introduce MacrOData, a large-scale benchmark suite for tabular OD comprising three carefully curated components.<n> Owing to its scale and diversity, MacrOData enables comprehensive and statistically robust evaluation of OD methods.
arXiv Detail & Related papers (2026-02-10T01:51:41Z) - Anymate: A Dataset and Baselines for Learning 3D Object Rigging [18.973312365787137]
We present a large-scale dataset of 230K 3D assets paired with expert-crafted rigging and skinning information.<n>We propose a learning-based auto-rigging framework with three sequential modules for joint, connectivity, and skinning weight prediction.<n>Our models significantly outperform existing methods, providing a foundation for comparing future methods in automated rigging and skinning.
arXiv Detail & Related papers (2025-05-09T17:59:33Z) - CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training [63.07024608399447]
We propose an automated framework that discovers, evaluates, and refines data mixtures in a pre-training setting.<n>We introduce ClimbLab, a filtered 1.2-trillion-token corpus with 20 clusters as a research playground, and ClimbMix, a compact yet powerful 400-billion-token dataset.
arXiv Detail & Related papers (2025-04-17T17:58:13Z) - FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models [48.484485609995986]
Federated learning has enabled multiple parties to collaboratively train large language models without directly sharing their data (FedLLM)
There are currently no realistic datasets and benchmarks for FedLLM.
We propose FedLLM-Bench, which involves 8 training methods, 4 training datasets, and 6 evaluation metrics.
arXiv Detail & Related papers (2024-06-07T11:19:30Z) - Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks [66.87070857705994]
In low-resource settings, the amount of seed data samples to use for data augmentation is very small.
We propose a novel method that augments training data by incorporating a wealth of examples from other datasets.
This approach can ensure that the generated data is not only relevant but also more diverse than what could be achieved using the limited seed data alone.
arXiv Detail & Related papers (2024-02-21T02:45:46Z) - Natural Language-Based Synthetic Data Generation for Cluster Analysis [4.13592995550836]
Cluster analysis relies on effective benchmarks for evaluating and comparing different algorithms.<n>We propose synthetic data generation based on direct specification of high-level scenarios.<n>Our open-source Python package repliclust implements this workflow.
arXiv Detail & Related papers (2023-03-24T23:45:27Z) - BREEDS: Benchmarks for Subpopulation Shift [98.90314444545204]
We develop a methodology for assessing the robustness of models to subpopulation shift.
We leverage the class structure underlying existing datasets to control the data subpopulations that comprise the training and test distributions.
Applying this methodology to the ImageNet dataset, we create a suite of subpopulation shift benchmarks of varying granularity.
arXiv Detail & Related papers (2020-08-11T17:04:47Z) - Open Graph Benchmark: Datasets for Machine Learning on Graphs [86.96887552203479]
We present the Open Graph Benchmark (OGB) to facilitate scalable, robust, and reproducible graph machine learning (ML) research.
OGB datasets are large-scale, encompass multiple important graph ML tasks, and cover a diverse range of domains.
For each dataset, we provide a unified evaluation protocol using meaningful application-specific data splits and evaluation metrics.
arXiv Detail & Related papers (2020-05-02T03:09:50Z) - NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localization [101.13851473792334]
We construct a large-scale congested crowd counting and localization dataset, NWPU-Crowd, consisting of 5,109 images, in a total of 2,133,375 annotated heads with points and boxes.
Compared with other real-world datasets, it contains various illumination scenes and has the largest density range (020,033)
We describe the data characteristics, evaluate the performance of some mainstream state-of-the-art (SOTA) methods, and analyze the new problems that arise on the new data.
arXiv Detail & Related papers (2020-01-10T09:26:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.