Smart Metadata in Action: The Social Impact Data Commons
- URL: http://arxiv.org/abs/2511.17694v1
- Date: Fri, 21 Nov 2025 16:18:47 GMT
- Title: Smart Metadata in Action: The Social Impact Data Commons
- Abstract summary: This article describes the use of metadata and standards in the Social Impact Data Commons to expose official statisticians to an innovative project built on actionable and evaluable metadata.<n>We begin by introducing the concept of the Data Commons, focusing on its features, and presenting an overview of current implementations of the Data Commons.<n>We then present the core metadata case study, demonstrating how smart metadata support the Data Commons.
- Score: 0.5545791216381869
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This article describes the use of metadata and standards in the Social Impact Data Commons to expose official statisticians to an innovative project built on actionable and evaluable metadata, which produces a FAIR data system. We begin by introducing the concept of the Data Commons, focusing on its features, and presenting an overview of current implementations of the Data Commons. We then present the core metadata case study, demonstrating how smart metadata support the Data Commons. We also present evaluations of our core metadata, including its adherence to the FAIR guidelines. We conclude with a discussion on our future metadata and standards-related projects to support the Social Impact Data Commons.
Related papers
- MIRAGE: Metadata-Integrated Repository Analysis and Guided Enhancement for MSR Datasets [0.0]
This research expands upon an earlier dataset directory created specifically for the analysis of MSR datasets.<n>The metadata of the MSR papers presented from 2013 to 2024 has been gathered using the Semantic Scholar API.<n>The study reveals that the choice of repository hosting sites and data formats influences citation patterns and dataset usability.
arXiv Detail & Related papers (2026-05-29T16:10:18Z) - Conscious Data Contribution via Community-Driven Chain-of-Thought Distillation [4.275696286826178]
We consider questions of data portability and user autonomy in the context of LLMs that "reason"<n>We show how communities who receive low utility from an available model can aggregate and distill their shared knowledge into an alternate model better aligned with their goals.
arXiv Detail & Related papers (2025-12-20T02:17:18Z) - Multi-Platform Aggregated Dataset of Online Communities (MADOC) [64.45797970830233]
MADOC aggregates and standardizes data from Bluesky, Koo, Reddit, and Voat (2012-2024), containing 18.9 million posts, 236 million comments, and 23.1 million unique users.<n>The dataset enables comparative studies of toxic behavior evolution across platforms through standardized interaction records and sentiment analysis.
arXiv Detail & Related papers (2025-01-22T14:02:11Z) - Language Models Learn Metadata: Political Stance Detection Case Study [1.2277343096128712]
This paper investigates the optimal way to incorporate metadata into a political stance detection task.
We show that our simple baseline, using only party membership information, surpasses the current state-of-the-art.
arXiv Detail & Related papers (2024-09-15T14:57:41Z) - DatAasee -- A Metadata-Lake as Metadata Catalog for a Virtual Data-Lake [0.0]
This work constructs a data architecture, derived from the data-lake: the metadata-lake.<n>A proof-of-concept implementation of this proposed metadata aggregator is presented and also evaluated.
arXiv Detail & Related papers (2024-09-09T11:10:45Z) - When is Off-Policy Evaluation (Reward Modeling) Useful in Contextual Bandits? A Data-Centric Perspective [64.73162159837956]
evaluating the value of a hypothetical target policy with only a logged dataset is important but challenging.
We propose DataCOPE, a data-centric framework for evaluating a target policy given a dataset.
Our empirical analysis of DataCOPE in the logged contextual bandit settings using healthcare datasets confirms its ability to evaluate both machine-learning and human expert policies.
arXiv Detail & Related papers (2023-11-23T17:13:37Z) - Data Acquisition: A New Frontier in Data-centric AI [65.90972015426274]
We first present an investigation of current data marketplaces, revealing lack of platforms offering detailed information about datasets.
We then introduce the DAM challenge, a benchmark to model the interaction between the data providers and acquirers.
Our evaluation of the submitted strategies underlines the need for effective data acquisition strategies in Machine Learning.
arXiv Detail & Related papers (2023-11-22T22:15:17Z) - Data Leaves: Scenario-oriented Metadata for Data Federative Innovation [0.04893345190925177]
A method for representing the digest information of each dataset is proposed.
This method connects datasets via events, situations, or actions in a scenario that is supposed to be active in the real world.
arXiv Detail & Related papers (2022-08-07T13:48:26Z) - DataPerf: Benchmarks for Data-Centric AI Development [81.03754002516862]
DataPerf is a community-led benchmark suite for evaluating ML datasets and data-centric algorithms.
We provide an open, online platform with multiple rounds of challenges to support this iterative development.
The benchmarks, online evaluation platform, and baseline implementations are open source.
arXiv Detail & Related papers (2022-07-20T17:47:54Z) - The Problem of Zombie Datasets:A Framework For Deprecating Datasets [55.878249096379804]
We examine the public afterlives of several prominent datasets, including ImageNet, 80 Million Tiny Images, MS-Celeb-1M, Duke MTMC, Brainwash, and HRT Transgender.
We propose a dataset deprecation framework that includes considerations of risk, mitigation of impact, appeal mechanisms, timeline, post-deprecation protocol, and publication checks.
arXiv Detail & Related papers (2021-10-18T20:13:51Z) - ContentWise Impressions: An Industrial Dataset with Impressions Included [68.5068326729525]
The ContentWise Impressions dataset is a collection of implicit interactions and impressions of movies and TV series from an Over-The-Top media service.
We describe the data collection process, the preprocessing applied, its characteristics, and statistics when compared to other commonly used datasets.
We release software tools to load and split the data, as well as examples of how to use both user interactions and impressions in several common recommendation algorithms.
arXiv Detail & Related papers (2020-08-03T21:46:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.