Altar: Structuring Sharable Experimental Data from Early Exploration to Publication

• URL: http://arxiv.org/abs/2602.18588v1
• Date: Fri, 20 Feb 2026 19:54:39 GMT
• Title: Altar: Structuring Sharable Experimental Data from Early Exploration to Publication
• Abstract summary: Managing the data and metadata during the active development phase of an experimental project presents a significant challenge.<n>Here we present Altar, a framework for structuring experimental data from the onset of a project without imposing rigid data models.<n> Altar is built around the Sacred experiment-tracking model and captures experimental (meta)data and structures them.
• Score: 0.6927055673104934
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Managing the data and metadata during the active development phase of an experimental project presents a significant challenge, particularly in collaborative research. This phase is frequently overlooked in Data Management Plans included in project proposals, despite its important role in ensuring reproducibility and preventing the need for retroactive reconstruction at the time of publication. Here we present Altar, a lightweight, domain-agnostic framework for structuring experimental data from the onset of a project without imposing rigid data models. Altar is built around the Sacred experiment-tracking model and captures experimental (meta)data and structures them. Parameters, metadata, curves and small files are stored in a flexible NoSQL database, while large raw data are maintained in dedicated storage and linked through unique identifiers, ensuring efficiency and traceability. This integration is composable with exiting workflows, allowing integration with minimial disruption of work habits. We document different pathways to use Altar based on users skillset (PhD students, Post-docs, Principal Investigators, Laboratory administrators, System administrators). While getting started with Altar does not require a specialized infrastructure, the framework can be easily deployed on a server and made publicly accessible when scaling up or preparing data for publication. By addressing the dynamic phase of research, Altar provides a practical bridge between exploratory experimentation and FAIR-aligned data sharing.

Related papers

• DataParasite Enables Scalable and Repurposable Online Data Curation [0.9543667840503739]
  DataParasite is a modular pipeline for scalable online data collection.<n>It decomposes curation tasks into independent, entity-level searches.<n>It achieves high accuracy while reducing data-collection costs by an order of magnitude relative to manual curation.
  arXiv  Detail & Related papers  (2026-01-05T22:04:16Z)
• A Configuration-First Framework for Reproducible, Low-Code Localization [4.904092547705666]
  We introduce LOCALIZE, a low-code, configuration-first framework for radio localization.<n>We show that the framework reduces authoring effort while maintaining comparable runtime and memory behavior.
  arXiv  Detail & Related papers  (2025-10-29T16:57:33Z)
• Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents [85.02904078131682]
  We introduce the agent data protocol (ADP), a light-weight representation language that serves as an "interlingua" between agent datasets.<n> ADP is expressive enough to capture a large variety of tasks, including API/tool use, browsing, coding, software engineering, and general agentic.<n>All code and data are released publicly, in the hope that ADP could help lower the barrier to standardized, scalable, and reproducible agent training.
  arXiv  Detail & Related papers  (2025-10-28T17:53:13Z)
• LLM-based Multi-Agent Blackboard System for Information Discovery in Data Science [69.1690891731311]
  We propose a novel multi-agent communication paradigm inspired by the blackboard architecture for traditional AI models.<n>In this framework, a central agent posts requests to a shared blackboard, and autonomous subordinate agents respond based on their capabilities.<n>We evaluate our method on three benchmarks that require explicit data discovery.
  arXiv  Detail & Related papers  (2025-09-30T22:34:23Z)
• RedStone: Curating General, Code, Math, and QA Data for Large Language Models [134.49774529790693]
  This study explores the untapped potential of Common Crawl as a comprehensive and flexible resource for pre-training Large Language Models.<n>We introduce RedStone, an innovative and scalable pipeline engineered to extract and process data from Common Crawl.
  arXiv  Detail & Related papers  (2024-12-04T15:27:39Z)
• Putting Data at the Centre of Offline Multi-Agent Reinforcement Learning [3.623224034411137]
  offline multi-agent reinforcement learning (MARL) is an exciting direction of research that uses static datasets to find optimal control policies for multi-agent systems. Though the field is by definition data-driven, efforts have thus far neglected data in their drive to achieve state-of-the-art results. We show how the majority of works generate their own datasets without consistent methodology and provide sparse information about the characteristics of these datasets.
  arXiv  Detail & Related papers  (2024-09-18T14:13:24Z)
• Introducing a Comprehensive, Continuous, and Collaborative Survey of Intrusion Detection Datasets [2.7082111912355877]
  COMIDDS is an effort to comprehensively survey intrusion detection datasets with an unprecedented level of detail. It provides structured and critical information on each dataset, including actual data samples and links to relevant publications.
  arXiv  Detail & Related papers  (2024-08-05T14:40:41Z)
• Open-Vocabulary Camouflaged Object Segmentation [66.94945066779988]
  We introduce a new task, open-vocabulary camouflaged object segmentation (OVCOS) We construct a large-scale complex scene dataset (textbfOVCamo) containing 11,483 hand-selected images with fine annotations and corresponding object classes. By integrating the guidance of class semantic knowledge and the supplement of visual structure cues from the edge and depth information, the proposed method can efficiently capture camouflaged objects.
  arXiv  Detail & Related papers  (2023-11-19T06:00:39Z)
• On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrieval [59.25292920967197]
  Few-shot document entity retrieval (VDER) is an important topic in industrial NLP applications. FewVEX is a new dataset to boost future research in the field of entity-level few-shot VDER. We present a task-aware meta-learning based framework, with a central focus on achieving effective task personalization.
  arXiv  Detail & Related papers  (2023-11-01T17:51:43Z)
• Fingerprinting and Building Large Reproducible Datasets [3.2873782624127843]
  We propose a tool-supported approach facilitating the creation of large tailored datasets while ensuring their provenance. We propose a way to define a unique fingerprint to characterize a dataset which, when provided to the extraction process, ensures that the same dataset will be extracted.
  arXiv  Detail & Related papers  (2023-06-20T08:59:33Z)
• Partially-Aligned Data-to-Text Generation with Distant Supervision [69.15410325679635]
  We propose a new generation task called Partially-Aligned Data-to-Text Generation (PADTG) It is more practical since it utilizes automatically annotated data for training and thus considerably expands the application domains. Our framework outperforms all baseline models as well as verify the feasibility of utilizing partially-aligned data.
  arXiv  Detail & Related papers  (2020-10-03T03:18:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.