LLMCrater: Lifecycle-Aware FAIR Metadata Generation using Large Language Models
- URL: http://arxiv.org/abs/2608.23158v1
- Date: Mon, 24 Aug 2026 12:06:10 GMT
- Title: LLMCrater: Lifecycle-Aware FAIR Metadata Generation using Large Language Models
- Abstract summary: We present emphLLMCrater, a lifecycle-aware metadata generation framework.<n>It automatically extracts metadata from heterogeneous artifacts, generates and validates machine-actionable RO-Crates, and supports publication to FAIR repositories and PID services.<n>We demonstrate the approach using two representative use cases: a 5G experimentation environment within SLICES-RI and an experiment on GreenDIGIT's EcoJupyter platform.
- Score: 2.8978926857710263
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: FAIR (Findable, Accessible, Interoperable, and Reusable) metadata is essential for the discovery, interoperability, and reuse of scientific research assets. However, creating and maintaining FAIR metadata remains largely manual, making the process time-consuming for heterogeneous research artifacts generated throughout the research lifecycle. Existing approaches primarily generate metadata at publication time, missing opportunities to capture contextual information as it becomes available. To address this limitation, we present \emph{LLMCrater}, a lifecycle-aware metadata generation framework that combines Large Language Models (LLMs) with stage-specific RO-Crate metadata profiles. The framework progressively enriches metadata across four research lifecycle stages (Design, Development, Deployment, and Execution \& Provenance) while remaining compatible with RO-Crate~1.1 and EOSC metadata recommendations. It automatically extracts metadata from heterogeneous artifacts, generates and validates machine-actionable RO-Crates, and supports publication to FAIR repositories and PID services (e.g., Zenodo). We demonstrate the approach using two representative use cases: a 5G experimentation environment within SLICES-RI and an experiment on GreenDIGIT's EcoJupyter platform. Results show that LLMCrater progressively enriches metadata throughout the research lifecycle and generates valid RO-Crates conforming to the RO-Crate~1.1 specification.
Related papers
- Structure-Aware RAG: Structured Retrieval Augmented Generation from Noisy Data for Conversational Agents [68.52563127206808]
Structure-aware Retrieval Augmented Generation (SA-RAG) uses tables as an intermediate structured representation to provide a compact and controllable interface.<n>We introduce a quality-aware table metadata generation framework that models metadata normalization and effectiveness.<n>Experiments on two noisy real-world datasets show that SA-RAG significantly outperforms existing RAG baselines.
arXiv Detail & Related papers (2026-05-23T03:07:33Z) - The Reproducible Research Platform establishes a unified open science environment bridging data and software lifecycles across disciplines, from proposal to publication [0.0]
We developed the open-source Reproducible Research Platform (RRP), which unifies research data management with version-controlled, containerized computational environments.<n>RRP enables anyone to execute, reuse and publish fully documented, FAIR research without manual retrieval or platform-specific setup.<n>We demonstrate RRP's impact by reproducing results from diverse published studies, including work over a decade old, showing sustained usability.
arXiv Detail & Related papers (2025-12-04T22:02:19Z) - Metadata-Driven Retrieval-Augmented Generation for Financial Question Answering [0.0]
We introduce a sophisticated indexing pipeline to create contextually rich document chunks.<n>We benchmark a spectrum of enhancements, including pre-retrieval filtering, post-retrieval reranking, and enriched embeddings.<n>Our proposed optimal architecture combines LLM-driven pre-retrieval optimizations with these contextual embeddings to achieve superior performance.
arXiv Detail & Related papers (2025-10-28T13:16:36Z) - MeXtract: Light-Weight Metadata Extraction from Scientific Papers [48.73595915402094]
We present MeXtract, a family of lightweight language models designed for metadata extraction from scientific papers.<n>MeXtract achieves state-of-the-art performance on metadata extraction on the MOLE benchmark.<n>We release all the code, datasets, and models openly for the research community.
arXiv Detail & Related papers (2025-10-08T11:12:28Z) - Flexible metadata harvesting for ecology using large language models [3.4117490081172774]
We develop a large language model (LLM)-based metadata harvester.<n>It flexibly extracts metadata from any dataset's landing page.<n>It converts these to a user-defined, unified format using existing metadata standards.
arXiv Detail & Related papers (2025-08-21T10:10:29Z) - SMECS: A Software Metadata Extraction and Curation Software [0.0]
Metadata play a crucial role in adopting the FAIR principles for research software and enables findability and reusability.<n>We developed the Software Metadata Extraction and Curation Software (SMECS) which integrates the extraction of metadata from existing sources together with a user-friendly interface for metadata curation.<n> SMECS extracts metadata from online repositories such as GitHub and presents it to researchers through an interactive interface for further curation and export as a CodeMeta file.
arXiv Detail & Related papers (2025-07-24T07:53:46Z) - MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs [48.73595915402094]
MOLE is a framework that automatically extracts metadata attributes from scientific papers covering datasets of languages other than Arabic.<n>Our methodology processes entire documents across multiple input formats and incorporates robust validation mechanisms for consistent output.
arXiv Detail & Related papers (2025-05-26T10:31:26Z) - Procedural Environment Generation for Tool-Use Agents [55.10427063893754]
We introduce RandomWorld, a pipeline for the procedural generation of interactive tools and compositional tool-use data.<n>We show that models tuned via SFT and RL on synthetic RandomWorld data improve on a range of tool-use benchmarks.
arXiv Detail & Related papers (2025-05-21T14:10:06Z) - DiscoveryBench: Towards Data-Driven Discovery with Large Language Models [50.36636396660163]
We present DiscoveryBench, the first comprehensive benchmark that formalizes the multi-step process of data-driven discovery.
Our benchmark contains 264 tasks collected across 6 diverse domains, such as sociology and engineering.
Our benchmark, thus, illustrates the challenges in autonomous data-driven discovery and serves as a valuable resource for the community to make progress.
arXiv Detail & Related papers (2024-07-01T18:58:22Z) - TSGM: A Flexible Framework for Generative Modeling of Synthetic Time Series [61.436361263605114]
Time series data are often scarce or highly sensitive, which precludes the sharing of data between researchers and industrial organizations.
We introduce Time Series Generative Modeling (TSGM), an open-source framework for the generative modeling of synthetic time series.
arXiv Detail & Related papers (2023-05-19T10:11:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.