Reproducibility is Not Enough: Artifact Verifiability in Decentralized-Build Package Ecosystems

• URL: http://arxiv.org/abs/2608.18180v1
• Date: Tue, 18 Aug 2026 02:30:23 GMT
• Title: Reproducibility is Not Enough: Artifact Verifiability in Decentralized-Build Package Ecosystems
• Abstract summary: Artifact verification requires recovering the source state, build environment, dependencies, and build instructions that produced the artifact.<n>Decentralized-build ecosystems make this difficult because artifacts are produced through heterogeneous tools and fragmented metadata.<n>This paper studies artifact verifiability across four popular decentralized-build package ecosystems.
• Score: 5.670956660842575
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reproducible and verifiable builds increase trust in distributed software artifacts by enabling independent parties to detect artifacts produced by compromised build or release pipelines. However, artifact verification requires more than deterministic builds: a verifier must also recover the source state, build environment, dependencies, and build instructions that produced the artifact. Decentralized-build ecosystems make this difficult because artifacts are produced through heterogeneous tools, maintainer-controlled workflows, and fragmented metadata. As a result, it remains unclear how often artifacts in these ecosystems can be independently verified. This paper studies artifact verifiability across four popular decentralized-build package ecosystems. We define an independent verifier model that relies only on registry-derivable metadata and an artifact comparison model with tiered equivalence levels. We implement these models in an Artifact Verification Pipeline and use it to measure artifact verifiability across the target ecosystems. Our results show that, beyond build determinism, verifiability is limited by missing source and build metadata, implicit release transformations, and unconventional build practices. Provenance attestations and embedded VCS metadata improve verification, but they do not provide complete rebuild specifications. These findings identify concrete metadata gaps and ecosystem-level changes needed to make artifact verification practical at package-registry scale.

Related papers

• Vero: Can AI Agents Build Formally Verified Software Repositories? [45.09790101960906]
  Vero is the first benchmark to evaluate joint implementation and proof at the repository level.<n>It contains 43 multi-module instances from real-world repositories spanning Python, Dafny, Verus, and Coq.<n>To improve benchmark reliability, Vero also includes an audit mechanism where agents are allowed to formally prove unsatisfiability of provided specification.
  arXiv  Detail & Related papers  (2026-08-13T17:41:27Z)
• QwenPaw-Data: Bridging Facts, Methodology, and Execution for Autonomous Enterprise Data Analytics [45.48758200829718]
  We introduce QwenPaw-Data, an agentic data system designed for enterprise intelligent data analysis.<n>QwenPaw-Data consolidates heterogeneous assets into reusable, governable, and evolvable analysis assets, then turns natural-language requests into end-to-end analytical spanning data understanding, retrieval, analysis, report generation, and decision support.
  arXiv  Detail & Related papers  (2026-07-13T02:38:00Z)
• Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs [21.170181670676566]
  We introduce ModSleuth, a system that reconstructs dependency graphs from public artifacts with source-grounded evidence.<n>Applying ModSleuth to four public-artifact-rich LLM releases, we recover 1,060 source-verified dependencies and construct large-scale dependency graphs.<n>These graphs reveal multi-hop license obligations, train-evaluation coupling, discrepancies between released and training-time artifacts, and documentation inconsistencies.
  arXiv  Detail & Related papers  (2026-06-10T17:47:59Z)
• The Custody Envelope Threshold: Authority-Scaled Admission of External Artifacts in Institutional Infrastructure [0.0]
  This paper proposes an authority-scaled model of artifact admission.<n>It argues that direct institutional admission is defensible only when object identity, ingress path, and revocation capacity are sufficiently closed.<n>It is applied to package dependencies, GitHub Actions, container images, Terraform providers and modules, developer extensions, and open model artifacts, with Model Context Protocol (MCP) servers treated as held-out evidence.
  arXiv  Detail & Related papers  (2026-06-04T23:09:15Z)
• Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs [46.60041435990374]
  We present FireFly, a pipeline for generating verified tool-call data from real-world MCP servers.<n>To handle the scale of real-world tool spaces, we build a pairwise tool graph and sample sub-DAGs.<n>Applying this pipeline yields 5,144 verified tasks spanning 240 servers and 993 tools.
  arXiv  Detail & Related papers  (2026-05-17T17:38:17Z)
• Intermediate Artifacts as First-Class Citizens: A Data Model for Durable Intermediate Artifacts in Agentic Systems [0.10312968200748114]
  We argue that such systems should preserve durable, inspectable intermediate artifacts.<n>We distinguish intermediate artifacts from chat transcripts, memory, hidden chain-of-thought, narration, thinking, and final answers.<n>It is that durable intermediate artifacts make AI-generated work more inspectable, revisable, and maintainable over time.
  arXiv  Detail & Related papers  (2026-05-12T13:09:07Z)
• Attesting LLM Pipelines: Enforcing Verifiable Training and Release Claims [2.0403981727850233]
  Modern Large Language Model (LLM) systems are assembled from third-party artifacts such as pre-trained weights, fine-tuning adapters, datasets, dependency packages, and container images.<n>This speed comes with supply-chain risks, including compromised dependencies, malicious hub artifacts, unsafe dedefaultization, forged provenance, and backdoored models.<n>We propose an attestation-aware promotion gate: before an artifact is admitted into trusted environments, the gate verifies claim evidence, enforces safe loading and static scanning policies, and applies secure-by-serial deployment constraints.
  arXiv  Detail & Related papers  (2026-03-30T20:37:48Z)
• Architecture-Aware Multi-Design Generation for Repository-Level Feature Addition [53.50448142467294]
  RAIM is a multi-design and architecture-aware framework for repository-level feature addition.<n>It shifts away from linear patching by generating multiple diverse implementation designs.<n>Experiments on the NoCode-bench Verified dataset demonstrate that RAIM establishes a new state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-03-02T12:50:40Z)
• interwhen: A Generalizable Framework for Verifiable Reasoning with Test-time Monitors [47.363850513075356]
  We present a test-time verification framework, interwhen, that ensures that the output of a reasoning model is valid wrt. a given set of verifiers.<n> Verified reasoning is an important goal in high-stakes scenarios such as deploying agents in the physical world.
  arXiv  Detail & Related papers  (2026-02-05T08:35:01Z)
• EvoSyn: Generalizable Evolutionary Data Synthesis for Verifiable Learning [63.03672166010434]
  We introduce an evolutionary, task-agnostic, strategy-guided, executably-checkable data synthesis framework.<n>It jointly synthesizes problems, diverse candidate solutions, and verification artifacts.<n>It iteratively discovers strategies via a consistency-based evaluator that enforces agreement between human-annotated and strategy-induced checks.
  arXiv  Detail & Related papers  (2025-10-20T11:56:35Z)
• Attestable Builds: Compiling Verifiable Binaries on Untrusted Systems using Trusted Execution Environments [2.4650753804485417]
  We present attestable builds, a new paradigm to provide strong source-to-binary correspondence in software artifacts.<n>Our system uses modern trusted execution environments (TEEs) and sandboxed build containers to provide strong guarantees that a given artifact was correctly built from a specific source code snapshot.
  arXiv  Detail & Related papers  (2025-05-05T10:00:04Z)
• Fake It Till Make It: Federated Learning with Consensus-Oriented Generation [52.82176415223988]
  We propose federated learning with consensus-oriented generation (FedCOG) FedCOG consists of two key components at the client side: complementary data generation and knowledge-distillation-based model training. Experiments on classical and real-world FL datasets show that FedCOG consistently outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-12-10T18:49:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.