The Last Human-Written Paper: Agent-Native Research Artifacts

• URL: http://arxiv.org/abs/2604.24658v2
• Date: Wed, 29 Apr 2026 18:21:16 GMT
• Title: The Last Human-Written Paper: Agent-Native Research Artifacts
• Abstract summary: We introduce the Agent-Native Research Artifact (ARA), a protocol that replaces the narrative paper with a machine-executable research package.<n>Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an ARA Compiler that translates legacy PDFs and repos into ARAs; and an ARA-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste.
• Score: 106.47848184955576
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Scientific publication compresses a branching, iterative research process into a linear narrative, discarding the majority of what was discovered along the way. This compilation imposes two structural costs: a Storytelling Tax, where failed experiments, rejected hypotheses, and the branching exploration process are discarded to fit a linear narrative; and an Engineering Tax, where the gap between reviewer-sufficient prose and agent-sufficient specification leaves critical implementation details unwritten. Tolerable for human readers, these costs become critical when AI agents must understand, reproduce, and extend published work. We introduce the Agent-Native Research Artifact (ARA), a protocol that replaces the narrative paper with a machine-executable research package structured around four layers: scientific logic, executable code with full specifications, an exploration graph that preserves the failures compilation discards, and evidence grounding every claim in raw outputs. Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an ARA Compiler that translates legacy PDFs and repos into ARAs; and an ARA-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste. On PaperBench and RE-Bench, ARA raises question-answering accuracy from 72.4% to 93.7% and reproduction success from 57.4% to 64.4%. On RE-Bench's five open-ended extension tasks, preserved failure traces in ARA accelerate progress, but can also constrain a capable agent from stepping outside the prior-run box depending on the agent's capabilities.

Related papers

• OpenAI4S: Code as Action, Science as Sessions [57.428071188574]
  We present OpenAI4S, an open-source scientific research agent built around the principle of emphCode as Action, Science as Sessions.<n>OpenAI4S combines a persistent computing runtime with research-session management orchestration is handled through structured tool calls.<n>We evaluate OpenAI4S on 36 research scenarios spanning retrosynthesis, molecular protein binder design, protein mutation, catalyst screening, and mineral spectroscopy.
  arXiv  Detail & Related papers  (2026-09-14T06:16:59Z)
• Who is the Agent to Blame? Localizing Faithfulness and Citation Mistakes in Agentic Deep Research [75.8770212601511]
  Deep research (DR) systems produce long-form cited reports by orchestrating multiple agents that search and synthesize information from the web.<n> Citations are the primary mechanism for evaluating the faithfulness of these reports, yet current DR systems exhibit poor citation recall.<n>We propose an evaluation method that pinpoints which agent introduced each error by locally testing agent invocations for faithfulness and verifiability relative to their own inputs.
  arXiv  Detail & Related papers  (2026-08-25T09:34:18Z)
• Apodex Discovery: Reality Benchmarks and Environments for Evaluating and Building Discoverative Artificial Intelligence [86.61561123749011]
  We introduce Apodex Discovery, a framework for building and evaluating discoverative AI through the heavy-duty solver.<n>First, a problem-scouting process surveyed 561 industries across 16 sectors, assembled 423 high-value real-world problems, and selected 20 for the initial release.<n>Second, a common environment-task-episode abstraction provides data, tools, constraints, feedback, trajectory recording, and verification of intermediate artifacts and final submissions.
  arXiv  Detail & Related papers  (2026-08-11T18:48:40Z)
• Can AI agents conduct open-ended AI research? Early evidence from two case studies [16.75408134467252]
  Evidence on whether agents can carry out open-ended AI research is thin.<n>Current evaluations either test agents on narrow tasks, which excludes open-ended research, or submit AI-generated papers to blind peer review.<n>We introduce a third way to measure progress towards AI R&D automation.
  arXiv  Detail & Related papers  (2026-07-29T17:57:19Z)
• ReproRepo: Scaling Reproducibility Audits with GitHub Repository Issues [54.98461672730087]
  We introduce ReproRepo, a scalable framework for evaluation that leverages human-raised GitHub issues as naturally occurring supervision on realistic reproduction blockers.<n>We instantiate ReproRepo on 1,149 recent machine learning papers from major conferences and evaluate four frontier model-agent configurations.<n>Our results show that LLM agents, even without executing code, can identify many real-world problems from paper-repository pairs.
  arXiv  Detail & Related papers  (2026-06-16T17:58:05Z)
• ResearchLoop: An Evidence-Gated Control Plane for AI-Assisted Research [4.9833735627186435]
  ResearchLoop is an evidence-gated control plane for AI-assisted computational research.<n>ResearchLoop treats research questions, task contracts, evidence objects, claim ledgers, closeouts, and paper bindings as durable project state.<n>This technical report provides the complete protocol specification, state model, transition rules, claim-admission algorithm, and insight-compounding mechanism.
  arXiv  Detail & Related papers  (2026-05-27T10:29:00Z)
• AI for Auto-Research: Roadmap & User Guide [107.0834449839233]
  We present an end-to-end analysis of AI across the complete research lifecycle.<n>We identify a sharp, stage-dependent boundary between reliable assistance and unreliable autonomy.<n>We show that greater automation can obscure rather than eliminate failure modes.
  arXiv  Detail & Related papers  (2026-05-18T17:08:26Z)
• ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration [10.076972559007116]
  ARIS (Auto-Research-in-sleep) is an open-source research harness for autonomous research.<n>ARIS coordinates machine-learning research through cross-model adversarial collaboration.
  arXiv  Detail & Related papers  (2026-05-04T18:10:15Z)
• PRBench: End-to-end Paper Reproduction in Physics Research [32.672534450424386]
  PRBench is a benchmark of 30 expert-curated tasks spanning 11 subfields of physics.<n>Agents are provided only with the task instruction and paper content, and operate in a sandboxed execution environment.<n>We evaluate a set of coding agents on PRBench and analyze their capabilities across key dimensions of scientific reasoning and execution.
  arXiv  Detail & Related papers  (2026-03-29T11:44:57Z)
• AI-Supervisor: Autonomous AI Research Supervision via a Persistent Research World Model [1.14219428942199]
  Existing automated research systems operate as stateless, linear pipelines.<n>We present textbfAI-Supervisor, a multi-agent orchestration framework.<n>Agents provide end-to-end AI research supervision driven by human interests.
  arXiv  Detail & Related papers  (2026-03-25T15:16:51Z)
• NoveltyAgent: Autonomous Novelty Reporting Agent with Point-wise Novelty Analysis and Self-Validation [34.18769961207746]
  We introduce NoveltyAgent, a multi-agent system designed to generate comprehensive and faithful novelty reports.<n>It decomposes manuscripts into discrete novelty points for fine-grained retrieval and comparison, and builds a comprehensive related-paper database.<n>Experiments show that NoveltyAgent achieves state-of-the-art performance, outperforming GPT-5 DeepResearch by 10.15%.
  arXiv  Detail & Related papers  (2026-03-21T17:19:11Z)
• AgentIR: Reasoning-Aware Retrieval for Deep Research Agents [76.29382561831105]
  Deep Research agents generate explicit natural language reasoning before each search call.<n> Reasoning-Aware Retrieval embeds the agent's reasoning trace alongside its query.<n>DR- Synth generates Deep Research retriever training data from standard QA datasets.<n>AgentIR-4B achieves 68% accuracy with the open-weight agent Tongyi-DeepResearch.
  arXiv  Detail & Related papers  (2026-03-04T18:47:26Z)
• FlyAOC: Evaluating Agentic Ontology Curation of Drosophila Scientific Knowledge Bases [10.00386797940562]
  We present FlyBench to evaluate AI agents on end-to-end agentic curation from scientific literature.<n>Given only a gene symbol, agents must search and read from a corpus of 16,898 full-text papers to produce structured annotations.<n>The benchmark includes 7,397 expert-curated annotations across 100 genes drawn from FlyBase.
  arXiv  Detail & Related papers  (2026-02-09T20:12:38Z)
• WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Research [73.58638285105971]
  This paper tackles textbfopen-ended deep research (OEDR), a complex challenge where AI agents must synthesize vast web-scale information into insightful reports.<n>We introduce textbfWebWeaver, a novel dual-agent framework that emulates the human research process.<n>Our framework establishes a new state-of-the-art across major OEDR benchmarks, including DeepResearch Bench, DeepConsult, and DeepResearchGym.
  arXiv  Detail & Related papers  (2025-09-16T17:57:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.