The Half-Lives of Generative-AI Evidence: A 40-Record Audit, a Claim-Currency Framework, and a Reflexive Case of Frontier-Model-Assisted Research

• URL: http://arxiv.org/abs/2607.24032v1
• Date: Mon, 27 Jul 2026 05:59:49 GMT
• Title: The Half-Lives of Generative-AI Evidence: A 40-Record Audit, a Claim-Currency Framework, and a Reflexive Case of Frontier-Model-Assisted Research
• Abstract summary: Generative-AI evaluations can become historical before publication, yet calendar age does not affect every conclusion equally.<n>This paper audits a maximum-variation purposive corpus of 40 empirical records appearing between 18 July 2025 and 17 July 2026.<n>The audit coded publication route, execution timing, model identity, age of the newest named generation or immutable snapshot, same-family supersession and refresh behaviour.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generative-AI evaluations can become historical before publication, yet calendar age does not affect every conclusion equally. This paper has two linked purposes. First, it audits a maximum-variation purposive corpus of 40 empirical records appearing between 18 July 2025 and 17 July 2026. The audit coded publication route, execution timing, model identity, age of the newest named generation or immutable snapshot, same-family supersession and refresh behaviour. At appearance, the newest named model was a median 281 days old (middle 50%: 75-478; range: 11-939). Median age was 395 days for 25 journal articles, 56 days for 14 preprints and 49 days for one laboratory report. Thirty-five records included a superseded family, seven supplied a precise dated identifier, three clearly refreshed model evidence, and one added a late sensitivity test. All 40 included an OpenAI system, a feature of this corpus rather than a prevalence estimate. The paper distinguishes model age from claim currency and proposes six reporting practices. Second, it treats its own two-day production process as a reflexive case of frontier-model-assisted research creation. GPT-5.6 Sol Pro in ChatGPT supported candidate discovery, source reconciliation, calculations, drafting and critique; the author checked sources, made all substantive decisions and accepts responsibility. This is a proof-of-practice, not a controlled estimate of productivity or quality. By applying its own Model Facts and model-currency statement, the paper shows how rapid AI-assisted research can be made inspectable without treating model output as independent validation. The title uses half-lives metaphorically; no universal decay rate is estimated.

Related papers

• NovGauge: A Fine-Grained Benchmark for Diagnosing LLMs' Capability in Paper Novelty Assessment [54.4265627247104]
  Large language models (LLMs) are increasingly used in peer review at major AI conferences.<n>Existing benchmarks assess novelty as a single holistic score.<n>We present NovGauge, a human-anchored benchmark for fine-grained novelty assessment diagnosis.
  arXiv  Detail & Related papers  (2026-09-10T08:34:56Z)
• AgentIdeaBench: Benchmarking Scientific Ideation in the Agent Era [55.37558486468993]
  We introduce AgentIdeaBench, a benchmark that evaluates scientific ideation under two matched settings, static observation and active exploration.<n>We report matched Static-Active evaluations for 33 LLMs across 40 densely scored subfields spanning five disciplines.<n>Active exploration reveals considerably more capability headroom, and that headroom is unevenly distributed across models.
  arXiv  Detail & Related papers  (2026-09-07T15:19:13Z)
• Model Retirement Creates Reproducibility Risk in Biomedical AI Publications [0.0]
  We searched PubMed for original research articles that applied a specific large language model to a biomedical task.<n>We identified 8,931 paper-model mentions spanning 5,242 unique publications.<n>Overall, 42% involved a model that was already retired by the time of official publication or is scheduled to retire within two years of publication.
  arXiv  Detail & Related papers  (2026-09-04T04:00:54Z)
• Auditing the Synthetic Memoir: Measuring Scene-Level Confabulation in LLM-Generated Autobiography Against the Documented Record of the Life It Describes [0.0]
  We present the first quantified audit of a large language model's autobiography against a subject-specific ground-truth corpus.<n>A 366-day "page-a-day" book of first-person anecdotal entries was drafted with a conversational LLM.<n>Every day was audited at the anecdote-scene level against an independent verification corpus.
  arXiv  Detail & Related papers  (2026-08-23T20:10:50Z)
• From Traceability to Justifiability: Accountability Structures in Agentic Software Engineering [0.0]
  We measure, from public material only, whether AI records can express a claim and whether they hold where declared.<n>Across 188 double-graded cells we found no platform whose default record emits a content identity of a behavioral system.<n>An instrument computes realized assurance depth from a pipeline's published exhaust alone and compares it with the declared depth.
  arXiv  Detail & Related papers  (2026-08-21T16:45:00Z)
• Reconstruction: A Blind Benchmark for Recovering Research Ideas from Pre-Publication Bibliographies [5.8079638399400375]
  We introduce Reconstruction, a blind idea-recovery benchmark that withholds the seed paper and all contemporaneous or future literature.<n>We ask models to propose hypotheses that an independent large language model judge matches against the held-out ground-truth idea.
  arXiv  Detail & Related papers  (2026-08-17T14:44:30Z)
• Reconcile Once, Write Anytime: A Trust-Tiered Librarian and a Multi-Agent Writer for Drift-Free, Point-in-Time Research [7.426963307811556]
  We present a two-tier agentic system that separates a maintained, point-in-time knowledge library from report writing.<n>A portable multi-agent "writer" runtime composes a contradiction-free, evidence-grounded report at any knowledge cutoff T.<n>We evaluate on a self-collected, public corpus of 6,130 sources yielding 555,926 evidence cards.
  arXiv  Detail & Related papers  (2026-08-13T09:09:28Z)
• From Interpretability to Control: Insights from Six Years of the TrustNLP Workshop [63.00693129203923]
  The Workshop on Trustworthy Natural Language Processing has grown from 8 proceedings papers to 41 over six editions.<n>We synthesize insights from all 144 proceedings papers, classifying them along six trust dimensions grounded in established frameworks.<n>Analysis from the classification study reveals that truthfulness is the fastest-growing dimension (absent in 2021-2022, comprising 37% of papers by 2025-2026)
  arXiv  Detail & Related papers  (2026-08-11T17:30:16Z)
• Plato-Bio: verification-first biological novelty screening with temporal rediscovery and structural benchmarks [0.0]
  We developed Plato-Bio, a biology-routed extension of the open Plato/Denario architecture.<n>Plato-Bio couples explicit workflow states with provenance records, citation checks, claim-to-evidence links, scoped file writes, and publication gates.<n>On the current clean revision, the full Python suite completed with 931 passes, six skips, and no failures or errors.
  arXiv  Detail & Related papers  (2026-07-27T03:55:39Z)
• The Two-Process Theory of Machine Self-Report [0.0]
  We propose the first language-model-specific psychometric theory of machine self-report.<n>We operationalize the theory in a 48-item Pinocchio Inventory with human-instrument reliability.<n>We test it on 206 open-weight models, including 67 same-checkpoint base/post-trained pairs.
  arXiv  Detail & Related papers  (2026-07-22T12:35:36Z)
• Modality-Driven Search with Holistic Trace Judging for ARC-AGI-2 [0.0]
  I present a solver for ARC-AGI-2, a few-shot visual reasoning benchmark.<n>It generates diverse candidates independently across text, image, and code channels.<n>Unlike self-consistency or majority voting, it reliably recovers correct minority hypotheses on tasks where the modal answer is wrong.
  arXiv  Detail & Related papers  (2026-06-30T11:55:33Z)
• Frontier Lag: A Bibliometric Audit of Capability Misrepresentation in Academic AI Evaluation [0.0]
  We compare tested models to the contemporaneous frontier on the Epoch AI Capabilities Index.<n>The gap between these answers is widening at +5.53 ECI/year.<n>Proposed remedies include API-access subsidies and editorial enforcement of reporting frameworks.
  arXiv  Detail & Related papers  (2026-05-05T17:58:35Z)
• The Last Human-Written Paper: Agent-Native Research Artifacts [106.47848184955576]
  We introduce the Agent-Native Research Artifact (ARA), a protocol that replaces the narrative paper with a machine-executable research package.<n>Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an ARA Compiler that translates legacy PDFs and repos into ARAs; and an ARA-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste.
  arXiv  Detail & Related papers  (2026-04-27T16:23:09Z)
• TSVer: A Benchmark for Fact Verification Against Time-Series Evidence [8.095827820420839]
  We introduce TSVer, a new benchmark dataset for fact verification focusing on temporal and numerical reasoning with time-series evidence.<n> TSVer contains 287 real-world claims sourced from 38 fact-checking organizations and a curated database of 400 time series covering diverse domains.
  arXiv  Detail & Related papers  (2025-11-02T22:33:19Z)
• Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models [44.31597857713689]
  We introduce Active Indexing for the first stage, which creates generalizable, source-anchored bindings.<n>Experiments with Qwen-2.5-7B&3B show that Active Indexing consistently outperforms a Passive Indexing baseline.<n> internal citations complement external ones by making the model more robust to retrieval noise.
  arXiv  Detail & Related papers  (2025-06-21T04:48:05Z)
• GERE: Generative Evidence Retrieval for Fact Verification [57.78768817972026]
  We propose GERE, the first system that retrieves evidences in a generative fashion. The experimental results on the FEVER dataset show that GERE achieves significant improvements over the state-of-the-art baselines.
  arXiv  Detail & Related papers  (2022-04-12T03:49:35Z)
• The MultiBERTs: BERT Reproductions for Robustness Analysis [86.29162676103385]
  Re-running pretraining can lead to substantially different conclusions about performance. We introduce MultiBERTs: a set of 25 BERT-base checkpoints. The aim is to enable researchers to draw robust and statistically justified conclusions about pretraining procedures.
  arXiv  Detail & Related papers  (2021-06-30T15:56:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.