Reconcile Once, Write Anytime: A Trust-Tiered Librarian and a Multi-Agent Writer for Drift-Free, Point-in-Time Research
- URL: http://arxiv.org/abs/2608.12984v1
- Date: Thu, 13 Aug 2026 09:09:28 GMT
- Title: Reconcile Once, Write Anytime: A Trust-Tiered Librarian and a Multi-Agent Writer for Drift-Free, Point-in-Time Research
- Abstract summary: We present a two-tier agentic system that separates a maintained, point-in-time knowledge library from report writing.<n>A portable multi-agent "writer" runtime composes a contradiction-free, evidence-grounded report at any knowledge cutoff T.<n>We evaluate on a self-collected, public corpus of 6,130 sources yielding 555,926 evidence cards.
- Score: 7.426963307811556
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Long-form research reports generated by large language models drift, contradict themselves, and lose provenance: the same metric appears with different values, and rumor is quoted as confidently as an audited filing. We present a two-tier agentic system that separates a maintained, point-in-time knowledge library from report writing. A deterministic "librarian" ingests timestamped sources into a trust-tiered ontology, layering evidence cards, an authoritative metric ledger, and a claim graph into an always-current source of truth, not per-query RAG over raw chunks. A portable multi-agent "writer" runtime then composes a contradiction-free, evidence-grounded report at any knowledge cutoff T, reading only evidence with as_of <= T (no look-ahead); red-team verdicts flow back into the librarian. We evaluate on a self-collected, public corpus of 6,130 sources yielding 555,926 evidence cards (SEC EDGAR filings across 295 issuers and 11 sectors, U.S. Bureau of Labor Statistics releases, and Wikipedia). From the one library we compose four point-in-time reports on distinct theses and run eight reproducible experiments, whose headline metrics come from a deterministic quality-control gate, itself validated by defect-injection meta-evaluation at recall 1.0 and precision 1.0. A shared metric ledger removes 6,845 cross-section contradictions to zero. Tier-first selection is correct on 22/22 gold cases where a popularity-first baseline scores only 9/22; trust tiering leaks zero media-sourced numbers, and no government statistic displaces a company's own filing. A red-team refutation propagates back and self-corrects a later run with zero manual edits. Replay exhibits zero look-ahead violations across seven cutoffs while the library grows from 235,373 to 555,312 cards. Difficulty-tiered model routing exceeds the all-Opus quality ceiling while running 3.7x faster than serial.
Related papers
- SkillAtlas: An Attack Trace Library for Agent Skills [67.18648151130607]
We present SkillAtlas, a hosted attack trace library that converts private agent-skill security report bundles into reviewed, redacted, and searchable public cases.<n>The library contains 3,014 cases, 6,589 traces, 151,131 steps, 233 affected skills, and 8 risk categories.
arXiv Detail & Related papers (2026-09-11T16:44:39Z) - VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement [57.86962208273888]
We present an auditable physical-verification system in which a text-only planner compiles the prompt into typed physical obligations.<n>Each action returns a provenance-carrying evidence record whose payload, when usable, is either a typed measurement or an explicitly tagged learned state.<n>We anchor evaluation in a 1,500-clip corpus of human-annotated flaw records that localize real generation failures in prompt reference, space, and time.
arXiv Detail & Related papers (2026-09-02T20:36:45Z) - Who is the Agent to Blame? Localizing Faithfulness and Citation Mistakes in Agentic Deep Research [75.8770212601511]
Deep research (DR) systems produce long-form cited reports by orchestrating multiple agents that search and synthesize information from the web.<n> Citations are the primary mechanism for evaluating the faithfulness of these reports, yet current DR systems exhibit poor citation recall.<n>We propose an evaluation method that pinpoints which agent introduced each error by locally testing agent invocations for faithfulness and verifiability relative to their own inputs.
arXiv Detail & Related papers (2026-08-25T09:34:18Z) - Auditing the Synthetic Memoir: Measuring Scene-Level Confabulation in LLM-Generated Autobiography Against the Documented Record of the Life It Describes [0.0]
We present the first quantified audit of a large language model's autobiography against a subject-specific ground-truth corpus.<n>A 366-day "page-a-day" book of first-person anecdotal entries was drafted with a conversational LLM.<n>Every day was audited at the anecdote-scene level against an independent verification corpus.
arXiv Detail & Related papers (2026-08-23T20:10:50Z) - Quipu: A Governed Bitemporal Knowledge Graph Store [0.0]
Quipu is an embeddable knowledge store that inverts four default defaults.<n>No fact enters except through a gate whose predicates evaluate the pending post-state.<n>A trace from a governed writer surfaces a live enforcement gap the audit names with its remediation.
arXiv Detail & Related papers (2026-08-17T17:04:29Z) - Governed Persistent Memory: Source-Bound State Semantics and Fail-Closed Release for Long-Horizon Agents [3.202978695204522]
Long-term agent memory is usually treated as select--store--retrieve, but retrieval does not decide whether contradictory, superseded, retracted, deleted, or stale records may support an outgoing claim.<n>We introduce Governed Persistent Memory (GPM), an auditable bitemporal state-transition model with source-bound admission, derived lifecycle state, current public barriers, and fail-closed structured release.
arXiv Detail & Related papers (2026-08-12T18:00:42Z) - Beyond Top-K: Replacing Black-Box Retrieval with Interpretable Agentic Operations [0.0]
Retrieval-augmented generation over long documents is dominated by one design: chunk the text, embed the chunks, and surface the top-k nearest neighbours of the query.<n>We argue that for an important class of documents -- financial statements, audit reports, regulatory returns -- this design is structurally unsound.<n>We propose READ (Reliable Embedding-free Agentic Document-search), in which an agent reads the raw document through three deterministic operations.
arXiv Detail & Related papers (2026-08-06T17:23:13Z) - CrossAudit: A Git-Native, Cross-Vendor Audit Loop for Agentic Science [5.610929955077264]
CrossAudit is a protocol for supervising autonomous research pipelines.<n>Each increment of work is audited by an agent from a different vendor against a rulebook a human wrote and versioned.<n>Reports, verdicts, disputes and rulings are git commits, so the supervision history can be re-read and cited.
arXiv Detail & Related papers (2026-08-05T12:35:59Z) - The Half-Lives of Generative-AI Evidence: A 40-Record Audit, a Claim-Currency Framework, and a Reflexive Case of Frontier-Model-Assisted Research [0.0]
Generative-AI evaluations can become historical before publication, yet calendar age does not affect every conclusion equally.<n>This paper audits a maximum-variation purposive corpus of 40 empirical records appearing between 18 July 2025 and 17 July 2026.<n>The audit coded publication route, execution timing, model identity, age of the newest named generation or immutable snapshot, same-family supersession and refresh behaviour.
arXiv Detail & Related papers (2026-07-27T05:59:49Z) - Plato-Bio: verification-first biological novelty screening with temporal rediscovery and structural benchmarks [0.0]
We developed Plato-Bio, a biology-routed extension of the open Plato/Denario architecture.<n>Plato-Bio couples explicit workflow states with provenance records, citation checks, claim-to-evidence links, scoped file writes, and publication gates.<n>On the current clean revision, the full Python suite completed with 931 passes, six skips, and no failures or errors.
arXiv Detail & Related papers (2026-07-27T03:55:39Z) - Fantastic Adaptive Taxonomies and How to Use Them [100.20614173157708]
AdaMAST converts execution traces into a compact, evidence-grounded failure taxonomy.<n>No code is hand-authored, no trace human-annotated.<n>In agent-system search, taxonomy-coded diagnoses of failed candidates outperform free-form.
arXiv Detail & Related papers (2026-07-17T17:41:16Z) - Trust Before Fusion: QIMG-7 and Source-Aware Resolution for Polluted Multimodal RAG [45.88028371034407]
Multimodal retrieval-augmented generation (RAG) is often evaluated with clean evidence, yet real retrieval can return topically relevant but unreliable content.<n>We introduce QIMG-7, a benchmark for multimodal retrieval pollution in multi-sentence factual QA.<n>We propose source-aware trust resolution (SATR), a training-free approach that compares Parametric, Text-only, and Full-MM candidate answers.
arXiv Detail & Related papers (2026-07-12T15:13:09Z) - Catching One in Five: LLM-as-Judge Blind Spots in Production Multi-Turn Transaction Agents [45.148328075418156]
We study a deployed multi-turn food-and-beverage ordering agent and measure how many genuine quality problems it catches.<n>Our blind-spot taxonomy shows the failure is structured, not random.<n>For production multi-turn agents, automated judging is a regression floor, not a substitute for human review.
arXiv Detail & Related papers (2026-06-09T02:11:01Z) - The Last Human-Written Paper: Agent-Native Research Artifacts [106.47848184955576]
We introduce the Agent-Native Research Artifact (ARA), a protocol that replaces the narrative paper with a machine-executable research package.<n>Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an ARA Compiler that translates legacy PDFs and repos into ARAs; and an ARA-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste.
arXiv Detail & Related papers (2026-04-27T16:23:09Z) - FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Grounding [81.2130536158575]
LLMs exhibit remarkable fluency, their utility is often compromised by factual hallucinations and a lack of traceable provenance.<n>We introduce FactNet, a massive, open-source resource designed to unify 1.7 billion atomic assertions with 3.01 billion auditable evidence pointers derived exclusively from 316 Wikipedia editions.
arXiv Detail & Related papers (2026-02-03T11:44:11Z) - Fact Checking Beyond Training Set [64.88575826304024]
We show that the retriever-reader suffers from performance deterioration when it is trained on labeled data from one domain and used in another domain.
We propose an adversarial algorithm to make the retriever component robust against distribution shift.
We then construct eight fact checking scenarios from these datasets, and compare our model to a set of strong baseline models.
arXiv Detail & Related papers (2024-03-27T15:15:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.