Assurance Envelopes for Autonomous Coding Agents: Minimum-Cost Evidence for Software Change
- URL: http://arxiv.org/abs/2609.16302v1
- Date: Mon, 14 Sep 2026 20:06:46 GMT
- Title: Assurance Envelopes for Autonomous Coding Agents: Minimum-Cost Evidence for Software Change
- Abstract summary: We ask which least-cost subset of available evidence re-establishes a required property.<n>We validate every selection by that closure rather than by trusting the closure.<n>Small graphs from Rust, IronBlocks, and Pong outcomes show that the minimum envelope depends on the task.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: When a coding agent returns to existing software, it inherits evidence from earlier engineering work: tests, type checks, proofs, static analyses, and traces. Reloading all of it is wasteful, but dropping a piece the change depends on can leave a required property unsupported. Given the properties a change must preserve, its obligations, we ask which least-cost subset of the available evidence re-establishes them, and we call such a subset a task-conditioned assurance envelope. Evidence and the rules that combine it form a typed inference graph; an obligation is met when forward chaining from the selected evidence reaches it, and we validate every selection by that closure rather than by trusting the optimizer. The software-derived graphs in our evaluation come from preserved outcomes of prior AI coding-agent runs; we freeze those artifacts and ask which accumulated evidence should be restored for a later task. Small graphs from Rust, IronBlocks, and Pong outcomes show that the minimum envelope depends on the task, that none may exist when current evidence cannot re-establish a required property, that some properties need several pieces of evidence together, and that expanding the requirements adds evidence rather than replacing it. A prespecified synthetic benchmark of 249 instances characterizes computation: a baseline that discards the 'several pieces together' structure necessarily fails to re-derive them; every completed exact cross-check agreed with the CP-SAT optimizer; and median solve time stayed below 20 ms at 500-evidence graphs, except that graphs with many alternative derivations per target timed out at far smaller sizes, so structure, not raw size, drives difficulty. The contribution is a bounded application of established optimization to selecting assurance context for a software change; discovering the obligations and downstream agent benefit remain open.
Related papers
- TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents [54.88208747581851]
Training-free visual token pruning can reduce this cost, but cache reuse introduces a fundamental constraint.<n>We propose textbfmethod, a training-free framework for emphtextbfTrajectory-textbfrobust textbfAdmission and textbfCoverage-aware textbfEvidence ordering.
arXiv Detail & Related papers (2026-09-09T15:12:48Z) - When Agents Implement Systems: A Case Study in Defects, Detection, and Evaluation Rigor [0.0]
We present a case study of one such agent implementing a multi-component data system against a detailed pre-existing specification.<n>We catalog five such defects, categorized by constraint violated and detection method.<n>Across retrieval budgets from 1 to 10 and 100 questions against a pooled corpus of 2994 paragraphs, filtered recall reaches its ceiling by a budget of 3, expected once candidates are restricted to the gold paragraphs themselves.
arXiv Detail & Related papers (2026-09-02T01:43:09Z) - EviGraph: Towards Verifiable Evidence Construction for Information-Seeking Agents [0.28675177318965045]
We present EviGraph, a deep-search framework that separates search execution from evidence recording.<n>The resulting graph serves both as persistent working memory and as a source of dense process rewards.<n>On BrowseComp-Plus, a Qwen3-8B EviGraph agent achieves 35.9% accuracy under a matched interaction budget.
arXiv Detail & Related papers (2026-08-25T15:06:54Z) - AuditCoder: Responsibility-Preserving Task Graphs for Auditable Code Generation and Bounded Repair [2.2743778085578437]
AuditCoder treats the program and an auditable construction trace as joint outputs.<n>For tasks with stable, locally testable boundaries, the graph functions not only as a decomposition structure but also as a persistent index for validation and repair.
arXiv Detail & Related papers (2026-07-31T15:29:14Z) - Fantastic Adaptive Taxonomies and How to Use Them [100.20614173157708]
AdaMAST converts execution traces into a compact, evidence-grounded failure taxonomy.<n>No code is hand-authored, no trace human-annotated.<n>In agent-system search, taxonomy-coded diagnoses of failed candidates outperform free-form.
arXiv Detail & Related papers (2026-07-17T17:41:16Z) - TTHE: Test-Time Harness Evolution [50.26245555541721]
Existing approaches optimize such harnesses before deployment, searching training or development data for a fixed agent workflow that is then frozen at test time.<n>We ask whether the harness can instead be optimized during evaluation itself, using only the unlabeled execution traces the agent produces on the test inputs.<n>During evaluation, TTHE maintains a population of candidate harnesses and refines them through an agentic proposer that reasons over their execution traces.<n>A judge then commits an improved harness from execution-derived proxy signals, and the selected program persists to govern subsequent inputs.
arXiv Detail & Related papers (2026-07-09T05:53:39Z) - AuditWeave: A Tamper-Evident, Auditor-Navigable Evidence Layer for AI-Assisted and Data-Transformation Workflows [0.0]
AuditWeave is a lightweight Python library that records the steps of AI-assisted and data-transformation into a single hash-chained ledger.<n>We describe the design and evaluate recording overhead, scalability, and tamper-detection correctness on the reference implementation.
arXiv Detail & Related papers (2026-06-14T21:46:04Z) - No Accidental Software Agent First Canonical Code for Human Code Entropy Reduction and 30 to 500 times Lower Frontier Model Requirements [0.0]
We propose a proof-carrying substrate that rewrites routine product software into canonical behavior profiles.<n>The proposed limit is a No-Accident Horizon: removable accident decreases until residual novelty, evidence, governance, risk, and future optionality dominate.<n>Preliminary QLoRA experiments on Qwen2.5-Coder-14B show that 64,088 canonical trajectories are learnable and suppress tested forbidden-language markers.
arXiv Detail & Related papers (2026-06-12T11:35:54Z) - TAPO: Tool-Aware Policy Optimization via Credit Transfer for Multimodal Search Agents [54.08846865906602]
We characterize credit misassignment as a systematic failure mode of GRPO in tool-augmented multimodal search agents.<n>We propose Tool-Aware Policy Optimization (TAPO), which exploits the parameter-determinism property of information-acquisition tools.
arXiv Detail & Related papers (2026-06-04T07:15:43Z) - VASO: Formally Verifiable Self-Evolving Skills for Physical AI Agents [57.240036084348354]
We introduce VASO, a framework for verification-guided self-evolution of robot skill contracts.<n>VASO verifies logically inconsistent skill contracts, then verifies plans induced by the skill against global and local temporal specifications.<n>On Clearpath Jackal and PX4 quadcopter tasks, VASO reaches 97.2% formal-specification compliance using fewer than 100 optimization samples.
arXiv Detail & Related papers (2026-06-03T20:02:35Z) - IMPACT-CYCLE: A Contract-Based Multi-Agent System for Claim-Level Supervisory Correction of Long-Video Semantic Memory [73.22944697933603]
Existing pipelines produce opaque, end-to-end outputs that expose no intermediate state for inspection.<n>We present IMPACT-Cycle, a supervisory multi-agent system that reformulates long-video understanding as a multimodal iterative claim-level maintenance.
arXiv Detail & Related papers (2026-04-22T03:03:33Z) - Reasoning Graphs: Self-Improving, Deterministic RAG through Evidence-Centric Feedback [0.0]
Language model agents reason from scratch on every query, discarding their chain of thought after each run.<n>We introduce reasoning graphs, a graph structure that persists per-evidence chain thought as structured edges connected to evidence items they evaluate.<n>We evaluate on MuSiQue and HotpotQA using a sequential cluster protocol, a high-reuse deployment simulation, and a determinism experiment.
arXiv Detail & Related papers (2026-04-08T20:57:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.