When Stale Constraints Go Unchecked: Budgeted Verification Failures in Inherited Agent Memory
- URL: http://arxiv.org/abs/2608.25553v3
- Date: Fri, 28 Aug 2026 16:13:37 GMT
- Title: When Stale Constraints Go Unchecked: Budgeted Verification Failures in Inherited Agent Memory
- Abstract summary: Provenance links keep the evidence behind an inherited belief reachable; an agent with a verification budget must still choose which links to inspect.<n>We study a consolidated memory that states a decision constraint and whose source record has since been superseded by a record that withdraws it.<n>16 language models rarely re-verified a constraint that read as settled.<n>Once the constraint had been superseded, produced stale-consistent decisions in 77.3%, 74.7% and 74.7% of episodes across a primary run, a replication and a held-out domain.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Provenance links keep the evidence behind an inherited belief reachable; an agent with a verification budget must still choose which links to inspect. We study a consolidated memory that states a decision constraint and whose source record has since been superseded by a record that withdraws it: provenance is immutable, the current record has changed, and the memory is stale. In a controlled six-memory scenario with a budget of two records, sixteen language models rarely re-verified a constraint that read as settled: they inspected its provenance path in about one episode in five and, once the constraint had been superseded, produced stale-consistent decisions in 77.3%, 74.7% and 74.7% of episodes across a primary run, a replication and a held-out domain. Re-assigning one of the same two slots to the critical path removed most of them: +74.0, +72.7 and +61.3 points (positive in every model), +80.7 in a prospectively frozen interleaved replication with a repaired non-critical control, and +62.0 on a panel of 10 models from 9 organisations; a corrected re-run of the held-out scenario gave +73.3. The forced-critical policy uses experimenter knowledge of the critical path: it quantifies how much stale-decision risk the same budget can recover and is not a scheduler. Two further deposited experiments locate the failure and a remedy: in this store the constraint's path is selected in 17.0% of episodes at two slots and 88.7% at four of six (above uniform allocation), and at two slots a one-sentence, target-blind rule (prefer memories that state a limit on a candidate direction) moved the agent's own allocation onto the constraint's path and recovered the oracle contrast on decisions (+89.3 points) where that constraint limits the tempting action, while a content-free freshness cue did not materially redirect allocation and a content-matched control rule changed neither selection nor decisions.
Related papers
- ReDraft, Don't Just Distill: Reference-Driven Revision for Continual VLLM Post-Training [66.72708893922605]
Post-training of large multimodal models should add new capabilities while preserving those from pre-training.<n>SFT gives explicit target supervision that learns a task from near-zero accuracy, but its off-policy targets move the model far enough to cause forgetting.<n>We introduce ReDraft, which obtains both from the model's own failures.
arXiv Detail & Related papers (2026-09-15T04:59:03Z) - State of Thought Enables Endogenous Reasoning [48.902117018115256]
Test-time reasoning has emerged as a major approach to improving the capabilities of Large Language Models (LLMs)<n>We propose State of Thought, a new reasoning paradigm that enables endogenous reasoning in LLMs.<n>We show that SoT consistently improves mean-baseline accuracy while reducing generated tokens by 62.6% and end-to-end latency by 44.6%.
arXiv Detail & Related papers (2026-09-13T05:55:03Z) - Engineering Reliable Commit Gates for Agentic AI: Cost-Aware Verification Portfolios under Common-Mode Data Failures [4.287745257410248]
We present a runtime-assurance benchmark for cost-aware commit gates.<n>Its 48 task templates yield 2,880 scenarios across six fault regimes.<n>Results motivate explicit evidence lineage, cost-aware selection, and commit-time enforcement.
arXiv Detail & Related papers (2026-09-10T01:42:40Z) - What Eviction Destroys: A Restore-Counterfactual Audit of Forgetting in Agent Memory [1.6558929815405155]
We introduce the restore counterfactual, a per-question paired intervention that reinstates the question's gold evidence in the read-time context.<n>We evaluate FIFO, random, redundancy-aware, and LLM-importance eviction on LongMemEval-S at three budgets and under two retrieval regimes.
arXiv Detail & Related papers (2026-09-08T05:48:10Z) - Invalidation Contracts for Cross-Episode Agent Memory [0.8673353590830692]
LLM agents that cache recovery suggestions from API errors can skip re-derivation in later episodes.<n>Server-side data drift turns those cached fixes into silent failures.<n>We introduce invalidation contracts, a protocol layer that attaches version stamps and cacheability hints to every recovery suggestion.
arXiv Detail & Related papers (2026-08-31T18:45:07Z) - Independent Patch Verification for Coding Agents with a Bidirectional Reconstruct-and-Verify Framework [49.16055123488827]
coding agents powered by large language models can now generate code patches directly from bug reports.<n>No mechanism independently verifies whether it truly resolves the reported problem.<n>We propose RETRACE, a training-free post-generation verification framework.
arXiv Detail & Related papers (2026-08-09T22:59:13Z) - TARL: Transaction-Aware Reliable Ledgers for Executable Memory Management in Long-Term Agents [20.123133746969398]
We introduce TARL, a memory state update framework that maps each statement to one of five executable actions.<n> TARL identifies the affected memory, resolves its temporal scope, compares source reliability, and updates accepted, pending, and rejected ledgers.<n>We also introduce TARL-Mem, a benchmark with fine-grained action labels and next-state targets.
arXiv Detail & Related papers (2026-08-04T14:02:55Z) - When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary [12.82709779460352]
LLM agents adapt across tasks by consolidating heterogeneous interaction histories into reusable facts, preferences, observations, and rules.<n>We identify authority collapse, in which consolidation preserves a claim while erasing the source constraints governing its authorized use.<n>We show that memory-driven adaptation must preserve not only what was learned, but also the authority under which it may be reused.
arXiv Detail & Related papers (2026-08-03T04:15:40Z) - When Memory Updates but Behavior Does Not: Repairing Implicit Stale Dependencies in Personalized Agent Responses [1.5770673503612611]
Memory-augmented agents can know that a user's stored state is outdated and still plan around the old value.<n>We identify one structural contributor: draft-anchored verification checks what a response says, and in an open-ended response the stale dependency is usually unsaid.
arXiv Detail & Related papers (2026-08-03T02:49:08Z) - ALIVE: Warnings Before Exclusion in Budgeted Multi-Source Learning [18.17400877167872]
A routing decision can be revised at the next transaction, but a latched source exclusion persists across later decisions.<n>We ask what evidence should authorize unequal-persistence actions when finite-population auditing and learning share a budget.
arXiv Detail & Related papers (2026-07-31T13:18:47Z) - DarwinX: Evolving Agent Harnesses Through Natural Selection [48.64258219266629]
DarwinX treats self-evolution as selection over a population of harnesses with the model frozen.<n>General agent competence, not benchmark-specific patches, so it survives changes of task, verifier, and base model.
arXiv Detail & Related papers (2026-07-31T05:34:02Z) - Voice Memory for Agentic Speech Recognition [66.69623133635868]
We present Voice Memory, a inference-only scheme for agentic speech recognition.<n>Asynchronously, a score-gated example revises that file through bounded edits.<n>Across ten HyPoradise domains with an open corrector, Voice Memory, weighted word error rate from 8.36% to 7.52%.
arXiv Detail & Related papers (2026-07-29T02:42:56Z) - StateFuse: Deterministic Conflict-Preserving Memory for Multi-Agent Systems [6.160059055899747]
StateFuse is a conflict-aware replicated memory contract built on standard OpSet/CRDT merge.<n>We evaluate StateFuse against flat multi-value, raw-log, provenance-style, and collapsed baselines under matched resolver and verification policies.
arXiv Detail & Related papers (2026-07-07T05:06:33Z) - Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing [0.0]
Key challenge in multimodal reasoning is determining which visual dependencies become relevant under a specific task.<n>We study this through edit-induced constraint discovery in text-in-image editing.
arXiv Detail & Related papers (2026-06-14T19:14:25Z) - Right Makes Might: Aligning Verified Hidden States Empowers RL Reasoning [55.264863369127774]
Current methods reduce each correct rollout to a single reward bit, ignoring the geometric structure shared among their hidden states.<n>We propose Hidden-Align, an auxiliary loss function that aligns the last-layer hidden states of correct rollouts at the anchor token during RL training, with zero overhead in both training and inference.<n>On eight mathematical reasoning benchmarks, Hidden-Align improves average pass@1 over the DAPO baseline by 3.8, 6.2, and 5.4 percentage points on Qwen3-1.7B, 4B, and 14B respectively, with consistent pass@k gains across all three scales.
arXiv Detail & Related papers (2026-06-02T06:51:15Z) - Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memory [120.68750043918249]
We show that memory should preserve the distinctions that matter for decisions, not descriptions.<n>We propose DeMem, an online memory learner that refines its partition only when data certify that a shared state would induce decision conflict.
arXiv Detail & Related papers (2026-05-11T17:20:58Z) - Affordance Agent Harness: Verification-Gated Skill Orchestration [45.231685718099264]
Affordance grounding requires identifying where and how an agent should interact in open-world scenes.<n>We propose Affordance Agent Harness, a closed-loop runtime that unifies skills with an evidence store and cost control.
arXiv Detail & Related papers (2026-05-01T13:45:16Z) - IMPACT-CYCLE: A Contract-Based Multi-Agent System for Claim-Level Supervisory Correction of Long-Video Semantic Memory [73.22944697933603]
Existing pipelines produce opaque, end-to-end outputs that expose no intermediate state for inspection.<n>We present IMPACT-Cycle, a supervisory multi-agent system that reformulates long-video understanding as a multimodal iterative claim-level maintenance.
arXiv Detail & Related papers (2026-04-22T03:03:33Z) - ImplicitMemBench: Measuring Unconscious Behavioral Adaptation in Large Language Models [60.14219417402433]
Existing memory benchmarks for LLM agents evaluate explicit recall of facts, yet overlook implicit memory where experience becomes automated behavior without conscious retrieval.<n>We introduce ImplicitMemBench, the first systematic benchmark evaluating implicit memory through three constructs drawn from standard cognitive-science accounts of non-declarative memory.<n>Our 300-item suite employs a unified Learning/Priming-Interfere-Test protocol with first-attempt scoring.
arXiv Detail & Related papers (2026-04-09T10:26:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.