EVAF: A Test-Retest Protocol for Selective Parametric Consolidation
- URL: http://arxiv.org/abs/2606.29916v1
- Date: Mon, 29 Jun 2026 07:53:50 GMT
- Title: EVAF: A Test-Retest Protocol for Selective Parametric Consolidation
- Abstract summary: We introduce EVAF, an Echo-Valence Attractor Field mechanism for gated LoRA consolidation.<n>Across GPT-2 and TinyLlama, EVAF preferentially consolidates high-valence, high-surprise experiences.<n>Test-retest measurements show stronger post-interference behavioral persistence than frozen, retrieval-only, and ungated continual-update baselines.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Long-running language agents need mechanisms for deciding which experiences should persist after the working context is gone. Retrieval systems can reinsert past text, but they do not by themselves show that an experience has been selectively consolidated into the model's own behavior. We introduce EVAF, an Echo-Valence Attractor Field mechanism for gated LoRA consolidation, and a test-retest protocol for measuring selective parametric consolidation under controlled interference. Across GPT-2 and TinyLlama, EVAF preferentially consolidates high-valence, high-surprise experiences while preserving retrieval-accessible factual memory through a complementary routed memory path. Test-retest measurements show stronger post-interference behavioral persistence than frozen, retrieval-only, and ungated continual-update baselines, while keeping parameter drift and cross-persona contamination low. The results support a separation between memory access and memory depth: retrieving a fact and internalizing an experience are distinct computational operations.
Related papers
- S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement? [66.17176838165994]
Large language models (LLMs) increasingly interact with external environments and accumulate substantial behavioral experience.<n>It remains unclear whether an agent can actively test its behavior, judge the resulting experience, and use that experience to improve future decisions.<n>We introduce textbfStextsuperscript3Gym, an interactive benchmark for evaluating LLM self-improvement.
arXiv Detail & Related papers (2026-08-31T17:05:41Z) - MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations [50.24315431387575]
We introduce MemOps, a benchmark that reformulates conversational memory as a sequence of lifecycle operations.<n>MemOps represents each memory event with a structured trace specifying its trigger, target, scope, state transition, and supporting evidence.<n>Across long-context, retrieval-based, parametric and managed-memory systems, MemOps disentangles failure modes that final-answer accuracy alone conceals.
arXiv Detail & Related papers (2026-07-14T15:33:44Z) - Beyond Perplexity: A Behavioral Evaluation Framework for Deployment-Memory Claims in LLM Test-Time Training [30.22002300048916]
Large language model test-time training (TTT) is often evaluated through local proxy metrics.<n>We introduce a behavioral evaluation framework that calibrates TTT memory claims to the evidence that supports them.
arXiv Detail & Related papers (2026-07-01T03:07:17Z) - Memory Depth, Not Memory Access: Selective Parametric Consolidation for Long-Running Language Agents [0.0]
We study memory depth: durable goal-conditioned tendencies written into a small parametric store.<n>We introduce the loop-drift protocol, a controlled stress test in which the retrieval index remains intact while working context is unloaded.<n>We find that selective consolidation factorizes into two controllable dimensions: selection and actuation.
arXiv Detail & Related papers (2026-06-25T09:42:56Z) - Governed Shared Memory for Multi-Agent LLM Systems [1.2178992475191557]
This paper formalizes the fleet-memory problem and identifies four foundational failure modes.<n>We define explicit systems-level primitives: scoped retrieval, temporal supersession, provenance tracking, and policy-governed memory propagation.<n>These primitives are implemented in MemClaw, a production multi-tenant memory service, and evaluated via ArgusFleet.
arXiv Detail & Related papers (2026-06-23T13:04:14Z) - PEAM: Parametric Embodied Agent Memory through Contrastive Internalization of Experience in Minecraft [59.80301645617478]
We present PEAM, a Parametric Embodied Agent Memory framework in Minecraft.<n>PEAM transforms agent memory from inference-time retrieval into parameter-resident skills internalized through experience.<n>We show that PEAM improves long-horizon task performance, mitigates forgetting on previously consolidated skills, and improves parametric-versus-retrieval efficiency.
arXiv Detail & Related papers (2026-05-26T23:20:58Z) - MIITA: Memory-Induced Inference-Time Adaptation for Continual Learning with Small Language Models [64.2820121997882]
MIITA is a Memory-Induced Inference-Time Adaptation framework for supervised CL under constrained storage.<n>It stores supervised experiences as compact correction-direction prototypes with semantic anchors, and retrieves them at inference time using semantic and uncertainty-based cues.<n>Experiments show that MIITA consistently improves final performance and mitigates forgetting under fixed memory budgets.
arXiv Detail & Related papers (2026-05-20T03:03:04Z) - GoTTA be Diverse: Rethinking Memory Policies for Test-Time Adaptation [54.70334474895361]
Test-time adaptation (TTA) enables a pre-trained model to adapt online to an unlabeled test stream under distribution shift.<n>While most TTA research focuses on the adaptation objective, practical streams also depend critically on the memory used to select which test samples drive adaptation.<n>We introduce Guided Observational Test-Time Adaptation (GOTTA), a family of diversity-aware memory policies that combine class-balanced allocation with feature-space diversity.
arXiv Detail & Related papers (2026-05-19T14:18:46Z) - Back to Source: Open-Set Continual Test-Time Adaptation via Domain Compensation [18.70132691409063]
Test-Time Adaptation aims to mitigate distributional shifts between training and test domains during inference time.<n>The coupling of domain and semantic shifts often collapses the feature space, severely degrading both classification and out-of-distribution detection.<n>We propose DOmain COmpensation (DOCO), a lightweight and effective framework that robustly performs domain adaptation and OOD detection in a synergistic, closed loop.
arXiv Detail & Related papers (2026-04-23T15:29:29Z) - TS-Memory: Plug-and-Play Memory for Time Series Foundation Models [63.21390142212087]
Time Series Foundation Models (TSFMs) achieve strong zero-shot forecasting through large-scale pre-training.<n>Existing solutions face a trade-off: Parametric Adaptation can cause catastrophic forgetting, while Non-Parametric Retrieval improves forecasts but incurs high latency due to datastore search.<n>We propose Parametric Memory Distillation and implement it as TS-Memory, a lightweight memory adapter that augments frozen TSFMs.
arXiv Detail & Related papers (2026-02-12T04:16:19Z) - Memory in Large Language Models: Mechanisms, Evaluation and Evolution [8.158439933515131]
We propose a four-part taxonomy (parametric, contextual, external, procedural/episodic) and a memory quadruple (location, persistence, write/access path, controllability)<n>For updating and forgetting, we present DMM Gov: coordinating DAPT/TAPT, PEFT, model editing (ROME, MEND, MEMIT, SERAC), and RAG to form an auditable loop.<n>This yields a reproducible, comparable, and governable coordinate system for research and deployment.
arXiv Detail & Related papers (2025-09-23T10:06:58Z) - Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt
Tuning [109.7767515627765]
We propose a new semiparametric paradigm of retrieval-enhanced prompt tuning for relation extraction.
Our model infers relation through knowledge stored in the weights during training.
Our method can achieve state-of-the-art in both standard supervised and few-shot settings.
arXiv Detail & Related papers (2022-05-04T23:38:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.