Harness Continual Learning: Continual Adaptation Beyond Model Parameters

• URL: http://arxiv.org/abs/2608.19013v1
• Date: Wed, 19 Aug 2026 15:12:31 GMT
• Title: Harness Continual Learning: Continual Adaptation Beyond Model Parameters
• Abstract summary: We formulate a new continual learning paradigm in which the harness evolves around a frozen foundation model.<n>A candidate commits a harness only after checking current improvement, historical retention, and validity.<n>Experiments demonstrate capability accumulation and failure recovery, with relative gains exceeding 10% over corresponding baselines in multiple settings.
• Score: 9.54786133734043
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Continual learning has largely been model-centric, treating model parameters as the state that changes with sequential experience. Modern agents can also adapt through a harness of prompts, memories, tools, skills, and routing rules. Because these contents jointly shape later execution, a harness update can disrupt previously reliable behavior even when the model is frozen. This raises a new question: how can an agent continually improve its state outside the model while retaining behavior acquired earlier? We formulate Harness Continual Learning (HCL), a new continual learning paradigm in which the harness evolves around a frozen foundation model, and define the resulting loss of earlier behavior as harness-level forgetting. We instantiate HCL with four execution-facing components: the Task Interface, Experience Memory, Capability Map, and Adaptive Router. We further introduce guarded harness evolution to separate update generation from state commitment. A Continual Optimizer proposes candidate harnesses from post-execution feedback, and a Continual Evaluator commits the resulting candidate harness only after checking current improvement, historical retention, and validity. Experiments on textual reasoning, multimodal perception, and open-world interaction demonstrate capability accumulation and failure recovery, with relative gains exceeding 10% over corresponding baselines in multiple settings. Component ablations assess the contribution of each harness component, while controlled retention sweeps reveal measurable harness-level forgetting and show that the stability--plasticity trade-off can be explicitly adjusted.

Related papers

• World Models for Embodied Intelligence: From Plausible to Controllable to Actionable [100.13060753774657]
  World models connect perception and decision-making in embodied intelligence by maintaining hidden state, anticipating consequences, comparing interventions, and adapting when execution departs from expectations.<n>This raises a central question: which predictive capabilities improve behavior?<n>We introduce three progressively stronger capability levels: Plausible models preserve task-relevant temporal, geometric, or physical structure; Controllable models additionally predict how interventions alter that structure; and Actionable models translate predictions into measurable gains in planning, action, learning, evaluation, verification, recovery, or data selection.
  arXiv  Detail & Related papers  (2026-09-15T06:22:42Z)
• EVOHARNESSBENCH: Can Your Agents Keep Pace with an Evolving Harness? [83.21711423118768]
  EVOHARNESSBENCH is a benchmark for evaluating agents under controlled harness evolution.<n>It contains 17 multi-stage harness streams constructed deterministically from verifier-based benchmarks.
  arXiv  Detail & Related papers  (2026-09-03T03:24:02Z)
• HELIX: Model-Harness Co-evolution for Recursive Self-Improvement [8.484282837156933]
  We present HELIX, a source-traceable substrate for harness evolution.<n>We show how harness evolution expands current capability and creates learning signal for the next model.
  arXiv  Detail & Related papers  (2026-08-14T04:44:53Z)
• Self-Evolving Embodied Agents via Skill-Harness Evolution [53.307052568223945]
  Embodied agents are increasingly built as systems around foundation models.<n>While supervised fine-tuning and reinforcement learning can adapt agents to new environments, they require additional data, rewards, and training runs.<n>We propose SHAPER, a self-evolving framework for train-free embodied adaptation that keeps model parameters frozen.
  arXiv  Detail & Related papers  (2026-08-11T18:55:58Z)
• Living-Harness Is an Interactive-Agent Evolver [15.081919387954578]
  Large language model (LLM) agents may recover from a failure within an episode or after a retry, yet the same execution failure can recur in later tasks.<n>We propose $textbfLiving-Harness, a self-evolving agent harness that converts each completed trajectory and its evaluator signals into posterior evidence for bounded harness updates.
  arXiv  Detail & Related papers  (2026-07-29T08:20:11Z)
• Recursive Harness Self-Improvement [28.432258880153125]
  Under model--harness co-evolution, harnesses are data-generating components whose execution traces can shape future foundation models.<n>We introduce Recursive Harness Self-Improvement (RHI), which represents the harness as a prompt-level specification of the agent loop.<n>RHI iteratively refines it using pairwise feedback over its own revision history.
  arXiv  Detail & Related papers  (2026-07-17T00:21:19Z)
• Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoning [8.33682726719781]
  In-time harnesses substantially improve large language models on complex reasoning tasks.<n>We introduce emphOn-Policy Harness Self-Distillation (OPHSD)<n>OPHSD internalizes task-specific harness capabilities into the student model.
  arXiv  Detail & Related papers  (2026-05-09T07:06:37Z)
• Spectral Imbalance Causes Forgetting in Low-Rank Continual Adaptation [58.3773038915023]
  Continual learning aims to adapt pre-trained models to sequential tasks without forgetting previously acquired knowledge.<n>Most existing approaches treat continual learning as avoiding interference with past updates, rather than considering what properties make the current task-specific update naturally preserve previously acquired knowledge.<n>We address this problem using a projected first-order method compatible with standard deep-dots used in vision-language models.
  arXiv  Detail & Related papers  (2026-01-31T13:27:02Z)
• Continual Learning in Vision-Language Models via Aligned Model Merging [84.47520899851557]
  We present a new perspective based on model merging to maintain stability while still retaining plasticity.<n>To maximize the effectiveness of the merging process, we propose a simple mechanism that promotes learning aligned weights with previous ones.
  arXiv  Detail & Related papers  (2025-05-30T20:52:21Z)
• Temporal-Difference Variational Continual Learning [77.92320830700797]
  We propose new learning objectives that integrate the regularization effects of multiple previous posterior estimations.<n>Our approach effectively mitigates Catastrophic Forgetting, outperforming strong Variational CL methods.
  arXiv  Detail & Related papers  (2024-10-10T10:58:41Z)
• Large Continual Instruction Assistant [59.585544987096974]
  Continual Instruction Tuning (CIT) is adopted to instruct Large Models to follow human intent data by data.<n>Existing update gradient would heavily destroy the performance on previous datasets during CIT process.<n>We propose a general continual instruction tuning framework to address the challenge.
  arXiv  Detail & Related papers  (2024-10-08T11:24:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.