Instruction Duplication as an Inference-Time Control Primitive
- URL: http://arxiv.org/abs/2609.04024v1
- Date: Thu, 03 Sep 2026 16:05:21 GMT
- Title: Instruction Duplication as an Inference-Time Control Primitive
- Abstract summary: Procedural instruction following is a basic requirement for controllable language-model systems.<n>We introduce instruction duplication, a minimal black-box inference-time control that repeats only the procedural instruction.
- Score: 0.003596046562524959
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Procedural instruction following is a basic requirement for controllable language-model systems, especially when generated trajectories are inspected or repaired downstream. We introduce instruction duplication, a minimal black-box inference-time control that repeats only the procedural instruction, without retraining or decoding changes. Across seven instruction-tuned models, 300 medical multiple-choice questions, eight placement conditions, and 16,800 scheduled generations, moving from one to two copies raises the deterministic All-8 diagnostic--responses passing all eight observable tests--from 90.22% to 93.17% (+2.95 percentage points), eliminating 30.2% of the failures remaining after one copy. Pre-provisional TF-IDF recall rises from 73.44% to 74.81% (+1.38 points; Holm-adjusted p < .001), while final-answer accuracy remains exactly 60.21%. Premature commitment increases from 1.52% to 2.30% (p_Holm = .00536). A blinded challenge audit yields 10/30 directional confirmations, 20/30 perceptual ties, and no reversals; its prespecified 28/30 confirmation criterion is not met. Yet this distinction can matter operationally when a downstream system acts on the generated trajectory. In Answer Engineering (AE), where explicit trajectory state determines local repair, the published reason-first no-editing SSNHL endpoint was 25.1%; system-only AE was later reproduced at 84.2%, and the same trailing duplicate raised it to 97.1%. For conductive diagnostic branch preservation, the corresponding values are 58.9% published without editing, 78.6% with reproduced AE, and 73.8% with AE plus duplication--a within-AE decrease, but still 14.9 points above the no-editing baseline. Instruction duplication is therefore a low-complexity, placement-sensitive control whose practical value can emerge through the downstream system that consumes the exposed trajectory.
Related papers
- Approval Integrity and Recovery in LLM Answer Publication [0.2864713389096699]
LLM systems require binding approved content to its current authorization context.<n>We examine exact-content binding, authorization freshness and checkpoint recovery in Lightcap's publication enforcement mechanism.
arXiv Detail & Related papers (2026-09-14T13:48:48Z) - DriftNet: A Dual-Head Trajectory Transformer for Detecting and Localizing Prompt Injection in LLM Agents [0.0]
An operator needs three facts: where the attack entered, which steps it corrupted, and whether apparent poison was resisted.<n>We present DriftNet, a dual-head trajectory Transformer that reads a logged tool-call trajectory and answers all three questions in one forward pass.<n>To our knowledge it is the first supervised detector to produce this joint output.
arXiv Detail & Related papers (2026-09-09T22:52:23Z) - Rehearse: Stepping Back from the Confidence Cliff in Self-Improving Autoresearch [44.05969616406614]
Autoresearch improves machine-learning code by proposing changes, running full training jobs, and keeping changes that improve the metric.<n>We study how the reliability of this pre-execution judgment changes over the course of an autoresearch trajectory.
arXiv Detail & Related papers (2026-07-30T05:08:15Z) - Looping Is Not Reliability: State-Bound Evidence and Typed Revision Contracts for Agentic Code Repair [36.56438114281786]
We study the gap between finding a correct patch and retaining, verifying, and submitting it.<n>We derive an evidence-bound typed loop contract and instantiate its mechanically enforceable subset in a reference implementation.
arXiv Detail & Related papers (2026-07-27T16:05:23Z) - CUSUM-Shaped Inference-Time Monitoring and Targeted Re-Decoding for Quantized Small Language Model Reasoning [0.6999740786886536]
MGT-B maps overlapping windows of pre-sampling uncertainty and degeneration features to position-conditional empirical tail probabilities.<n>We audit whether the effect persists on problem identities first observed after the manual choice of log threshold h = 10.<n>Neither analysis is confirmatory, and the empirical factors are not established as a valid e-process or e-detector.
arXiv Detail & Related papers (2026-07-22T13:34:17Z) - Constrained Path Reasoning: Measuring When Committed Stages Earn Their Cost [2.9867974725783113]
Constrained Path Reasoning (CPR) pairs a source-aware path hypothesis with stage-level accounting.<n>CPR predicts that task-compatible commitments can factor transitions, concentrate candidate mass, induce regularity, and expose feedback when their gains exceed propagated error and execution cost.
arXiv Detail & Related papers (2026-07-19T13:11:18Z) - Efficient Visual Pointing for Embodied AI:Agent-Driven Data Synthesis, Cross-Block Attention, and Iterative Correction [55.11480729304395]
We describe our PointArena 2026 solution, which achieves 77.2% overall accuracy and ranks second on the benchmark.<n>The ap proach targets three failure modes. First, agent-driven syn thesis builds large semantic and anchor-relative candidate pools.<n>Second, a determinis tic steerable-data pipeline creates a verified 10,000-sample main set, plus reserve samples, using masks, templates, and path verification.
arXiv Detail & Related papers (2026-06-29T06:39:03Z) - Online Shift Detection and Conformal Adaptation for Deployed Safety Classifiers [0.0]
We present an online monitoring system for distributional shift in deployed safety classifiers.<n>After detection, a conformal abstention layer adapts decision to recover a target error.<n>The system achieves 86.6% detection with mean latency of 39.5800 steps.
arXiv Detail & Related papers (2026-06-10T11:24:25Z) - ReacTOD: Bounded Neuro-Symbolic Agentic NLU for Zero-Shot Dialogue State Tracking [2.2573512203799626]
We propose ReacTOD, a bounded neuro-symbolic architecture that reformulates NLU as discrete tool calls within a self-correcting ReAct loop governed by deterministic validation.<n>A bounded ReAct loop enables iterative self-correction, improving accuracy by up to 9.3 percentage points over single-pass inference on MultiWOZ.
arXiv Detail & Related papers (2026-05-18T20:06:04Z) - Step-wise Rubric Rewards for LLM Reasoning [72.17879367869503]
Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning in large language models.<n>We find 18.2% of steps in correct responses are wrong yet positively rewarded.<n>Across six mathematical reasoning benchmarks, SRaR improves average accuracy over RaR by 3.57 points.
arXiv Detail & Related papers (2026-05-17T07:08:14Z) - Distributional Energy-Based Models for Uncertainty-Aware Structured LLM Reasoning [40.342912574072024]
Large Language Models produce structured outputs such as travel plans or code solutions.<n>Individual reasoning steps may appear correct while the output as a whole violates budgets, fails test cases, or contradicts earlier deductions.<n>We propose a learned quality scorer with deterministic analytical constraint penalties for verifying structured LLM outputs.
arXiv Detail & Related papers (2026-05-15T17:08:27Z) - DART: Mitigating Harm Drift in Difference-Aware LLMs via Distill-Audit-Repair Training [18.22030439716779]
Large language models (LLMs) tuned for safety often avoid acknowledging demographic differences.<n>This identity-blindness yields incorrect responses, unnecessary refusals, or generic "equal-treatment" defaults.<n>We introduce DART (Distill--Audit-Repair Training), which distills label-conditioned reasoning from a teacher.
arXiv Detail & Related papers (2026-04-18T05:28:53Z) - Are Benchmark Tests Strong Enough? Mutation-Guided Diagnosis and Augmentation of Regression Suites [49.16055123488827]
Insufficiently strong test suites can admit plausible yet semantically incorrect patches, inflating reported success rates.<n>We introduce STING, a framework for targeted test augmentation that uses semantically altered program variants as diagnostic stressors.<n>STING produces 1,014 validated tests spanning 211 instances and increases patch-region line and branch coverage by 10.8% and 9.5%.
arXiv Detail & Related papers (2026-04-02T01:13:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.